Vacancy description
artech l.l.c.
India, India
Data Engineer SQL - Remote (m/w/d) in India, India is listed on Jobeax. Browse 30,000+ vacancies available.
Databricks Engineer Location - Remote
Data & AI Platform Engineering (Databricks-Centric):
Design, implement, and optimize end-to-end data pipelines on Databricks, following the Medallion Architecture principles.
Build robust and scalable ETL/ELT pipelines using Apache Spark and Delta Lake to transform raw (bronze) data into trusted curated (silver) and analytics-ready (gold) data layers.
Apply schema evolution and data versioning to support agile data development.
Platform Integration & Data Ingestion:
Connect and ingest data from enterprise systems such as PeopleSoft, D2L, and Salesforce using APIs, JDBC, or other integration frameworks.
Implement connectors and ingestion frameworks that accommodate structured, semi-structured, and unstructured data.
Design standardized data ingestion processes with automated error handling, retries, and alerting.
Data Quality, Monitoring, and Governance:
Develop data quality checks, validation rules, and anomaly detection mechanisms to ensure data integrity across all layers.
Integrate monitoring and observability tools (e.g., Databricks metrics, Grafana) to track ETL performance, latency, and failures.
Implement Unity Catalog or equivalent tools for centralized metadata management, data lineage, and governance policy enforcement.
Enforce data security best practices including row-level security, encryption at rest/in transit, and fine-grained access control via Unity Catalog.
Design and implement data masking, tokenization, and anonymization for compliance with privacy regulations (e.g., AI/ML-Ready Data Foundation:
Enable data scientists by delivering high-quality, feature-rich data sets for model training and inference.
Support AIOps/MLOps lifecycle workflows using MLflow for experiment tracking, model registry, and deployment within Databricks.
Collaborate with AI/ML teams to create reusable feature stores and training pipelines.
Cloud Data Architecture and Storage:
Architect and manage data lakes on Azure Data Lake Storage (ADLS) or Amazon S3, and design ingestion pipelines to feed the bronze layer.
Build data marts and warehousing solutions using platforms like Databricks.
Optimize data storage and access patterns for performance and cost-efficiency.
Maintain technical documentation, architecture diagrams, data dictionaries, and runbooks for all pipelines and components.
Provide training and enablement sessions to internal stakeholders on the Databricks platform, Medallion Architecture, and data governance practices.
Track deliverables against roadmap milestones and communicate risks or dependencies.
Hands-on experience with Databricks, Delta Lake, and Apache Spark for large-scale data engineering.
Deep understanding of ELT pipeline development, orchestration, and monitoring in cloud-native environments.
Experience implementing Medallion Architecture (Bronze/Silver/Gold) and working with data versioning and schema enforcement in enterprise grade environments.
Strong proficiency in SQL, Python, or Scala for data transformations and workflow logic.
Proven experience integrating enterprise platforms (e.g., PeopleSoft, Salesforce, D2L) into centralized data platforms.
Familiarity with data governance, lineage tracking, and metadata management tools.
Experience with Databricks Unity Catalog for metadata management and access control.
Experience deploying ML models at scale using MLFlow or similar MLOps tools.
Familiarity with cloud platforms like Azure or AWS, including storage, security, and networking aspects.
Knowledge of data warehouse design and star/snowflake schema modeling.
Similar vacancies
Straive
... a related field (Master's degree preferred). Core Technical Skills: Python, PySpark, Databricks, Google ADK, LLMs, FastAPI, Spring Boot, Microservices, Kafka, SQL, Data Mesh, Starburst. Infrastructure and Cloud: Kubernetes, OpenShift, Docker, Cloud-Native Infrastructure, CI/CD pipelines. Industry Context: Data engineering ...
India, Pune
MapOut Digital Solutions Inc
Rs 2.5 - 4.5 lakhs p.a.
We are looking for a Data Engineer to join our team and play a key role in building, optimizing, and managing data pipelines. You will work closely with Data Analysts and Business Functions to ensure seamless data processing, reporting, and dashboarding. Our tech stack includes BigQuery, Snowflake, Airflow, Stitch/Fivetran, ...
India, Bengaluru
Path Mentors Staffing Solution
... Python, SQL, and Spark/PySpark.- Hands-on experience with Azure Data Factory, Azure Databricks, and/or Synapse Analytics.- Experience with ETL/ELT frameworks and data integration tools.- Good understanding of data engineering concepts and data pipeline architecture.- Experience with data transformation, processing, and optimization.- ...
India, Bengaluru
Equal Experts
... experience with Python, SQL, and PySpark. Strong understanding of unit testing, test automation, debugging, and code quality best practices. Good understanding of data engineering fundamentals and advanced concepts. Experience building scalable and fault-tolerant data pipelines. Strong knowledge of CI/CD, automated testing, ...
India, Bengaluru
Zinnia - Employee Referral
$180 USD
... Bachelor/Master's Degree with 4+ years of experience across Data Engineering (Data Pipelining, Warehousing, ETL Tools etc.) Extensive hands-on experience with data engineering techniques and Python & SQL Strong working knowledge of Snowflake, Airflow and dbt You are comfortable and have expertise in data engineering tooling ...
India, Gurugram
Accenture
Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Python (Programming ...
India, Mumbai
... relocation Remote Type: This position is fully remote Commercial Acumen, Communication, Data Analysis, Data cleansing and transformation, Data domain knowledge, Data Integration, Data Management, Data Manipulation, Data Sourcing, Data strategy and governance, Data Structures and Algorithms (Inactive), Data visualization and ...
India, Pune
applied systems india
... pipelines with automated data quality checks to support business needs and demonstrate ownership of live data pipelines. Proficiency understanding and implementing data life cycles, data lineage, custom metadata, and data governance. Proficiency implementing BigQuery SQL procedures, functions, and similar, with actionable logging ...
India, Bengaluru
GenY Medium
At GenY Medium, we don’t just market brands — we make them impossible to ignore. We’re a national digital marketing agency working with enterprise brands and fast-growing startups.
India, Hyderabad
Communication Crafts
... designers and account managers, occasionally with other leaders Attending client meetings for new projects along with the team, asking the right questions to collect data to work on the project successfully Creating content maps, sitemaps, content inventory and wireframes and writing content primarily for websites, brochures, landing ...
India, Ahmedabad
NxtWave
Key Responsibilities Execute 2 brand campaigns/month, collaborating with design, video, and ORM teams Identify 5–10 trending posts/month for witty, brand-safe comment interventions Craft content across formats—social media, scripts, influencer assets, digital copy Collaborate on IP and content integration ideas; own
India, Rāniganj
thecreatorsproject
Copywriter & Client Servicing Executive: Type: Full-time | Location: In-office ( Chembur, Mumbai ) | Experience: 0–2 years We're looking for a Copywriter & Client Servicing Executive to join our brand strategy team.
India, Mumbai
Clevertize
Job Title: Copywriter Location: [Bangalore / Mumbai] | Hybrid / On-site Experience: 2+ years | Digital Agency Background Mandatory About the Role We're looking for a creative and digitally savvy Copywriter who can craft compelling narratives, spark fresh ideas, and bring big brand campaigns to life.
India, Bengaluru
Subject Matter Expert (SME) / Technical Support Engineer Location-Hyderabad Company- MNC Client of Adecco The Subject Matter Expert (SME) / Technical Support Engineer is responsible for providing advanced technical expertise and support for products (UPS, STS, PDU, APF Etc) under DCS Power and critical customer applications. ...
India, Rāniganj
... expectations are met through disciplined implementation (access controls, lineage, and quality standards) 5+ years building and operating production data pipelines (data engineering—not primarily BI/analytics or data science) - Strong SQL plus strong data modeling skills (dimensional and/or lakehouse modeling) - Hands-on Databricks ...
India, Bengaluru
A client of People Impact
Job Summary :The Data Integration Engineer will design, develop, and support data integration solutions that extract financial and operational data from enterprise source systems and deliver trusted data to analytics platforms and external vendors. The role emphasizes source-to-target mapping, transformation, validation, ...
India, Bengaluru
SHIMENTO INDIA LLP
... experience in Data Engineering.- Strong Python + SQL expertise.- Strong Data Architecture and System Design skills.- End-to-end production pipeline ownership.- Expert SQL including Window Functions, CTEs, CASE logic.- Strong experience with MySQL / PostgreSQL.- Experience designing Transaction / Fact Tables.- Strong data quality, ...
India, Bengaluru
webologix ltd/ inc
... with source code versioning tools, specifically Github Familiar with security concept and integration is must, like cert pinning, encryption and decryption and data protection Deep experience working on a team of Android engineers building and maintaining large scale apps, or apps that you have built personally Comfortable ...
India, Pune
Mietwasch
2800
Gemeinsam Technik am Laufen halten. Gemeinsam Qualität sichern. Seit über 30 Jahren steht die Mietwasch GmbH & Co. KG für zuverlässige Wasch- und Trockenlösungen in ganz Deutschland.
India, Rāniganj