Vacancy description
artech l.l.c.
India, India
Data Engineer SQL - Remote (m/w/d) in India, India is listed on Jobeax. Browse 30,000+ vacancies available.
Databricks Engineer Location - Remote
Data & AI Platform Engineering (Databricks-Centric):
Design, implement, and optimize end-to-end data pipelines on Databricks, following the Medallion Architecture principles.
Build robust and scalable ETL/ELT pipelines using Apache Spark and Delta Lake to transform raw (bronze) data into trusted curated (silver) and analytics-ready (gold) data layers.
Apply schema evolution and data versioning to support agile data development.
Platform Integration & Data Ingestion:
Connect and ingest data from enterprise systems such as PeopleSoft, D2L, and Salesforce using APIs, JDBC, or other integration frameworks.
Implement connectors and ingestion frameworks that accommodate structured, semi-structured, and unstructured data.
Design standardized data ingestion processes with automated error handling, retries, and alerting.
Data Quality, Monitoring, and Governance:
Develop data quality checks, validation rules, and anomaly detection mechanisms to ensure data integrity across all layers.
Integrate monitoring and observability tools (e.g., Databricks metrics, Grafana) to track ETL performance, latency, and failures.
Implement Unity Catalog or equivalent tools for centralized metadata management, data lineage, and governance policy enforcement.
Enforce data security best practices including row-level security, encryption at rest/in transit, and fine-grained access control via Unity Catalog.
Design and implement data masking, tokenization, and anonymization for compliance with privacy regulations (e.g., AI/ML-Ready Data Foundation:
Enable data scientists by delivering high-quality, feature-rich data sets for model training and inference.
Support AIOps/MLOps lifecycle workflows using MLflow for experiment tracking, model registry, and deployment within Databricks.
Collaborate with AI/ML teams to create reusable feature stores and training pipelines.
Cloud Data Architecture and Storage:
Architect and manage data lakes on Azure Data Lake Storage (ADLS) or Amazon S3, and design ingestion pipelines to feed the bronze layer.
Build data marts and warehousing solutions using platforms like Databricks.
Optimize data storage and access patterns for performance and cost-efficiency.
Maintain technical documentation, architecture diagrams, data dictionaries, and runbooks for all pipelines and components.
Provide training and enablement sessions to internal stakeholders on the Databricks platform, Medallion Architecture, and data governance practices.
Track deliverables against roadmap milestones and communicate risks or dependencies.
Hands-on experience with Databricks, Delta Lake, and Apache Spark for large-scale data engineering.
Deep understanding of ELT pipeline development, orchestration, and monitoring in cloud-native environments.
Experience implementing Medallion Architecture (Bronze/Silver/Gold) and working with data versioning and schema enforcement in enterprise grade environments.
Strong proficiency in SQL, Python, or Scala for data transformations and workflow logic.
Proven experience integrating enterprise platforms (e.g., PeopleSoft, Salesforce, D2L) into centralized data platforms.
Familiarity with data governance, lineage tracking, and metadata management tools.
Experience with Databricks Unity Catalog for metadata management and access control.
Experience deploying ML models at scale using MLFlow or similar MLOps tools.
Familiarity with cloud platforms like Azure or AWS, including storage, security, and networking aspects.
Knowledge of data warehouse design and star/snowflake schema modeling.
Similar vacancies
Auriga IT
... teams including data analysts and engineers. Write reusable, efficient, and well-documented code. Integrate APIs and third-party services. Troubleshoot and debug data-related issues. Required Skills Strong proficiency in Python. Experience with data libraries like Pandas, NumPy. Hands-on experience with SQL and relational databases. ...
India, Jaipur
altysys
... data quality, reliability, and performance across data systems Required Skills: - Scala (must-have), python - Apache Spark - Strong coding fundamentals and engineering principles - Azure or on-premises Hadoop ecosystem experience - 5+ years of experience in Data Engineering - Python * SQL * AWS / Azure / GCP Preferred (Bonus) ...
India, Gurugram
Straive
... a related field (Master's degree preferred). Core Technical Skills: Python, PySpark, Databricks, Google ADK, LLMs, FastAPI, Spring Boot, Microservices, Kafka, SQL, Data Mesh, Starburst. Infrastructure and Cloud: Kubernetes, OpenShift, Docker, Cloud-Native Infrastructure, CI/CD pipelines. Industry Context: Data engineering ...
India, Pune
... relocation Remote Type: This position is fully remote Commercial Acumen, Communication, Data Analysis, Data cleansing and transformation, Data domain knowledge, Data Integration, Data Management, Data Manipulation, Data Sourcing, Data strategy and governance, Data Structures and Algorithms (Inactive), Data visualization and ...
India, Pune
applied systems india
... pipelines with automated data quality checks to support business needs and demonstrate ownership of live data pipelines. Proficiency understanding and implementing data life cycles, data lineage, custom metadata, and data governance. Proficiency implementing BigQuery SQL procedures, functions, and similar, with actionable logging ...
India, Bengaluru
treebo hospitality ventures
₹3k INR - ₹6k INR
Treebo Hospitality Ventures (THV) is a hotel group operating with a mission of 'democratising the joy of travel'. We focus on the affordable segments of the market — economy to mid-market — to cater to the next 100 million travellers who will experience the joy of travel over the next 10 years.
India, Bengaluru
GenY Medium
At GenY Medium, we don’t just market brands — we make them impossible to ignore. We’re a national digital marketing agency working with enterprise brands and fast-growing startups.
India, Hyderabad
Communication Crafts
... designers and account managers, occasionally with other leaders Attending client meetings for new projects along with the team, asking the right questions to collect data to work on the project successfully Creating content maps, sitemaps, content inventory and wireframes and writing content primarily for websites, brochures, landing ...
India, Ahmedabad
NxtWave
Key Responsibilities Execute 2 brand campaigns/month, collaborating with design, video, and ORM teams Identify 5–10 trending posts/month for witty, brand-safe comment interventions Craft content across formats—social media, scripts, influencer assets, digital copy Collaborate on IP and content integration ideas; own
India, Rāniganj
thecreatorsproject
Copywriter & Client Servicing Executive: Type: Full-time | Location: In-office ( Chembur, Mumbai ) | Experience: 0–2 years We're looking for a Copywriter & Client Servicing Executive to join our brand strategy team.
India, Mumbai
Subject Matter Expert (SME) / Technical Support Engineer Location-Hyderabad Company- MNC Client of Adecco The Subject Matter Expert (SME) / Technical Support Engineer is responsible for providing advanced technical expertise and support for products (UPS, STS, PDU, APF Etc) under DCS Power and critical customer applications. ...
India, Rāniganj
JP Morgan Chase & Co.
... transformational change initiatives, including data governance, data quality, or analytics transformation https://jobeax.com/link/LsX0MHwADPrlj8n9 technical skills in data profiling, analysis, and data management using modern tools and environments (Python, R, SQL, Spark, cloud platforms) Understanding of data lineage concepts and ...
India, Bengaluru
... requirements Experience: 8+ years of professional experience in data engineering, with a focus on data modelling and transformation. Programming: Strong proficiency in SQL and Python for data processing and pipeline development. Data Platforms: Hands-on experience with Snowflake, dbt, and modern cloud data warehouses. Data Modelling: ...
India, Bengaluru
Two Circles
... architecture, establish engineering best practices, and mentor other engineers. The role requires strong experience designing, building, and operating large-scale data pipelines and distributed data systems. Our technology stack includes AWS services, Airflow, Snowflake, MS SQL Server, and .NET. We are looking for someone who ...
India, Hyderabad
... expectations are met through disciplined implementation (access controls, lineage, and quality standards) 5+ years building and operating production data pipelines (data engineering—not primarily BI/analytics or data science) - Strong SQL plus strong data modeling skills (dimensional and/or lakehouse modeling) - Hands-on Databricks ...
India, Bengaluru
A client of People Impact
Job Summary :The Data Integration Engineer will design, develop, and support data integration solutions that extract financial and operational data from enterprise source systems and deliver trusted data to analytics platforms and external vendors. The role emphasizes source-to-target mapping, transformation, validation, ...
India, Bengaluru
SHIMENTO INDIA LLP
... experience in Data Engineering.- Strong Python + SQL expertise.- Strong Data Architecture and System Design skills.- End-to-end production pipeline ownership.- Expert SQL including Window Functions, CTEs, CASE logic.- Strong experience with MySQL / PostgreSQL.- Experience designing Transaction / Fact Tables.- Strong data quality, ...
India, Bengaluru
Accenture
... (Kafka, RabbitMQ) Preferred. Nice To Have : Hands-on expertise in Automic (Job Scheduling) Experience with Grafana , OpenSearch and Ansible Understanding of data governance and data quality frameworks. Experience with Oracle Database programming with PL/SQL Certificate Experience in Informatica Power Center ( ETL Process) ...
India, Bengaluru
webologix ltd/ inc
... with source code versioning tools, specifically Github Familiar with security concept and integration is must, like cert pinning, encryption and decryption and data protection Deep experience working on a team of Android engineers building and maintaining large scale apps, or apps that you have built personally Comfortable ...
India, Pune
Capgemini
... partners and data scientists. - Intermediate expertise in Data Vault 2.0 Modeling to be able to support and use the Specialty data vault. - Advance Expertise in SQL. The Engineer will be writing complex SQL statements. The Engineer should be able to use DBT as an ELT tool to load the data mart tables. - Advance expertise ...
India, Hyderabad