Vacancy description
Hexaconcepts
India, Chennai
Senior Data Engineer - Databricks & AI Solutions in Chennai, India is listed on Jobeax. Browse 30,000+ vacancies available.
Role Overview:Seeking a highly skilled Senior Data Engineer with deep expertise in Databricks, Real-Time Data Processing, Lakehouse Architecture, and AI-driven solutions. The role involves designing, developing, and supporting scalable data platforms and streaming pipelines, leveraging modern Databricks capabilities such as Lakeflow, Unity Catalog, and Generative AI https://jobeax.com/link/86DscMukVX8p2VNe Responsibilities:- Design, develop, and maintain end-to-end streaming and batch data pipelines using Databricks and PySpark.- Build, optimize, and manage Delta Lake tables within Unity Catalog.- Develop and support Lakeflow pipelines with incremental processing, CDC, and data quality validations.- Integrate enterprise systems into the Databricks Lakehouse.- Ensure data quality, governance, security, and operational excellence across platforms.- Monitor, troubleshoot, and optimize workflows for reliability and performance.- Collaborate with stakeholders to deliver scalable, business-aligned solutions.- Build and support AI-powered data solutions leveraging LLMs, RAG, and vector search.- Implement CI/CD best practices and maintain deployment pipelines.- Drive deliverables independently, proactively resolving challenges with minimal https://jobeax.com/link/d98s5MNtpPjtjH4I Stack & Requirements :- Hands-on experience with Databricks and modern Lakehouse architecture.- Expertise in PySpark, Spark Structured Streaming, SQL, NoSQL databases, Delta Lake.- Proficiency with Unity Catalog for governance and security.- Experience building AI agents, copilots, and generative AI solutions using LLMs, RAG, and vector search.- Experience with Git-based source control, CI/CD pipelines, Databricks Repos, and Databricks Asset https://jobeax.com/link/7XVLZmR00vDKuYTN Qualifications :- BE/BTech/ME/MTech/MCA only. (ref:hirist.tech)
Similar vacancies
Smartsheet
... Product engineering team to influence designs with data, AI and analytics use cases in mind - In depth experience in System design involving large Petabytes of data with Databricks Lakehouse - Experience in modern AI/Data infrastructure patterns, Semantics layer Organizing data for AI agents (metadata, context) - AWS, GCP, ...
India, Bengaluru
Worksconsultancy
... layers.- Must have built and maintained end-to-end pipelines - ingestion (Auto Loader, DLT), transformation (PySpark/SQL or dbt), and serving (Unity Catalog, Databricks SQL).- Must hold at least one active Databricks Professional-level certification (Data Engineer Professional preferred), OR deep hands-on project experience ...
India, Bengaluru
CELEBAL TECHNOLOGIES PRIVATE LIMITED
... context - aware retrieval solutions.- Fine - tuning: Apply fine - tuning techniques (PEFT, LoRA/QLoRA) and prompt optimization for domain - specific applications.- Databricks ML & Lakehouse Integration: Build data prep pipelines, orchestrate workflows, and register/deploy models via Databricks Mosaic AI, MLflow, Unity Catalog, ...
India, Ahmedabad
CELEBAL TECHNOLOGIES PRIVATE LIMITED
... context - aware retrieval solutions.- Fine - tuning: Apply fine - tuning techniques (PEFT, LoRA/QLoRA) and prompt optimization for domain - specific applications.- Databricks ML & Lakehouse Integration: Build data prep pipelines, orchestrate workflows, and register/deploy models via Databricks Mosaic AI, MLflow, Unity Catalog, ...
India, Bengaluru
Kanerika Inc
Role: As a Senior Databricks Engineer you will be responsible for automating platform operations, managing CI/CD pipelines, and supporting deployments across multiple environments. The role ensures platform stability, security, and scalability while enabling faster and more reliable software delivery. Key Responsibilities: ...
India, Rāniganj
BAJAJ FINSERV HEALTH
... Engineer will own the end-to-end operationalisation of machine learning, large language model (LLM), and agentic AI workloads on the Bajaj Finance Enterprise Data Platform — a 5PB+ medallion lakehouse built on Azure Databricks and Unity Catalog. This role sits at the intersection of data engineering, model lifecycle management, ...
India, Pune
... Control & DevOps: Experience with Git, CI/CD practices; familiarity with Docker/Kubernetes is a plus. Key Responsibilities Design, develop, and maintain scalable data pipelines and data lake solutions on GCP. Build and automate data ingestion and transformation workflows using Airflow and BigQuery. Ensure data quality, performance, ...
India, Mannady
Commonwealth Bank
... Produce high quality, sustainable solutions to meet business requirements, leveraging approved delivery frameworks and by applying industry best practice. Deliver data engineering solutions aligned to core concepts of data design, preparation, transformation, and load. Build and implement data pipelines in distributed data platforms ...
India, Bengaluru
standard chartered india
... resolve risk, conduct and compliance matters. Skills And Experience Data Engineering SQL Unix Scripting Devops Bachelor's or Master's degree in Computer Science, Data Engineering, or a related technical field. 10+ years of experience in data engineering Strong proficiency in Python, Python-spark, shell scripting and SQL, with ...
India, Bengaluru
mindbrain
Senior Data Engineer – GCP Experience: 5+ Years Role: Senior Data Engineer Domain: Cloud Data Engineering Platform: Google Cloud Platform (GCP) Role Summary We are seeking a Senior Data Engineer with 5+ years of experience in designing, developing, and maintaining scalable, cloud-based data solutions. The ideal candidate ...
India, Gurugram
... tools like Airflow, AWS Glue, S3, AWS EMR, Streaming data pipelines, Kafka/Kinesis is desirable u2022 Assists in solving data engineering challenges by analyzing data issues and applying simple solutions, working under general supervision. u2022 Helps develop technical solutions by integrating data from different sources and ...
India, Bengaluru
Akamai Technologies
Senior Data Engineer II Join our Data Engineering, Analytics & Intelligence team The Data Engineering, Analytics & Intelligence team is the engine behind our data-driven culture. We partner across the enterprise—from Finance (Accounting, Customer Revenue Operations, Business Finance) to Sales and Marketing—to build the ...
India, Bengaluru
InterEx Group
... modelers and analysts to deliver analytics-ready datasets Support downstream reporting and dashboarding use cases What we’re looking for Strong experience as a Data Engineer in Azure environments Hands-on with tools such as Azure Data Factory, Azure Databricks, Synapse or similar Solid SQL and data transformation experience ...
India, Mumbai
... Preferred Experience with Data Engineering concepts, ELT/ETL pipelines, and workflow orchestration (Airflow/Dagster). Good to have experience with dbt, Snowflake, Databricks, Apache Beam, or Apache Flink. Good to have experience with building AI/ML or RAG infrastructure. Familiarity with vector databases, embeddings, and feature ...
India, Ahmedabad
anrgi tech
... - Share knowledge and best practices with Team ***** - Mentor junior data engineers on PySpark and Databricks technologies - Document technical solutions and maintain comprehensive documentation Essential Technical Skills - Data Engineering: Strong foundation in data engineering principles, ETL/ELT processes, and data pipeline ...
India, Pune
KPI PARTNERS INDIA PRIVATE LIMITED
... details related to data engineering or a relevant https://jobeax.com/link/cwwOL3BLJkve6nkU Skills :- Azure Databricks, Python, pyspark, sql, ADF- Proficiency in data pipeline design and implementation- Strong understanding of data factory and orchestration toolsPreferred Skills:- Familiarity with advanced data processing techniques- ...
India, Bengaluru
ganit inc.
Job Title: Senior Data Engineer At Ganit , we are not just data geeks – we are a family of scientists, refiners, and artisans. Our mission is to bridge the gap between intelligence and action, translating data into valuable insights and strategies. We work with businesses to create state-of-the-art solutions that push the ...
India, Bengaluru
Azilen Technologies
Senior Data Engineer Start Date Starts Immediately CTC (ANNUAL) Competitive salary Competitive salary Experience 5 year(s) 5 year(s) Apply By Not Provided Posted 2 weeks ago Job Be an early applicant About the job Job Purpose: Design and implement scalable data engineering and data warehouse solutions while managing data ...
India, Ahmedabad
Equal Experts
Senior Data Engineer Start Date Starts Immediately CTC (ANNUAL) Competitive salary Competitive salary Experience 5 year(s) 5 year(s) Apply By Not Provided Posted today Job Be an early applicant About the job Strong hands-on experience with Python, SQL, and PySpark. Strong understanding of unit testing, test automation, ...
India, Bengaluru