Vacancy description
Hexaconcepts
India, Chennai
Senior Data Engineer - Databricks & AI Solutions in Chennai, India is listed on Jobeax. Browse 30,000+ vacancies available.
Role Overview:Seeking a highly skilled Senior Data Engineer with deep expertise in Databricks, Real-Time Data Processing, Lakehouse Architecture, and AI-driven solutions. The role involves designing, developing, and supporting scalable data platforms and streaming pipelines, leveraging modern Databricks capabilities such as Lakeflow, Unity Catalog, and Generative AI https://jobeax.com/link/86DscMukVX8p2VNe Responsibilities:- Design, develop, and maintain end-to-end streaming and batch data pipelines using Databricks and PySpark.- Build, optimize, and manage Delta Lake tables within Unity Catalog.- Develop and support Lakeflow pipelines with incremental processing, CDC, and data quality validations.- Integrate enterprise systems into the Databricks Lakehouse.- Ensure data quality, governance, security, and operational excellence across platforms.- Monitor, troubleshoot, and optimize workflows for reliability and performance.- Collaborate with stakeholders to deliver scalable, business-aligned solutions.- Build and support AI-powered data solutions leveraging LLMs, RAG, and vector search.- Implement CI/CD best practices and maintain deployment pipelines.- Drive deliverables independently, proactively resolving challenges with minimal https://jobeax.com/link/d98s5MNtpPjtjH4I Stack & Requirements :- Hands-on experience with Databricks and modern Lakehouse architecture.- Expertise in PySpark, Spark Structured Streaming, SQL, NoSQL databases, Delta Lake.- Proficiency with Unity Catalog for governance and security.- Experience building AI agents, copilots, and generative AI solutions using LLMs, RAG, and vector search.- Experience with Git-based source control, CI/CD pipelines, Databricks Repos, and Databricks Asset https://jobeax.com/link/7XVLZmR00vDKuYTN Qualifications :- BE/BTech/ME/MTech/MCA only. (ref:hirist.tech)
Similar vacancies
Smartsheet
... Product engineering team to influence designs with data, AI and analytics use cases in mind - In depth experience in System design involving large Petabytes of data with Databricks Lakehouse - Experience in modern AI/Data infrastructure patterns, Semantics layer Organizing data for AI agents (metadata, context) - AWS, GCP, ...
India, Bengaluru
Andor Tech
... updated resume to View email address on https://jobeax.com/link/8om4ubga9gvjbUNE Contact: View phone number on https://jobeax.com/link/8om4ubga9gvjbUNE #Hiring #DataEngineer #SeniorDataEngineer #AzureDatabricks #Databricks #PySpark #PythonDeveloper #AzureCloud #DataEngineering #BigData #ADF #ADLS #SQL #BangaloreJobs #TechHiring ...
India, Bengaluru
CELEBAL TECHNOLOGIES PRIVATE LIMITED
... context - aware retrieval solutions.- Fine - tuning: Apply fine - tuning techniques (PEFT, LoRA/QLoRA) and prompt optimization for domain - specific applications.- Databricks ML & Lakehouse Integration: Build data prep pipelines, orchestrate workflows, and register/deploy models via Databricks Mosaic AI, MLflow, Unity Catalog, ...
India, Ahmedabad
CELEBAL TECHNOLOGIES PRIVATE LIMITED
... context - aware retrieval solutions.- Fine - tuning: Apply fine - tuning techniques (PEFT, LoRA/QLoRA) and prompt optimization for domain - specific applications.- Databricks ML & Lakehouse Integration: Build data prep pipelines, orchestrate workflows, and register/deploy models via Databricks Mosaic AI, MLflow, Unity Catalog, ...
India, Bengaluru
Job Title: Senior Data Engineer Eperience - 10+ to 18 yrs Location: Remote Type: Contract( Comfortable with a 6-month contractual role) Requires strong hands-E xperience in AI and Data Engineering with strong expertise in Azure OpenAI, Azure AI Foundry, Agentic AI, RAG, LLMs, AutoGen, OCR, Databricks, PySpark, Python, Azure ...
India, Bengaluru
... to reinvent the food industry and remain the leading food company in the region. It also operates its Customer Experience Center in Amman, Jordan, and its Engineering Hub in Krakow, Poland. We're looking for a Senior Data Engineer to design, build, and scale the pipelines that power our analytics and AI platforms. You ...
India, Bengaluru
Kanerika Inc
Role: As a Senior Databricks Engineer you will be responsible for automating platform operations, managing CI/CD pipelines, and supporting deployments across multiple environments. The role ensures platform stability, security, and scalability while enabling faster and more reliable software delivery. Key Responsibilities: ...
India, Rāniganj
BAJAJ FINSERV HEALTH
... Engineer will own the end-to-end operationalisation of machine learning, large language model (LLM), and agentic AI workloads on the Bajaj Finance Enterprise Data Platform — a 5PB+ medallion lakehouse built on Azure Databricks and Unity Catalog. This role sits at the intersection of data engineering, model lifecycle management, ...
India, Pune
... Control & DevOps: Experience with Git, CI/CD practices; familiarity with Docker/Kubernetes is a plus. Key Responsibilities Design, develop, and maintain scalable data pipelines and data lake solutions on GCP. Build and automate data ingestion and transformation workflows using Airflow and BigQuery. Ensure data quality, performance, ...
India, Mannady
InterEx Group
... modelers and analysts to deliver analytics-ready datasets Support downstream reporting and dashboarding use cases What we’re looking for Strong experience as a Data Engineer in Azure environments Hands-on with tools such as Azure Data Factory, Azure Databricks, Synapse or similar Solid SQL and data transformation experience ...
India, Mumbai
anrgi tech
... - Share knowledge and best practices with Team ***** - Mentor junior data engineers on PySpark and Databricks technologies - Document technical solutions and maintain comprehensive documentation Essential Technical Skills - Data Engineering: Strong foundation in data engineering principles, ETL/ELT processes, and data pipeline ...
India, Pune
ganit inc.
Job Title: Senior Data Engineer At Ganit , we are not just data geeks – we are a family of scientists, refiners, and artisans. Our mission is to bridge the gap between intelligence and action, translating data into valuable insights and strategies. We work with businesses to create state-of-the-art solutions that push the ...
India, Bengaluru
KPI PARTNERS INDIA PRIVATE LIMITED
... details related to data engineering or a relevant https://jobeax.com/link/cwwOL3BLJkve6nkU Skills :- Azure Databricks, Python, pyspark, sql, ADF- Proficiency in data pipeline design and implementation- Strong understanding of data factory and orchestration toolsPreferred Skills:- Familiarity with advanced data processing techniques- ...
India, Bengaluru
Azilen Technologies
Senior Data Engineer Start Date Starts Immediately CTC (ANNUAL) Competitive salary Competitive salary Experience 5 year(s) 5 year(s) Apply By Not Provided Posted 2 weeks ago Job Be an early applicant About the job Job Purpose: Design and implement scalable data engineering and data warehouse solutions while managing data ...
India, Ahmedabad
Blue Cloud Softech Solutions Limited
... https://jobeax.com/link/HLsikUBtnTuAcImv Certifications : - Databricks Data Engineer Professional or Databricks Machine Learning Professional.- AWS Certified Data Analytics, AWS Solutions Architect Associate, or AWS Solutions Architect Professional.- Relevant data governance, data management, product ownership, or agile ...
India, India
infovision inc.
Senior Data Engineer – Data Pipelines & Cloud Databases Location: Pune | Experience: 4+ years | Type: Full-Time Role Overview Design, build, manage enterprise data pipelines on Azure and Databricks. Own schema design, API development, and data infrastructure for analytics and intelligence products. Key Responsibilities ...
India, Pune
Job Description: Data Engineer with Databricks Expertise Job Summary We are seeking a highly skilled Data Engineer with Databricks certifications and extensive practical experience working with the Databricks Lakehouse platform and its supporting capabilities. The ideal candidate will possess a robust understanding of AWS ...
India, Pune
Rackspace Technology
... configuring and managing AWS/tableau and databricks solutions Experience with Databricks and tableau environment is desired research of various sources such as databricks/AWS/tableau documentation that may be required to identify and resolve issues We may use artificial intelligence (AI) tools to support parts of the hiring ...
India, Bengaluru
Straive
... Docker, Cloud-Native Infrastructure, CI/CD pipelines. Industry Context: Data engineering experience in Banking Risk, Retail Products, Cards, Mortgage, Deposits, or Wealth Management. Assumed Requirements / Certifications: Databricks Certified Data Engineer, AWS Certified Data Analytics, or Azure Data Engineer Associate.
India, Pune