Senior Data Engineer - Databricks & AI Solutions in Chennai, India
Hexaconcepts
India, Chennai
Senior Data Engineer - Databricks & AI Solutions in Chennai, India is listed on Jobeax. Browse 30,000+ vacancies available.
Role Overview:Seeking a highly skilled Senior Data Engineer with deep expertise in Databricks, Real-Time Data Processing, Lakehouse Architecture, and AI-driven solutions. The role involves designing, developing, and supporting scalable data platforms and streaming pipelines, leveraging modern Databricks capabilities such as Lakeflow, Unity Catalog, and Generative AI https://jobeax.com/link/86DscMukVX8p2VNe Responsibilities:- Design, develop, and maintain end-to-end streaming and batch data pipelines using Databricks and PySpark.- Build, optimize, and manage Delta Lake tables within Unity Catalog.- Develop and support Lakeflow pipelines with incremental processing, CDC, and data quality validations.- Integrate enterprise systems into the Databricks Lakehouse.- Ensure data quality, governance, security, and operational excellence across platforms.- Monitor, troubleshoot, and optimize workflows for reliability and performance.- Collaborate with stakeholders to deliver scalable, business-aligned solutions.- Build and support AI-powered data solutions leveraging LLMs, RAG, and vector search.- Implement CI/CD best practices and maintain deployment pipelines.- Drive deliverables independently, proactively resolving challenges with minimal https://jobeax.com/link/d98s5MNtpPjtjH4I Stack & Requirements :- Hands-on experience with Databricks and modern Lakehouse architecture.- Expertise in PySpark, Spark Structured Streaming, SQL, NoSQL databases, Delta Lake.- Proficiency with Unity Catalog for governance and security.- Experience building AI agents, copilots, and generative AI solutions using LLMs, RAG, and vector search.- Experience with Git-based source control, CI/CD pipelines, Databricks Repos, and Databricks Asset https://jobeax.com/link/7XVLZmR00vDKuYTN Qualifications :- BE/BTech/ME/MTech/MCA only. (ref:hirist.tech)
Senior Data Engineer – Data Pipelines & Cloud Databases Location: Pune | Experience: 4+ years | Type: Full-Time Role Overview Design, build, manage enterprise data pipelines on Azure and Databricks. Own schema design, API development, and data infrastructure for analytics and intelligence products. Key Responsibilities ...
Job Description: Data Engineer with Databricks Expertise Job Summary We are seeking a highly skilled Data Engineer with Databricks certifications and extensive practical experience working with the Databricks Lakehouse platform and its supporting capabilities. The ideal candidate will possess a robust understanding of AWS ...
... batch jobs, database replication & Kafka- Set up and maintain monitoring/observability for data pipelines- Support ML pipelines, Airflow workflows and production data science infrastructureIDEAL PROFILE:Looking for candidates with strong hands-on experience in:- Data Operations- Production Data Engineering- Data Platform Support- ...
... batch jobs, database replication & Kafka- Set up and maintain monitoring/observability for data pipelines- Support ML pipelines, Airflow workflows and production data science infrastructureIDEAL PROFILE:Looking for candidates with strong hands-on experience in:- Data Operations- Production Data Engineering- Data Platform Support- ...
... configuring and managing AWS/tableau and databricks solutions Experience with Databricks and tableau environment is desired research of various sources such as databricks/AWS/tableau documentation that may be required to identify and resolve issues We may use artificial intelligence (AI) tools to support parts of the hiring ...
... Docker, Cloud-Native Infrastructure, CI/CD pipelines. Industry Context: Data engineering experience in Banking Risk, Retail Products, Cards, Mortgage, Deposits, or Wealth Management. Assumed Requirements / Certifications: Databricks Certified Data Engineer, AWS Certified Data Analytics, or Azure Data Engineer Associate.
... operations at ELGi. Data Engineering & Architecture Design scalable, production-grade ETL/ELT pipelines across Azure, AWS, and GCP. Develop modular, reusable data engineering frameworks for ingestion, transformation, and orchestration. Build Spark, SQL, and Python workflows in Databricks. Optimize compute, storage, and ...
Role: Senior Data EngineerExperience: 7+ YearsLocation: PuneJoining: Immediate to 30 Days' Notice PeriodRole Summary:We are looking for a skilled Sr. Data Engineer with strong expertise in Python and cloud-native technologies to design, develop, and maintain scalable data pipelines and distributed systems. The ideal candidate ...
Data Engineer – Python & Pyspark (AWS) Exp: 6+ yrs Location : Chennai Client Place Guindy Work Mode : All 5 days Role Overview We're seeking a Senior Data Engineer with strong hands-on expertise in Python, PySpark, and AWS to design, build, and operate scalable data pipelines for analytics and operational workloads. You ...
Neutrino Advisory is looking for an experienced Senior Data Engineer with strong hands-on experience building and supporting data solutions on AWS . The role requires solid experience with Amazon Redshift, S3, AWS Glue, Amazon AppFlow, Lambda, and SQL . You will work on data ingestion, transformation, data pipelines, data ...
... product engineers, and other engineering teams to build a modern, cloud-native data https://jobeax.com/link/2Y4cCTL2qZrUlGJ5 You'll Do : - Design, build, and maintain robust batch and streaming data pipelines that ingest data from multiple sources into analytical data stores.- Build and operate Apache Airflow DAGs, including ...
... Engineer Experience Required: 6+ Years Location: Remote Employment Type: Contract We are seeking a highly skilled Senior Data Engineer with expertise in Graph Databases, Data Modeling, and modern backend frameworks. The ideal candidate should have strong experience in building scalable data solutions using Neo4j, Cypher ...
... during your interview. Position Title – Senior Data Engineer The Senior Data Engineer will lead the design, development, and optimization of enterprise-scale data pipelines and integration solutions. This role requires deep expertise in data engineering principles, strong knowledge of relational databases, and experience ...
... large volumes of data, create meaningful analyses, and deliver recommendations to https://jobeax.com/link/R1rBsus5T71Cfgto Responsibilities :- Create and maintain optimal data pipeline architecture ETL/ ELT into structured data.- Assemble large, complex data sets that meet business requirements and create and maintain multi-dimensional ...
Position: Senior Data Engineer Location: Pune Job Responsibilities Design, develop, and maintain scalable data pipelines using AWS services. Design and implement scalable, secure, and resilient MLOps architecture across cloud and on-prem environments Define best practices for model lifecycle management, including versioning, ...
Hiring : Senior Data Engineer | 6+ https://jobeax.com/link/elpmNuUlUrtRmNOJ : https://jobeax.com/link/TEtw0SgP3UR1RgAh : Senior Data https://jobeax.com/link/gTHUyXDKJ42uWexF are looking for a highly skilled Senior Data Engineer with strong expertise in Data Architecture, System Design, Python, and SQL to design, build, ...
... and support our larger purpose of unlocking the power of nature to enrich quality of life. Senior Data Engineer Do you want to join a team passionate about engineering data solutions to inform business decisions and transform business performance ADM is seeking a Sr. Data Engineer, someone who thrives in an environment ...
... Collaboration: Work closely with engineering, product management, and DevOps teams to share insights, identify recurring issues, and drive improvements to the Databricks Data Intelligence platform. - Documentation and Knowledge Sharing: Create and maintain detailed documentation on support procedures, known issues, and solutions. Contribute ...
Role Overview : We are looking for an experienced Senior Lead Engineer with strong expertise in Full Stack Development, DevOps, and cloud-based data applications. The role involves leading the design, development, enhancement, and production support of enterprise applications built using https://jobeax.com/link/6WcBICn0LM558SP0, ...