Databricks Engineer in Hyderabad, India is listed on Jobeax. Browse 30,000+ vacancies available.
Job Title: Databricks Engineer Experience Level: 5 - 10 years Location: Hyderabad / Pune
Qualification: BTech/MTech/MCA Mode of Work: Hybrid
We are seeking a skilled and motivated Databricks Engineer to design, develop, and optimize scalable data solutions on the Databricks platform. The ideal candidate will have strong expertise in Apache Spark, Databricks architecture, ETL development, and modern data lakehouse concepts. This role will be responsible for building robust data pipelines, implementing best practices in data engineering, and supporting analytics and machine learning workloads. Key Responsibilities:
Design, develop, and maintain scalable data engineering solutions using Databricks and Apache Spark.
Create and deploy custom ETL/ELT pipelines to ingest, transform, and process large volumes of structured and unstructured data.
Configure, manage, and optimize Databricks clusters for performance, scalability, and cost efficiency.
Implement and manage Lakehouse architectures using Databricks best practices.
Develop and maintain data workflows utilizing Delta Lake and Delta Live Tables (DLT).
Design and implement Medallion Architecture (Bronze, Silver, Gold layers) for reliable and scalable data processing.
Configure and govern data assets using Unity Catalog, ensuring data security, access control, and compliance.
Collaborate with data architects, analysts, and business stakeholders to translate business requirements into technical solutions.
Monitor data pipelines and troubleshoot performance or data quality issues.
Optimize Spark jobs and workflows to improve processing efficiency and reduce execution time.
Follow DevOps and CI/CD best practices for deployment and release management.
Requirements
5-10 years of experience in Data Engineering or Big Data technologies.
Strong understanding of Databricks architecture and core platform capabilities.
Hands-on experience in setting up and managing Databricks clusters.
Strong expertise in Apache Spark (PySpark/Scala Spark).
Experience developing and deploying custom ETL pipelines in Databricks.
Experience implementing Medallion Architecture within Databricks.
Hands-on experience with Delta Live Tables (DLT).
Strong understanding and implementation experience with Unity Catalog.
Experience working with Delta Lake and Lakehouse architecture principles.
Knowledge of data modeling, data quality, and performance tuning techniques.
Familiarity with version control tools such as Git.
Benefits
Comprehensive Medical Coverage:
Health insurance of INR 5.0 Lakhs for you and your family (up to 6 members), ensuring complete peace of mind.
Robust Protection Plans:
Group Personal Accident Insurance and Group Term Life Insurance to safeguard you and your loved ones.
Retirement Benefits:
PF and Gratuity provided as per standard government regulations.
Flexible Work Options:
Enjoy hybrid work arrangements & flexible working hours
Generous Leave Policy:
21 days of annual leave, in addition to 10 company-declared holidays.
Employee Well-being Spaces:
Access to a dedicated break-out area with round-the-clock refreshments for relaxation and rejuvenation.
... with data governance policies, and protecting sensitive data - Perform other duties as assigned You Have: - Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field. - 10+ years of experience in data engineering or a similar role. - Enterprise SaaS software solutions with high availability and scalability ...
Consultant Data Engineer Databricks | Azure | PySpark | Spark SQL - Bengaluru / Hyderabad / GurugramLooking for an experienced Data Engineer with strong expertise in Azure Databricks, PySpark, Spark SQL, Azure Data Factory (ADF), ADLS, ETL, and SQL. You will design scalable data pipelines, build modern Lakehouse solutions, ...
Consultant Data Engineer Databricks | Azure | PySpark | Spark SQL - Bengaluru / Hyderabad / GurugramLooking for an experienced Data Engineer with strong expertise in Azure Databricks, PySpark, Spark SQL, Azure Data Factory (ADF), ADLS, ETL, and SQL. You will design scalable data pipelines, build modern Lakehouse solutions, ...
Role Overview:Seeking a highly skilled Senior Data Engineer with deep expertise in Databricks, Real-Time Data Processing, Lakehouse Architecture, and AI-driven solutions. The role involves designing, developing, and supporting scalable data platforms and streaming pipelines, leveraging modern Databricks capabilities such ...
... data solutions.- Mentor junior engineers and promote data engineering best https://jobeax.com/link/E00qLmZDpXHJjFEm Qualifications : - 5+ years of Azure Data Engineering experience.- Experience with large-scale distributed data processing systems.- Databricks and/or Azure Data Engineering certifications preferred.- Strong ...
... production issues, work with Databricks to open incident tickets/case and follow up to close the issue and ensure long term fixes - Additional knowledge of other Databricks key features, like Genie, Apps, Models creations etc Required Qualifications: - Bachelor's degree in computer science, Information Technology, Engineering, ...
... one certification • Databricks Certified Data Engineer Associate OR Databricks Certified Data Engineer Professional Additional Certifications (Preferred) - Databricks Certified Associate Developer for Apache Spark - Cloud platform certifications (Azure Data Engineer Associate, AWS Certified Data Analytics, or Google Cloud ...
... Technical Solutions Engineer with over 12+ years of experience to join our Platform Support team. This role is pivotal in delivering exceptional support for our Databricks Data Intelligence platform, addressing complex technical challenges, and ensuring the seamless operation of our data solutions. As a frontline engineer, you ...
Location Name: Pune Corporate Office - Mantri The MLOps Engineer will own the end-to-end operationalisation of machine learning, large language model (LLM), and agentic AI workloads on the Bajaj Finance Enterprise Data Platform — a 5PB+ medallion lakehouse built on Azure Databricks and Unity Catalog. This role sits at the ...
Job Description: Data Engineer with Databricks Expertise Job Summary We are seeking a highly skilled Data Engineer with Databricks certifications and extensive practical experience working with the Databricks Lakehouse platform and its supporting capabilities. The ideal candidate will possess a robust understanding of AWS ...
Senior Data Engineer Starts Immediately Competitive salary Competitive salary Experience We are looking for a Senior Data Engineer to join our team. In this role, you will design, build, and optimize scalable data pipelines on the Databricks Lakehouse Platform. You will partner with data science, analytics, and business ...
... Docker, Cloud-Native Infrastructure, CI/CD pipelines. Industry Context: Data engineering experience in Banking Risk, Retail Products, Cards, Mortgage, Deposits, or Wealth Management. Assumed Requirements / Certifications: Databricks Certified Data Engineer, AWS Certified Data Analytics, or Azure Data Engineer Associate.
... of data engineering initiatives. Total Experience: 1-4 years in data engineering or related fields. Solid experience with Databricks, focusing on platform engineering, data engineering, and analytics. Technical Skills: Proficiency in Python, Scala, or Java; strong experience with Databricks APIs, Apache Spark, and Delta ...
Senior Data Engineer – Data Pipelines & Cloud Databases Location: Pune | Experience: 4+ years | Type: Full-Time Role Overview Design, build, manage enterprise data pipelines on Azure and Databricks. Own schema design, API development, and data infrastructure for analytics and intelligence products. Key Responsibilities ...
... utilization, and cost.- Support cloud, on-premises, hybrid, and air-gapped https://jobeax.com/link/72xljNf4GfrhBYcv Skills:- 3 - 5 years in MLOps, LLMOps, ML Engineering, or AI Engineering.- Strong Python.- Hands-on Databricks and/or Azure ML.- Experience with Deep Learning, LLMs, SLMs, RAG, and Hugging Face.- Experience ...
Job Description – Senior Data Engineer / Platform Re-Engineering Lead (Azure Synapse & Databricks Migration) Role Overview We are looking for a highly experienced Senior Data Engineer to lead the re-engineering of an existing enterprise data platform built on Azure Synapse Analytics. The role requires deep technical seniority ...
Data Engineer III/ IV - IN (Operation/ Supports) Work Location - Remote Work From Home Shift: Rotation Shifts (24/7) Experience: 7-12 years The Data engineer is responsible for managing and operating upon Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI/Tableau. The engineer will work closely with the customer ...
... managing this platform, utilizing leading technologies like Databricks, Delta Lake, Spark, PySpark, Scala, and the AWS suite. We are actively seeking skilled Data Engineers to join our team and contribute to scaling our platform across the organization. Create and manage robust data ingestion pipelines leveraging Databricks, Airflow, ...