Vacancy description

Lead Data Engineer in Hyderabad, भारत

NationsBenefits, LLC

Hyderabad, भारत

Job Title: Lead Data Engineer

Experience: 7-10 Years

Location: Hyderabad, India

Employment Type: Full-time

About NationsBenefits :

At NationsBenefits, we are leading the transformation of the insurance industry by developing innovative benefits management solutions. We focus on modernizing complex back-office systems to create scalable, secure, and high-performing platforms that streamline operations for our clients. As part of our strategic growth, we are focused on platform modernization — transitioning legacy systems to modern, cloud-native architectures that support the scalability, reliability, and high performance of core backoffice functions in the insurance domain.

Position Overview:

We are seeking a self-driven  Lead Data Engineer with 7–10 years of experience to build and optimize scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. The role involves working across scrum teams to develop data solutions, ensure data governance with Unity Catalog, and support real-time and batch processing. Strong problem-solving skills, T-SQL expertise, and hands-on experience with Azure cloud tools are essential. Healthcare domain knowledge is a plus.

Job Description:

• Work with different scrum teams to develop all the quality database programming requirements of the sprint.

• Experience in Azure cloud platforms like Advanced Python Programming, Databricks, Azure SQL , Data factory (ADF), Data Lake, Data storage, SSIS.

• Create and deploy scalable ETL/ELT pipelines with Azure Databricks by utilizing PySpark and SQL.

• Create Delta Lake tables with ACID transactions and schema evolution to support real-time and batch processing.

• Experience in Unity Catalog for centralized data governance, access control, and data lineage tracking

. • Independently analyse, solve, and correct issues in real time, providing problem resolution end-to-end.

• Develop unit tests to be able to test them automatically.

• Use SOLID development principles to maintain data integrity and cohesiveness.

• Interact with product owner and business representatives to determine and satisfy needs.

• Sense of ownership and pride in your performance and its impact on company's success.

• Critical thinker and problem-solving skills.

• Team player.

• Good time-management skills.

• Great interpersonal and communication skills.

Mandatory Qualifications:

• 7-10 years of experience as a Lead Data Engineer.

• Self-driven with minimal supervision.

• Proven experience with T-SQL programming, Azure Databricks, Spark (PySpark/Scala), Delta Lake, Unity Catalog, ADLS Gen2

• Microsoft TFS, Visual Studio, Devops exposure.

• Experience with cloud platforms such as Azure or any.

• Analytical, problem-solving mindset.

Preferred Qualifications

• HealthCare domain knowledge

Similar vacancies

More like this role

Referrals Only

Lead Data Engineer

  • Hybrid
  • Full-time
Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to ...

Bangalore, भारत

  • On-site
  • Full-time
  • Contract
... transaction is a sophisticated technology ecosystem that processes billions of payment events with speed, resilience, and precision. As a Lead Data Engineer within the Data Collection & Engineering (DC&E) organisation, you will play a critical role in designing, building, and scaling Mastercard's next-generation data platforms and ...

Hyderabad, भारत

  • Hybrid
  • Full-time
... potential. Title and Summary Lead Data Engineer Position Overview Have you ever wanted to be part of something BIG? Now is the time to make an immediate impact at a leading global technology company, Mastercard. This role is part of the AI&DPE Data Engineering platform team, responsible for building and evolving large scale backend ...

Pune, भारत

Cohere Health

Lead Data Engineer

... frameworks. This role combines deep hands-on engineering with technical leadership and collaboration across platform, analytics, and business teams. What you’ll do: - Lead Data Engineering Initiatives - Lead delivery of complex data engineering projects across multiple teams - Drive technical execution from design through production ...

Hyderabad, भारत

Dr Reddy's Laboratories Limited

Lead Data Engineer

  • Full-time
  • Contract

24k

... and diversity in our organization. " Job Description Role Summary We are looking for a Lead Data Engineer to design, build, and modernize DRL's cloud-native data platforms on Google Cloud. The role goes beyond pipeline development: the candidate will own data architecture and modeling, lead the move from legacy ETL platforms ...

Hyderabad, भारत

Calfus Technologies India Pvt Ltd

Calfus - Lead Data Engineer

About the Role : As a Lead Data Engineer, you'll own the design and delivery of our cloud data platforms on AWS and Azure. You'll architect lakehouse solutions built on Medallion Architecture, set the data modelling standards, and lead a team of data engineers delivering reliable, scalable pipelines. This is a hands-on ...

Pune, भारत

  • Full-time
Senior data science role at Genpact in Bengaluru. Needs a https://jobeax.com/link/2DENLGgQM7whDhaE, B.E. or B.Sc. What you'll do - Lead and mentor a team of python , pyspark , hadoop - Develop and implement cloud infrastructure and architecture strategies - Evaluate and recommend cloud services and solutions based on business ...

Bangalore, भारत

  • Full-time
... Looking For A seasoned Data Engineering expert who can drive the adoption of modern data platforms and provide technical thought leadership to clients across cloud data engineering, data architecture, and enterprise data management. This role requires deep expertise in building scalable, high-performance data engineering solutions ...

Pune, भारत

... perspective gives us a competitive advantage. Position: Data Engineer Location: Pune, Maharashtra Job Description The Data semantic solution team is looking for a Big Data Engineer to drive our mission to unlock potential of data assets by consistently innovating, eliminating friction in how users access data from its Big Data repositories ...

Pune, भारत

  • On-site
  • Full-time
... platforms for batch and real-time data processing - Build scalable data ingestion and processing frameworks to handle structured, semi-structured, and unstructured datasets - Solve complex business problems by leveraging data engineering best practices and advanced technologies What you need - SQL - ETL - Python - Spark - Azure ...

Pune, भारत