Back to list

Vacancy description

Lead Software Engineer - Data Engineer in Chennai, भारत

Caterpillar

  • On-siteWork from the office
  • Full-timeStandard weekly hours

Chennai, भारत

Responsibilities

  • Lead and mentor a team of data engineers and platform developers.
  • Architect scalable and secure AWS-based data platforms.
  • Design and develop batch and near-real-time ingestion pipelines for structured and unstructured data.
  • Build and optimize Snowflake data platforms, including data modeling, governance, metadata management, performance, and cost optimization.
  • Use AWS services to implement end-to-end data pipelines.
  • Establish engineering best practices, code quality, testing, version control, CI/CD standards, and reusable ingestion and transformation frameworks.
  • Drive Agile delivery, automation, continuous improvement, scalability, resiliency, and operational readiness.
  • Partner with product managers, subject matter experts, data science and AI teams, and business stakeholders to deliver scalable data solutions.
  • Operationalize ML models and analytics workflows and support real-time analytics, edge AI, and AI-enabled data engineering use cases.

Requirements

  • 10+ years of experience in data engineering or data platform roles.
  • Strong experience with the AWS data ecosystem, including S3, Glue, Lambda, EMR, and Redshift.
  • Deep expertise in Snowflake architecture, optimization, and data modeling.
  • Strong programming skills in Python and SQL.
  • Extensive experience with data ingestion pipelines and ETL/ELT frameworks.
  • Experience with real-time streaming technologies such as Kafka and Spark Streaming.
  • Experience with CI/CD and engineering tools including GitHub, Jenkins, AWS CloudFormation, and Git.
  • Understanding of distributed systems, scalable architectures, software engineering principles, testing, and design patterns.
  • Experience working with Agile teams and leading engineering teams at scale.
  • Bachelor’s or master’s degree in Computer Science or Engineering.
  • Preferred experience with graph databases such as Neo4j and Neptune; vector databases such as Milvus and OpenSearch; and the NVIDIA ecosystem, including RAPIDS, cuDF, cuML, and cuGraph.
  • Preferred experience integrating AI/ML pipelines or GenAI workflows.

Benefits

  • The position requires working onsite five days per week.
  • Relocation is available.
  • The posting is open from November 4, 2026 through November 12, 2026.

Similar vacancies

More like this role

  • IT
... your software engineering career while building impactful technology solutions. Grow your skills and make a difference with a collaborative team. As a Senior Lead Engineer at JPMorgan Chase within the Chief Technology Office team, you will design, develop, and deliver innovative software solutions. You will collaborate ...

Bangalore, भारत

  • Full-time
  • IT
... Experience with Git, CI/CD pipelines, and DevOps practices - Knowledge of Linux environments - Experience with Jira and ITSM tooling - Exposure to cloud-based data platforms Candidate Profile - Medior-level engineer capable of working independently on standard tasks - Able to create and resolve customers' requirements - ...

Bangalore, भारत

... inclusion, ownership, continuous learning, and engineering excellence. Required qualifications, capabilities, and skills - Formal training or certification on software engineering concepts and 5+ years applied experience in Python software development and architecture. - Hands-on practical experience in software, data, or ...

Bombay, भारत

  • Full-time
  • IT
Responsibilities - Design, development and testing of components / modules in TOP (Trade Open Platform) involving Spark, Java, Hive and related big-data technologies in a datalake architecture - Contribute to the design, development and deployment of new features & new components in Azure public cloud - Contribute to the ...

Bangalore, भारत

Senior software engineering role at Nomura in Mumbai. What you'll do - NXTConnect and Core Gateways are our flagship solutions that provides HFT/Hedge Fund Clients with low latency Direct Market Access (DMA) and connectivity to Algo… - This is an individual contributor position within Connectivity IT team - In this role, ...

Bombay, भारत

  • Full-time
  • IT
... networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Lead Software engineer All About Us MasterCard is a technology company in the global payments business. We connect consumers, financial institutions, merchants, governments, ...

Pune, भारत

  • Full-time
  • IT
... centers supporting MasterCard Business Partners processing needs and internal and external customer requirements. Knowledge / Experience: - Provide Technical leadership and strategic direction as a Lead to multiple teams and/or functional areas. AI Native engineer - experience of software engineering across variety of LLMs. ...

Pune, भारत

  • Full-time
  • IT
Senior software engineering role at NIKE in Karnataka. Needs 7–10 years and an https://jobeax.com/link/MPrGoo1PSJpZ7d0e, https://jobeax.com/link/2DENLGgQM7whDhaE or B.E.. What you'll do - Lead the design of consumption layers, APIs, and pipelines that BI Experience teams build on — establishing patterns, contracts, and ...

भारत

  • Full-time
  • IT
Senior software engineering role at JPMorgan Chase in Bengaluru. Needs 5+ years. What you'll do - Use domain modeling techniques to build best-in-class business products - Structure software for ease of understanding, testing, and evolution - Build scalable solutions that avoid single points of failure What you need - Java ...

Bangalore, भारत

  • Full-time
  • IT
Senior software engineering role at Danaher in Bengaluru. Needs a https://jobeax.com/link/2DENLGgQM7whDhaE or B.E.. What you'll do - Lead the technical execution of new product development and Product Care projects , ensuring delivery against business, quality, schedule, and technical objectives - Provide technical leadership ...

Bangalore, भारत