Back to list

Vacancy description

Lead Software Engineer - Data Engineer in Chennai, भारत

Caterpillar

  • On-siteWork from the office
  • Full-timeStandard weekly hours

Chennai, भारत

Responsibilities

  • Lead and mentor a team of data engineers and platform developers.
  • Architect scalable and secure AWS-based data platforms.
  • Design and develop batch and near-real-time ingestion pipelines for structured and unstructured data.
  • Build and optimize Snowflake data platforms, including data modeling, governance, metadata management, performance, and cost optimization.
  • Use AWS services to implement end-to-end data pipelines.
  • Establish engineering best practices, code quality, testing, version control, CI/CD standards, and reusable ingestion and transformation frameworks.
  • Drive Agile delivery, automation, continuous improvement, scalability, resiliency, and operational readiness.
  • Partner with product managers, subject matter experts, data science and AI teams, and business stakeholders to deliver scalable data solutions.
  • Operationalize ML models and analytics workflows and support real-time analytics, edge AI, and AI-enabled data engineering use cases.

Requirements

  • 10+ years of experience in data engineering or data platform roles.
  • Strong experience with the AWS data ecosystem, including S3, Glue, Lambda, EMR, and Redshift.
  • Deep expertise in Snowflake architecture, optimization, and data modeling.
  • Strong programming skills in Python and SQL.
  • Extensive experience with data ingestion pipelines and ETL/ELT frameworks.
  • Experience with real-time streaming technologies such as Kafka and Spark Streaming.
  • Experience with CI/CD and engineering tools including GitHub, Jenkins, AWS CloudFormation, and Git.
  • Understanding of distributed systems, scalable architectures, software engineering principles, testing, and design patterns.
  • Experience working with Agile teams and leading engineering teams at scale.
  • Bachelor’s or master’s degree in Computer Science or Engineering.
  • Preferred experience with graph databases such as Neo4j and Neptune; vector databases such as Milvus and OpenSearch; and the NVIDIA ecosystem, including RAPIDS, cuDF, cuML, and cuGraph.
  • Preferred experience integrating AI/ML pipelines or GenAI workflows.

Benefits

  • The position requires working onsite five days per week.
  • Relocation is available.
  • The posting is open from November 4, 2026 through November 12, 2026.

Similar vacancies

More like this role

  • IT
... your software engineering career while building impactful technology solutions. Grow your skills and make a difference with a collaborative team. As a Senior Lead Engineer at JPMorgan Chase within the Chief Technology Office team, you will design, develop, and deliver innovative software solutions. You will collaborate ...

Bangalore, भारत

  • Full-time
  • IT
... Experience with Git, CI/CD pipelines, and DevOps practices - Knowledge of Linux environments - Experience with Jira and ITSM tooling - Exposure to cloud-based data platforms Candidate Profile - Medior-level engineer capable of working independently on standard tasks - Able to create and resolve customers' requirements - ...

Bangalore, भारत

... inclusion, ownership, continuous learning, and engineering excellence. Required qualifications, capabilities, and skills - Formal training or certification on software engineering concepts and 5+ years applied experience in Python software development and architecture. - Hands-on practical experience in software, data, or ...

Bombay, भारत

  • Full-time
  • IT
Responsibilities - Design, development and testing of components / modules in TOP (Trade Open Platform) involving Spark, Java, Hive and related big-data technologies in a datalake architecture - Contribute to the design, development and deployment of new features & new components in Azure public cloud - Contribute to the ...

Bangalore, भारत

Senior software engineering role at Nomura in Mumbai. What you'll do - NXTConnect and Core Gateways are our flagship solutions that provides HFT/Hedge Fund Clients with low latency Direct Market Access (DMA) and connectivity to Algo… - This is an individual contributor position within Connectivity IT team - In this role, ...

Bombay, भारत

... networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Lead Software engineer All About Us MasterCard is a technology company in the global payments business. We connect consumers, financial institutions, merchants, governments, ...

Pune, भारत

... centers supporting MasterCard Business Partners processing needs and internal and external customer requirements. Knowledge / Experience: - Provide Technical leadership and strategic direction as a Lead to multiple teams and/or functional areas. AI Native engineer - experience of software engineering across variety of LLMs. ...

Pune, भारत

  • Full-time
  • IT
Senior software engineering role at NIKE in Karnataka. Needs 7–10 years and an https://jobeax.com/link/MPrGoo1PSJpZ7d0e, https://jobeax.com/link/2DENLGgQM7whDhaE or B.E.. What you'll do - Lead the design of consumption layers, APIs, and pipelines that BI Experience teams build on — establishing patterns, contracts, and ...

भारत

  • Full-time
  • IT
Senior software engineering role at JPMorgan Chase in Bengaluru. Needs 5+ years. What you'll do - Use domain modeling techniques to build best-in-class business products - Structure software for ease of understanding, testing, and evolution - Build scalable solutions that avoid single points of failure What you need - Java ...

Bangalore, भारत

  • Full-time
  • IT
Senior software engineering role at Danaher in Bengaluru. Needs a https://jobeax.com/link/2DENLGgQM7whDhaE or B.E.. What you'll do - Lead the technical execution of new product development and Product Care projects , ensuring delivery against business, quality, schedule, and technical objectives - Provide technical leadership ...

Bangalore, भारत