Vacancy description
talentgigs
India, Chennai
Senior Data Engineer - AWS, DevOps in Chennai, India is listed on Jobeax. Browse 30,000+ vacancies available.
Data Engineer – Python & Pyspark (AWS)
Exp: 6+ yrs
Location : Chennai Client Place Guindy
Work Mode : All 5 days
Role Overview
We're seeking a Senior Data Engineer with strong hands-on expertise in Python, PySpark, and AWS to design, build, and operate scalable data pipelines for analytics and operational workloads. You will own end-to-end data engineering — from ingestion to delivery — across batch and near-real-time patterns, with a focus on pipeline reliability, data quality, and cloud-native engineering.
This is an engineering role — you will build and own production systems, not just develop queries or reports. Individual contributor expected to influence architecture, drive technical decisions, and mentor peers without formal people management responsibilities.
Key Responsibilities
Design, build, and maintain scalable ETL/ELT pipelines using Python and PySpark to ingest data from files, APIs, RDBMS, NoSQL, and message queues into AWS data stores
Develop and optimize PySpark jobs for large-scale data processing, transformation, and aggregation on AWS EMR or Databricks
Build and manage AWS-native data workflows using S3, Glue, Lambda, Redshift, and Step Functions; manage scheduling, dependencies, retries, and SLAs
Write production-grade Python for data transformations, validations, orchestration, and API integrations — not notebook-level scripting
Implement robust data quality controls: schema validation, deduplication, referential integrity checks, and anomaly detection
Collaborate on data modeling (star/snowflake, data vault, medallion architecture) and define data contracts and lineage
Build CI/CD for data pipelines (tests, linting, packaging) using GitHub Actions or AWS CodePipeline; maintain documentation and runbooks
Troubleshoot and remediate production issues; drive continuous improvement in performance, reliability, and cost
Required Qualifications
Experience with Kafka, Kinesis, or Event Hubs for event streaming
Familiarity with dbt for ELT and data testing
Great Expectations or Deequ for data quality
Docker / Kubernetes for containerized data services
Knowledge of data security patterns: PII masking, tokenization, column/row-level security
Informatica, ODI, or SSIS exposure
Education & Certifications
Bachelor's/Master's in Computer Science, Engineering, or equivalent
AWS Certified Data Engineer, AWS Solutions Architect, Databricks, or Snowflake certifications are a plus
Similar vacancies
Smart Energy Water
... pipelines. Troubleshoot production ETL, database, integration, and data-quality issues and perform root-cause analysis. Collaborate with application, product, DBA, DevOps, and client teams to resolve end-to-end data issues. Required Technical Skills Must Have: - 5–7 years of Data Engineering / ETL experience - Strong SQL and Python ...
India, Noida
ELGI EQUIPMENTS LIMITED
... Vault / AWS Secrets Manager. Pipeline Reliability & DevOps Set up monitoring, logging, and alerting frameworks for pipeline health. Drive test-driven data engineering (unit, integration, regression tests). Use Azure DevOps and GitHub for CI/CD automation and version control. Collaborate with Data Engineering, Data Architects, ...
India, Bengaluru
anrgi tech
... least one certification • Databricks Certified Data Engineer Associate OR Databricks Certified Data Engineer Professional Additional Certifications (Preferred) - Databricks Certified Associate Developer for Apache Spark - Cloud platform certifications (Azure Data Engineer Associate, AWS Certified Data Analytics, or Google Cloud ...
India, Pune
JMAN Group
... specifications. Assist with data modelling and optimization tasks. Document the data platform architecture, processes, and best practices. Stay up to date with the latest trends and technologies in full stack development, data engineering, and DevOps. Proactively suggest improvements and innovations for the data platform.
India, Mannady
acs international india pvt. ltd. (acsii)
Position: Senior Data Engineer Location: Pune Job Responsibilities Design, develop, and maintain scalable data pipelines using AWS services. Design and implement scalable, secure, and resilient MLOps architecture across cloud and on-prem environments Define best practices for model lifecycle management, including versioning, ...
India, Pune
Tresata
DevOps Engineer ('DOE') is responsible for deploying and managing Tresata software installations for clients. You will develop code for automated deployment and configuration, and manage deployments by maintaining configurations and upgrading software. Environments vary from on-site Hadoop/Spark Clusters to Amazon AWS deployments ...
India, Bengaluru
... as the lead engineer on large or complex client deploy projects Act as the lead engineer on product engineering projects to further develop our service Provide AWS subject matter expertise advice and assistance to pre-sales architects Installation, configuration, and ongoing management of O/S and AWS services. Implementing ...
India, Bengaluru
... IaC: Azure, AWS, Terraform, ARM/Bicep Containers & Platform: Docker, Microservices, Kubernetes (desirable) Automation: PowerShell, Bash AI / AIOps: AIassisted DevOps and observability tools Security & Data: DevSecOps basics, networking, MS SQL, Windows/.NET Qualifications Engineering Graduate/ MCA Experience: 6+ years (Product ...
India, Bengaluru
refold ai
$6.5 USD
... companies that need to ship enterprise integrations at scale. We're reimagining integrations with AI agents that work like business consultants and integration engineers, building them 10x faster, in hours instead of days. The payoff: integrations stop being a bottleneck that costs you deals and burns margin, and become a growth ...
India, Bengaluru
Lucideus
... https://jobeax.com/link/3T8us57ZNOTZBEWN : - Bachelor's or Master's degree in Computer Science, Engineering, or a related field.- Minimum of 5+ years of proven experience as a DevOps Engineer or in a similar capacity.- Strong understanding of Infrastructure as Code tools using AWS CloudFormation, Terraform, Ansible, Puppet, Chef, or an equivalent.- ...
India, Bengaluru
Prophecy
... interfaces to analyze, transform and prepare data, to ship trusted insights at enterprise scale. Don’t miss the rocket ship—join Prophecy and build the next data revolution. This is a high-impact opportunity to be a senior DevOps engineer in a fast-growing startup, based in Prophecy’s India engineering center. You will ...
India, Bengaluru
growqai
Role - DevOps Engineer Location - Chennai Mode - Work from office Experience - 5+ Years Employment - Full-time Industries - Banking, Payments, FinTech, IT Products Note: Candidates having experience with US banking sector with US payment domains are preferred. About the role - We are looking for a Senior DevOps Engineer ...
India, Chennai
techbridge consultancy services
Job description Job Description (JD) - Senior Associate DevOps Assistant (Grade 2) The Senior Associate DevOps Assistant (Grade 2) supports the DevOps team in automating, streamlining, and enhancing the development and deployment pipelines. This role involves assisting in managing infrastructure, automating software deployment, ...
India, Gurugram
... testing of the platform takes place automatically. The individual is expected to collaborate and operate in parallel with the DevOps Engineers and Application Engineers. Mentoring and training other team members will be an expectation from this role. Responsibilities: The Senior Cloud Services Engineer utilizes software that ...
India, Rāniganj
... c#, API's, Azure - and many more – that deploy to Azure, AWS, internal, and client hosted platforms. We are a team of experienced and sharp developers with a DevOps mentality What Our Senior Software Engineer I Will Do Learn multiple platforms, technologies and languages (i.e. Azure, Azure DevOps, AWS, PowerShell, c#) to ...
India, Noida
... destinations since time began, our values guide us. They help us be at our best. For the cities and communities we serve. We're looking for a collaborative Senior Software Engineer to help build and improve a world-class payment platform that impacts millions of users. Proactively collaborate with your team, communicating ...
India, Bengaluru
Grid Dynamics
Details on Tech Stack Exp - 7+yrs to 12yrs Java Spring Framework AWS/GCP BigQuery Microservices Architecture Strong proficiency in Java with at least 7+ years of experience Extensive experience with Spring Framework Familiarity with Google Cloud Platform, particularly BigQuery Solid understanding of software engineering ...
India, Rāniganj
... cloud platform (AWS), with proven hands-on experience in Terraform, Docker, and Kubernetes. We are not looking for a 'server administrator.' Can challenge poor engineering practices Thinks in terms of reliability engineering, not firefighting For most SaaS companies, DevOps becomes a support function. A Weak DevOps Team Creates ...
India, Valsād
Infineon Technologies
We are looking for an experienced Senior Software Engineer / Developer with strong hands-on expertise in AWS cloud services, microservices, REST API development, and Node.js. The ideal candidate will design, develop, deploy, and support scalable, secure, and high-performance cloud-native applications on AWS. Exposure of ...
India, Bengaluru