Vacancy description
talentgigs
India, Chennai
Senior Data Engineer - AWS, DevOps in Chennai, India is listed on Jobeax. Browse 30,000+ vacancies available.
Data Engineer – Python & Pyspark (AWS)
Exp: 6+ yrs
Location : Chennai Client Place Guindy
Work Mode : All 5 days
Role Overview
We're seeking a Senior Data Engineer with strong hands-on expertise in Python, PySpark, and AWS to design, build, and operate scalable data pipelines for analytics and operational workloads. You will own end-to-end data engineering — from ingestion to delivery — across batch and near-real-time patterns, with a focus on pipeline reliability, data quality, and cloud-native engineering.
This is an engineering role — you will build and own production systems, not just develop queries or reports. Individual contributor expected to influence architecture, drive technical decisions, and mentor peers without formal people management responsibilities.
Key Responsibilities
Design, build, and maintain scalable ETL/ELT pipelines using Python and PySpark to ingest data from files, APIs, RDBMS, NoSQL, and message queues into AWS data stores
Develop and optimize PySpark jobs for large-scale data processing, transformation, and aggregation on AWS EMR or Databricks
Build and manage AWS-native data workflows using S3, Glue, Lambda, Redshift, and Step Functions; manage scheduling, dependencies, retries, and SLAs
Write production-grade Python for data transformations, validations, orchestration, and API integrations — not notebook-level scripting
Implement robust data quality controls: schema validation, deduplication, referential integrity checks, and anomaly detection
Collaborate on data modeling (star/snowflake, data vault, medallion architecture) and define data contracts and lineage
Build CI/CD for data pipelines (tests, linting, packaging) using GitHub Actions or AWS CodePipeline; maintain documentation and runbooks
Troubleshoot and remediate production issues; drive continuous improvement in performance, reliability, and cost
Required Qualifications
Experience with Kafka, Kinesis, or Event Hubs for event streaming
Familiarity with dbt for ELT and data testing
Great Expectations or Deequ for data quality
Docker / Kubernetes for containerized data services
Knowledge of data security patterns: PII masking, tokenization, column/row-level security
Informatica, ODI, or SSIS exposure
Education & Certifications
Bachelor's/Master's in Computer Science, Engineering, or equivalent
AWS Certified Data Engineer, AWS Solutions Architect, Databricks, or Snowflake certifications are a plus
Similar vacancies
ganit inc.
Job Title: Senior Data Engineer At Ganit , we are not just data geeks – we are a family of scientists, refiners, and artisans. Our mission is to bridge the gap between intelligence and action, translating data into valuable insights and strategies. We work with businesses to create state-of-the-art solutions that push the ...
India, Bengaluru
... operations teams to improve system performance. What you will need to be successful (experience and qualifications) A bachelor's degree in computer science, engineering, or a related field or equivalent work experience. AWS / Azure cloud engineering, fundamentals, DevOps, architect certifications) can be beneficial. Knowledge ...
India, Pune
... cloud innovation to customers worldwide. We celebrate diversity and foster an inclusive environment, empowering our employees to be their authentic selves. The Devops Engineer would be an active member within the Voice Application Services team, responsible for providing automation and test support for the SW releases of Five9. ...
India, Bengaluru
HERE Technologies
As a Senior DevOps Engineer , you will play a key role in designing, building, and operating cloud infrastructure and CI/CD platforms that support HERE's products and services. You will contribute to improving system reliability, automation, observability, and security while collaborating with cross‑functional engineering ...
India, Mumbai
We're looking for a seasoned Senior DevOps Engineer to lead cloud-native infrastructure initiatives across AWS, Azure and GCP. You'll architect scalable CI/CD pipelines using GitLab, manage containerized workloads with Kubernetes, Docker and Helm, and drive automation, security, and governance across multi-cloud environments. ...
India, Bengaluru
... in Computer Science, Engineering, or a related field. Minimum of 3 to 4 years of experience as a DevOps or Site Reliability Engineer. Minimum of 5 years of engineering experience. Strong expertise in Jenkins, Terraform, Ansible, Kubernetes, Python, PostgreSQL, MSK, Kafka, RDS, Airflow, and AWS. Comfortable with deployments ...
India, Chennai
Funic Tech
Role: Senior Data EngineerExperience: 7+ YearsLocation: PuneJoining: Immediate to 30 Days' Notice PeriodRole Summary:We are looking for a skilled Sr. Data Engineer with strong expertise in Python and cloud-native technologies to design, develop, and maintain scalable data pipelines and distributed systems. The ideal candidate ...
India, Pune
Neutrino Advisory, an Inc 5000 Company
Neutrino Advisory is looking for an experienced Senior Data Engineer with strong hands-on experience building and supporting data solutions on AWS . The role requires solid experience with Amazon Redshift, S3, AWS Glue, Amazon AppFlow, Lambda, and SQL . You will work on data ingestion, transformation, data pipelines, data ...
India, India
mindbrain
Senior Data Engineer – Graph Database & Data Intelligence Position: Senior Data Engineer Experience Required: 6+ Years Location: Remote Employment Type: Contract We are seeking a highly skilled Senior Data Engineer with expertise in Graph Databases, Data Modeling, and modern backend frameworks. The ideal candidate should ...
India, India
Datazymes
... processes, optimising data delivery and re-designing infrastructure for greater scalability.- Collaborate with stakeholders to ensure seamless integration of data with internal data marts, enhancing advanced reporting.- Setup and maintain data ingestion, streaming, scheduling, and job monitoring automation using AWS services.- ...
India, Bengaluru
The DevOps Engineer will lead the design, implementation, and maintenance of robust CI/CD pipelines, cloud infrastructure (AWS/Azure/GCP), containerized applications, and infrastructure automation solutions. The role requires advanced technical expertise in DevOps tools and scripting, infrastructure as code (Terraform), ...
India, Vadodara
Palo Alto Networks
... Majors (Science, Technology, Engineering and Math) A minimum of 1-3 years of professional experience as individual contributor role (DevOps/SRE). Proficiency in DevOps practices, methodologies, and tools, such as CI/CD pipelines, configuration management, and containerization. Experience with cloud platforms (e.g., AWS, Azure, ...
India, Rāniganj
... expertise with cloud infrastructure (AWS, GCP or Azure), containers and orchestration, CI/CD, monitoring stacks, automation - Strong experience in Site Reliability Engineering, DevOps, or Production Operations—preferably supporting large-scale systems - Solid understanding of incident management, reliability engineering, and microservice ...
India, Bengaluru
... Samarth, and GST Sahay, helping improve credit assessment, reduce turnaround time, and support financial inclusion across India. We are seeking a highly skilled Senior DevSecOps/DevOps Engineer with extensive experience in cloud infrastructure, automation, and security best practices. The ideal candidate must have 5+ years ...
India, Ahmedabad
... deployment velocity, and driving DevOps best practices across engineering teams. Key Responsibilities Cloud Infrastructure & Automation Design, provision, and manage AWS infrastructure using Terraform, CloudFormation, and AWS CLI. Manage AWS services including Kubernetes, EC2 (Windows/Linux), VPC, IAM, Load Balancers, RDS, S3, ...
India, Mumbai
Accenture
... scalable solutions while balancing long-term architecture goals with project delivery needs. Key Skills: Data anonymization, privacy-by-design, and clinical trial data concepts Python, R, Apache Airflow, Kafka, REST/gRPC integrations Data formats: CSV, Parquet, SAS, RDS AWS (EKS, S3, IAM, DocumentDB) Solution/Data Architecture, ...
India, Rāniganj
blucursor infotech pvt ltd
... building, managing, and optimizing CI/CD pipelines with tools like Jenkins, GitHub Actions, or GitLab CI. Provision, configure, and manage cloud infrastructure (AWS, Azure, or GCP) under the guidance of senior engineers. Work on containerization using Docker and support Kubernetes orchestration in development or staging environments. ...
India, Indore
... using work management tools (Azure Boards/Jira). Bachelor's degree in Computer Science, Engineering, or related field; or equivalent practical experience in DevOps / Cloud Engineering. Any relevant Cloud certifications (e.g., Azure Administrator, Azure DevOps Engineer Expert, Azure Solutions Architect, or Azure Data/AI ...
India, Bengaluru
... 1-2 years of professional experience as a DevOps Engineer or similar software engineering role - Proficiency in Python or Bash scripting - Working knowledge of databases, SQL, and Linux systems - Familiarity with Docker, CI/CD pipelines, and cloud platforms such as AWS (certifications are a plus) - Awareness of monitoring, ...
India, India
joblet-ai
... bidding, and predictive analytics — helping the world's largest employers find the right people, faster and fairer. But we're not done. Not even close. Role: DevOps Engineer Location: Remote Role Overview: We are hiring a DevOps Engineer to build, automate, and maintain the infrastructure that keeps Joveo's platform running ...
India, Mumbai