Vacancy description
Duobridge Talent Solution
Rs 15 - 18 lakhs p.a.
Bangalore, भारत
Job Description:
We are looking for an experienced Data Engineer to design, develop, and manage scalable cloud-native data engineering solutions on AWS. The role involves building automated ETL/ELT pipelines, real-time data processing frameworks, and governed data platforms.
Key Responsibilities:
Build and maintain scalable data pipelines using AWS, Python, SQL, and Databricks.
Work with Snowflake, Apache Airflow, Spark, Kafka, and AWS Kinesis for data processing and orchestration.
Implement containerisation and deployment using Docker and Kubernetes.
Manage CI/CD pipelines and infrastructure automation using Terraform, Git, and Jenkins.
Ensure data quality, governance, monitoring, and performance optimisation.
Required Skills:
AWS, Python, SQL, Databricks, Snowflake, Apache Airflow, Docker, Kubernetes, Spark, Kafka, Terraform, Git, and Jenkins.
Note: Candidates must be comfortable working from the Bangalore office 4 days a week.