Back to list

Vacancy description

Data Engineer - Bangalore in Bangalore, भारत

Duobridge Talent Solution

Rs 15 - 18 lakhs p.a.

Bangalore, भारत

Job Description:

We are looking for an experienced Data Engineer to design, develop, and manage scalable cloud-native data engineering solutions on AWS. The role involves building automated ETL/ELT pipelines, real-time data processing frameworks, and governed data platforms.

Key Responsibilities:

  • Build and maintain scalable data pipelines using AWS, Python, SQL, and Databricks.

  • Work with Snowflake, Apache Airflow, Spark, Kafka, and AWS Kinesis for data processing and orchestration.

  • Implement containerisation and deployment using Docker and Kubernetes.

  • Manage CI/CD pipelines and infrastructure automation using Terraform, Git, and Jenkins.

  • Ensure data quality, governance, monitoring, and performance optimisation.

Required Skills:
AWS, Python, SQL, Databricks, Snowflake, Apache Airflow, Docker, Kubernetes, Spark, Kafka, Terraform, Git, and Jenkins.

Note: Candidates must be comfortable working from the Bangalore office 4 days a week.

Similar vacancies

More like this role

  • Full-time
... choice. Data Engineer POSITION PURPOSE: As a Data Engineer, you are developing and operating reliable data pipelines that enable timely access to high-quality data assets. You are part of a dynamic team of technical experts, working hand-in-hand with subject matter experts, data product managers, semantic experts and data ...

Bangalore, भारत

  • Full-time
... scalability, and reliability. - Ensure data security and compliance by managing secrets and sensitive information using AWS Secrets Manager. - Monitor and troubleshoot data pipelines to ensure smooth operation and timely data delivery." - "Proven experience as a Data/Integration Engineer or in a similar role. - Strong knowledge of ...

Bangalore, भारत

  • Full-time
... SQL databases, REST APIs, data lakes, and other structured and unstructured data sources. - Knowledge of data integration and transformation techniques for engineering and operational data. Facilities Engineering Data Services & Workflows - Support functional testing and unit testing of data pipelines, models, and data ...

Bangalore, भारत

Vrinda International

Data Engineer

  • Full-time

Rs 15 - 22 lakhs p.a.

Data Engineer Summary We are seeking an experienced Data Engineer to architect, build, and maintain scalable data infrastructure within the IT Services sector. In this pivotal role, you will drive the design of robust data warehousing solutions and ensure seamless data modeling to support critical business analytics. Your ...

Bangalore, भारत

Next-Link

Data Engineer

  • Contract

Rs 13 lakh p.a.

... Use SQL for data querying, validation, and data modeling, as required. 3. Data Engineering Fundamentals - Design, develop, and maintain ETL/ELT pipelines for data ingestion and transformation. - Build efficient data models and optimize data processing workflows. - Work with structured and unstructured data from multiple ...

Bangalore, भारत

Commvault

Data Engineer

  • Hybrid
  • DevOps
... Engineer (Platform Engineering Focus) The Opportunity: The Platform Engineer builds, automates, and supports the shared cloud platform services that enable reliable data, analytics, and AI delivery. This hands-on role works with Senior Platform Engineers, Data Engineers, Analytics Engineers, Security, and Architecture teams to ...

Bangalore, भारत

  • Full-time
  • Project Management
... deployment. Prepare user training documents and related frameworks to ensure smooth adoption new applications and minimize transition risks. Mandatory Skills: DataBricks - Data Engineering. Experience: 5-8 Years. Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with ...

Bangalore, भारत

  • Full-time
  • IT
  • Cloud
... diversity of people and perspective gives us a competitive advantage. Location - Bangalore, Hyderabad, Chennai - Min 8-12 years of hands-on experience in GCP Data Engineering designing, building and supporting distributed systems and large-scale data processing systems in production with a proven track record. - Expertise ...

Bangalore, भारत

  • Full-time
  • Contract
... years of experience in data engineering, DataOps, DevOps, or a comparable technical role. - Advanced hands-on experience with Python, PySpark, SQL, Git, and Databricks. - Strong experience with the Databricks ecosystem, including Delta Lake, Unity Catalog, and Databricks Serverless SQL. - Proven experience with Infrastructure ...

Bangalore, भारत

  • Full-time
  • Contract
... passionate about building systems at scale. You will enable a world-class engineering practice, drive the approach with which we use data, develop backend systems and data models to serve the needs of insights and play an active role in building Atlassian's data-driven culture. - Own the technical evolution of the data engineering ...

Bangalore, भारत

  • Full-time
... migrating data pipelines from on-prem or other cloud platforms Understanding of data governance, security, and access control on AWS Experience with CI/CD for data pipelines Nice to have AWS certification (Data Analytics Specialty or Data Engineer Associate) Experience with streaming data (Kinesis, MSK/Kafka) Familiarity ...

Bangalore, भारत