We are looking for an experienced Data Engineer to design, develop, and manage scalable cloud-native data engineering solutions on AWS. The role involves building automated ETL/ELT pipelines, real-time data processing frameworks, and governed data platforms.
Key Responsibilities:
Build and maintain scalable data pipelines using AWS, Python, SQL, and Databricks.
Work with Snowflake, Apache Airflow, Spark, Kafka, and AWS Kinesis for data processing and orchestration.
Implement containerisation and deployment using Docker and Kubernetes.
Manage CI/CD pipelines and infrastructure automation using Terraform, Git, and Jenkins.
Ensure data quality, governance, monitoring, and performance optimisation.
... scalability, and reliability. - Ensure data security and compliance by managing secrets and sensitive information using AWS Secrets Manager. - Monitor and troubleshoot data pipelines to ensure smooth operation and timely data delivery." - "Proven experience as a Data/Integration Engineer or in a similar role. - Strong knowledge of ...
... SQL databases, REST APIs, data lakes, and other structured and unstructured data sources. - Knowledge of data integration and transformation techniques for engineering and operational data. Facilities Engineering Data Services & Workflows - Support functional testing and unit testing of data pipelines, models, and data ...
Data Engineer Summary We are seeking an experienced Data Engineer to architect, build, and maintain scalable data infrastructure within the IT Services sector. In this pivotal role, you will drive the design of robust data warehousing solutions and ensure seamless data modeling to support critical business analytics. Your ...
... Use SQL for data querying, validation, and data modeling, as required. 3. Data Engineering Fundamentals - Design, develop, and maintain ETL/ELT pipelines for data ingestion and transformation. - Build efficient data models and optimize data processing workflows. - Work with structured and unstructured data from multiple ...
... Engineer (Platform Engineering Focus) The Opportunity: The Platform Engineer builds, automates, and supports the shared cloud platform services that enable reliable data, analytics, and AI delivery. This hands-on role works with Senior Platform Engineers, Data Engineers, Analytics Engineers, Security, and Architecture teams to ...
... deployment. Prepare user training documents and related frameworks to ensure smooth adoption new applications and minimize transition risks. Mandatory Skills: DataBricks - Data Engineering. Experience: 5-8 Years. Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with ...
... design discussions, and grow your skills in distributed data processing in a creative and fast-moving environment. You will build and maintain reliable, scalable data pipelines and contribute to the data systems that support marketing across our Labels. Working under the technical direction of senior engineers, you'll turn ...
... Net Zero by 2040. What you'll be doing Build, maintain, and monitor automated data pipelines on the Group's cloud data platform, transforming raw transactional data into reporting schemas and developing BI dashboards to deliver reliable, analytics-ready data. • Build, maintain, and monitor automated ETL/ELT data pipelines ...
Locations: Bangalore, KA, IN | Hyderabad, TG, IN Senior Data Engineer Are you passionate about transforming raw data into powerful insights that drive real business decisions? Do you thrive at the intersection of cutting-edge technology, AI innovation, and large-scale data engineering? If so, we have an exciting opportunity ...
... detailed technical designs, development, and implementation of applications using cutting-edge technology stacks. The Senior Data Engineer Opportunity As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable solutions. This role involves collaborating with data engineers, analysts, ...
GE HealthCare seeks a Senior Data Engineer to design and implement data engineering solutions, ETL pipelines, and analytics infrastructure. The role involves data profiling, metadata management, and automation using cloud and low-code tools to support data science outcomes. Responsibilities - Design and build automations ...