Data Engineer (AWS, SQL) in Pune, India is listed on Jobeax. Browse 30,000+ vacancies available.
We are seeking a Data Engineer to join our team. The role will involve building and maintaining data pipelines and collaborating closely with stakeholders.
Key responsibilities
Design and develop scalable data pipelines using AWS services.
Implement ETL processes with AWS Glue, Lambda, and DBT.
Work with PySpark and SQL to transform and cleanse data.
Configure and manage Airflow workflows and Amazon EMR clusters.
Integrate data services with API Gateway and REST/Soap APIs.
Required qualifications
3 to 5 years of experience in data engineering.
Proficient in AWS S3, Glue, Lambda, DBT, PySpark, SQL, API Gateway, EMR, Airflow.
Hands‑on experience with REST and SOAP APIs.
Strong client communication and basic project lifecycle management.
Hello, We are hiring for 'Data Engineer with Java' for Pune Location. Exp :5+Years Loc : Pune Notice Period: Immediate joiners(notice period served or serving candidate) Mandatory Skills: Data Engineering Airflow Data Build Tool(DBT) Java ETL/ELT Pipeline CI/CD SQL NOTE: We are looking for Immediate joiners(notice period ...
... expectations are met through disciplined implementation (access controls, lineage, and quality standards) 5+ years building and operating production data pipelines (data engineering—not primarily BI/analytics or data science) - Strong SQL plus strong data modeling skills (dimensional and/or lakehouse modeling) - Hands-on Databricks ...
Job Summary :The Data Integration Engineer will design, develop, and support data integration solutions that extract financial and operational data from enterprise source systems and deliver trusted data to analytics platforms and external vendors. The role emphasizes source-to-target mapping, transformation, validation, ...
... experience in Data Engineering.- Strong Python + SQL expertise.- Strong Data Architecture and System Design skills.- End-to-end production pipeline ownership.- Expert SQL including Window Functions, CTEs, CASE logic.- Strong experience with MySQL / PostgreSQL.- Experience designing Transaction / Fact Tables.- Strong data quality, ...
... operations at ELGi. Data Engineering & Architecture Design scalable, production-grade ETL/ELT pipelines across Azure, AWS, and GCP. Develop modular, reusable data engineering frameworks for ingestion, transformation, and orchestration. Build Spark, SQL, and Python workflows in Databricks. Optimize compute, storage, and ...
... least one certification • Databricks Certified Data Engineer Associate OR Databricks Certified Data Engineer Professional Additional Certifications (Preferred) - Databricks Certified Associate Developer for Apache Spark - Cloud platform certifications (Azure Data Engineer Associate, AWS Certified Data Analytics, or Google Cloud ...
... maintain scalable data pipelines and distributed systems. The ideal candidate should have hands-on experience with ETL/ELT pipelines, workflow orchestration, AWS cloud services, data visualization, distributed architectures, and modern data engineering https://jobeax.com/link/TtkK7BHPbancvnFq Responsibilities:- Design, ...
... using Python and PySpark to ingest data from files, APIs, RDBMS, NoSQL, and message queues into AWS data stores Develop and optimize PySpark jobs for large-scale data processing, transformation, and aggregation on AWS EMR or Databricks Build and manage AWS-native data workflows using S3, Glue, Lambda, Redshift, and Step Functions; ...
... Senior Data Engineer with strong hands-on experience building and supporting data solutions on AWS . The role requires solid experience with Amazon Redshift, S3, AWS Glue, Amazon AppFlow, Lambda, and SQL . You will work on data ingestion, transformation, data pipelines, data warehouse solutions, and integrations across different ...
... Data Factory, Databricks, Synapse, dbt (any two – Mandatory). Data Warehousing: Azure SQL Server/Redshift/Big Query/Databricks/Snowflake (Anyone - Mandatory). Data Visualization: Looker, Power BI, Tableau (Basic understanding to support stakeholder queries). Cloud: Azure (Mandatory), AWS or GCP (Good to have). SQL and Scripting: ...
... entity resolution and record linkage. Strong SQL and Python programming skills. Experience with ETL/ELT pipeline development. Familiarity with cloud platforms like AWS, Azure, or GCP. Knowledge of data engineering best practices and scalable architectures. Experience with Apache Spark or PySpark. Knowledge of Docker, Kubernetes, ...
... working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases and Cloud Data warehouse like AWS Redshift.- Experience in creating scalable, efficient schema designs to support diverse business needs.- Experience with database normalization, ...
Position: Senior Data Engineer Location: Pune Job Responsibilities Design, develop, and maintain scalable data pipelines using AWS services. Design and implement scalable, secure, and resilient MLOps architecture across cloud and on-prem environments Define best practices for model lifecycle management, including versioning, ...
... global projects. - Degree in Engineering, Computer Science, Information Technology, Data Science, or a related discipline. Formal training or certification in Data provisioning will be preferred. Experience: · 5+ years of rich experience with Data provisioning within Supply Chain . (prior experience collaborating with global ...
Role :Lead Engineer - Conversion/Migration Skills - Mandatory-SQL Server, ETL/Data Migration Skills - Good to have -SSIS, Azure Data Factory Work location: Kochi/Trivandrum Total Experience: 6-9 years Strong hands-on expertise in SQL Server (T-SQL) and relational database design, with solid experience in data migration ...
... features and data contracts. Build and ship models to: Enhance customer experiences and personalization Boost revenue via pricing/discount optimization Detect and block fraud/risk in real time Collaborate with Engineering to productionize via APIs/CI/CD/Docker on AWS. Build monitoring for model/data drift and business KPIs
Data Engineer: PySpark+AWS Glue 4-8 years in Data Engineering with hands-on expertise in Snowflake, AWS Glue, AWS (S3/Lambda/CloudWatch), Python, PySpark, and SQL. Strong experience in ETL/ELT, Data Warehousing, Data Pipelines, Performance Tuning, and Cloud Data Platforms. Exposure to AI/ML or GenAI solutions is a plus ...
... understanding of streaming data pipelines for near real-time analytics- Hands-on experience and good understanding of AWS services for data engineering, including AWS Glue, Lambda, Step Functions, Amazon Redshift, EMR, Amazon Kinesis etc.- Good understanding and experience working with at-least one NoSQL database- Good understanding ...
... design and implement automated data pipelines and materialized views. - Proficiency in Python, Unix or similar languages. - Good understanding of SQL oracle, SQL server or similar languages. - Ops & CI/CD: Monitoring (Prometheus/Grafana), logging, pipelines (Jenkins/GitHub Actions). - Core Engineering: Data structures/algorithms, ...
Data Engineer III/ IV - IN (Operation/ Supports) Work Location - Remote Work From Home Shift: Rotation Shifts (24/7) Experience: 7-12 years The Data engineer is responsible for managing and operating upon Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI/Tableau. The engineer will work closely with the customer ...