Data Engineer - ETL/Data Pipelines in Mumbai, India

We are seeking a Data Engineer to join our team. The role will involve building and maintaining data pipelines and collaborating closely with stakeholders. Key responsibilities Design and develop scalable data pipelines using AWS services. Implement ETL processes with AWS Glue, Lambda, and DBT. Work with PySpark and SQL ...

... with other data engineers, data scientists, and business colleagues. The ideal candidate is a driven learner who develops and sharpens skills building data pipelines, transforming raw data into useful data systems, and optimizing the data delivery architecture. Responsible to design, build, refactor, and maintain data pipelines ...

... SQL, followed by expertise in data storage, modeling, cloud, data warehousing, and data lakes, ETL tools. The Data Engineer Lead will work closely with customer Data Architects, Data Scientists and BI Engineers to design and maintain scalable data models and pipelines. Data engineer lead will transfer requirements to the offshore ...

... years of working experience with Data Engineering. - Core Languages: Proficient in SQL and Python for data manipulation, ETL pipeline building, and debugging. - ETL with IDMC: Practical experience building and monitoring mapping tasks, taskflows, and data integration pipelines within the Informatica Intelligent Data Management ...

• Full-time

... Experience with system integration, implementation, upgrades, migrations, or technology modernization. - Good understanding of application, infrastructure, cloud, database, networking, or platform technologies relevant to the role. - Familiarity with automation, monitoring, DevOps, CI/CD, cloud platforms, or modern engineering ...

... members of IT, including business analysts, database administrators, and managers, to design and develop Cognos reporting capability- Exhibit a commitment to data quality by validating results against sources specified in the requirements- Develop and maintain stored procedures- Write and support queries against databases ...

• Contract

... in data security and privacy engineering, this individual deploys and tunes data discovery, classification, DLP, encryption, and key management controls. The Data Protection Engineer partners closely with Engineering, IT, Compliance, Legal, and Privacy stakeholders to embed privacy-by-design principles into how data is ...

... https://jobeax.com/link/OBSYxKmspgkYWOcn Responsibilities:- Design, develop, and maintain data pipelines.- Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver high-quality data solutions.- Optimize data workflows for performance and scalability within the Azure environment.- Ensure data quality, ...

... https://jobeax.com/link/OBSYxKmspgkYWOcn Responsibilities:- Design, develop, and maintain data pipelines.- Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver high-quality data solutions.- Optimize data workflows for performance and scalability within the Azure environment.- Ensure data quality, ...

Rs 22 - 30 lakhs p.a.

... documentation carrying the quality bar between reviews. Stack: Python, PostgreSQL, Django, server-rendered frontend (htmx). What You Will Own Core Responsibilities / Engineering Focus Deep third-party data ingestion Build reliable ingestion pipelines for external data sources Account for silently dropped webhooks through reconciliation ...

• Full-time

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. https://jobeax.com/link/6WcBICn0LM558SP0 ...

... you will work alongside senior engineers to build, optimise, and maintain data pipelines, write efficient SQL queries, and utilise AWS cloud services to enable data processing and analytics across the organisation. Key Responsibilities Assist in developing, testing, and maintaining scalable ETL/ELT data pipelines. Write, ...

... technical solutions and maintain comprehensive documentation Essential Technical Skills - Data Engineering: Strong foundation in data engineering principles, ETL/ELT processes, and data pipeline design patterns - PySpark: Proven hands-on experience developing data pipelines using PySpark, including DataFrames API, Spark ...

... Docker, Cloud-Native Infrastructure, CI/CD pipelines. Industry Context: Data engineering experience in Banking Risk, Retail Products, Cards, Mortgage, Deposits, or Wealth Management. Assumed Requirements / Certifications: Databricks Certified Data Engineer, AWS Certified Data Analytics, or Azure Data Engineer Associate.

Data Engineer – Python & Pyspark (AWS) Exp: 6+ yrs Location : Chennai Client Place Guindy Work Mode : All 5 days Role Overview We're seeking a Senior Data Engineer with strong hands-on expertise in Python, PySpark, and AWS to design, build, and operate scalable data pipelines for analytics and operational workloads. You ...

• Remote
• Contract

$ 62400 p.a.

... large-scale data processing, Python development, distributed systems, databases, data quality, and governance. What You’ll Do - Design, build, and maintain scalable data pipelines and architectures for large-scale data environments. - Translate business and technical requirements into reliable data engineering solutions. - Develop ...

• Remote
• Contract

$ 62400 p.a.

... large-scale data processing, Python development, distributed systems, databases, data quality, and governance. What You’ll Do - Design, build, and maintain scalable data pipelines and architectures for large-scale data environments. - Translate business and technical requirements into reliable data engineering solutions. - Develop ...

• Hybrid

... Programming: Python, SQL Data Processing: Dataflow, Apache Beam, Dataproc, Spark/PySpark Orchestration: Cloud Composer, Apache Airflow Transformation: Dataform, dbt Engineering: Git, CI/CD, Automated Testing, Monitoring Data Engineering: ETL/ELT, Batch Processing, Data Modelling, Data Quality, Data Contracts, Metadata & Lineage ...

• Remote
• Contract

... Strong SQL and Python programming skills. Experience with ETL/ELT pipeline development. Familiarity with cloud platforms like AWS, Azure, or GCP. Knowledge of data engineering best practices and scalable architectures. Experience with Apache Spark or PySpark. Knowledge of Docker, Kubernetes, and CI/CD pipelines. Experience ...

... (CI/CD).Qualifications:- Platforms: Microsoft Fabric (Mandatory), Azure Data Factory, Azure Synapse Analytics, ADLS Gen2.- Languages: Python (PySpark), SQL, Spark SQL.- Data Processing: Delta Lake (ACID transactions, schema evolution), ETL/ELT pipelines, Medallion Architecture (Bronze/Silver/Gold).- Reporting: Power BI (DAX, Power ...