Back to list

Vacancy description

Senior Data Engineer - ETL Pipelines in Pune, भारत

Intraedge Technologies Ltd.

Pune, भारत

About the Role:We are looking for an experienced Senior Data Engineer with strong expertise in designing, developing, and optimizing enterprise-scale ETL/ELT pipelines and data integration https://jobeax.com/link/XnflZD2dGSZYgXFG Responsibilities:- Design, develop, and maintain scalable ETL/ELT pipelines for extracting, transforming, and loading data from multiple source systems.- Build robust data ingestion and integration frameworks to process structured and unstructured data.- Develop and optimize complex SQL queries, stored procedures, and data transformation logic.- Design and manage automated data workflows using Apache Airflow.- Implement batch and incremental data processing solutions to handle large volumes of enterprise data.- Develop and maintain data models, data warehouses, and data processing frameworks.- Monitor pipeline execution, troubleshoot failures, and optimize performance and resource utilization.- Implement data validation, reconciliation, and quality checks to ensure accuracy and consistency.- Collaborate with data architects, analysts, business stakeholders, and engineering teams to understand data requirements.- Establish best practices for data pipeline development, code quality, documentation, and deployment.- Support production data pipelines, resolve technical issues, and perform root cause analysis.- Provide technical guidance and mentorship to junior data https://jobeax.com/link/bPKH86SZzX87taAc Skills & Qualifications:- 10 - 12 years of experience in Data Engineering, ETL Development, or Data Integration.- Strong hands-on experience designing and developing enterprise-scale ETL/ELT pipelines.- Advanced proficiency in SQL, including complex queries, joins, stored procedures, and query optimization.- Strong experience with Apache Airflow for workflow orchestration, scheduling, and pipeline monitoring.- Experience building data ingestion, transformation, and processing frameworks.- Strong understanding of data warehousing concepts, dimensional modelling, and database architecture.- Experience handling large datasets and complex data transformations.- Knowledge of batch processing, incremental data loading, and data integration patterns.- Experience with data quality, validation, reconciliation, and pipeline monitoring.- Familiarity with version control systems such as Git and software development best practices.- Strong analytical, troubleshooting, and problem-solving https://jobeax.com/link/HtEkNW75s0ExbvB1 to Have:- Programming experience in Python or PySpark.- Exposure to cloud-based data platforms such as AWS, Azure, or GCP.- Familiarity with Snowflake, Databricks, Redshift, or similar data warehouse platforms.- Experience with DBT or other data transformation frameworks.- Knowledge of big data technologies such as Apache Spark and Hadoop.- Experience implementing CI/CD practices for data engineering https://jobeax.com/link/UZaKzhyrvMYcq1yl Candidate Profile:- Strong technical ownership of end-to-end data engineering solutions.- Ability to work with cross-functional teams and translate business requirements into technical solutions.- Experience reviewing code, defining engineering standards, and mentoring team members.- Strong communication and stakeholder coordination skills. (ref:hirist.tech)

Similar vacancies

More like this role

... Skills :- Data Engineering, AI-Augmented Development, Python, SQL, ETL, ELT, Apache Airflow, Snowflake, dbt, Databricks, Apache Spark, PySpark, Data Pipelines, Data Modelling, Data Warehousing, Data Integration, REST APIs, Kafka, AWS, Azure, BigQuery, Git, CI/CD, GitHub Copilot, Cursor, Claude Code, Data Quality, Data Governance ...

Chennai, भारत

TekPioneers - A TekGence Company

Senior Python Engineer - Data Pipelines - Hybrid

  • Hybrid
  • Full-time
... Seeking a hands-on senior Python engineer to own data pipelines end to end (ingestion, transformation, orchestration, quality, and delivery) at enterprise scale. Pipelines feed analytics, search, and GenAI/Agentic AI platforms. Responsibilities - Design, build, and own production data pipelines in Python (batch and near-real-time). ...

Hyderabad, भारत

  • Full-time
... Cognite accelerates the digital transformation to drive operational https://jobeax.com/link/bHXj5wfzWbVlakbW you'll demonstrate Ownership : We're looking for a Senior Data Engineer who is ready to tackle big challenges and advance their career. You'll join a dynamic team committed to creating cutting-edge solutions that significantly ...

Bangalore, भारत

  • Full-time
  • IT
  • QA
The ETL/Data QA Engineer will be responsible for ensuring the accuracy, reliability, and quality of data processed through the organisation's data warehousing and integration platforms. Operating within established testing and governance frameworks, the engineer will validate ETL processes, conduct detailed source-to-target ...

Pune, भारत

  • Full-time
... role at Worley in Bengaluru. Needs 10+ years and a https://jobeax.com/link/2DENLGgQM7whDhaE or B.E.. What you'll do - Perform design activities for offshore pipelines in all phases of the project (from concept design to execution phase) in collaboration within the pipeline team across… - Assist Line Manager/ Lead Engineer ...

Bangalore, भारत

  • Full-time
... and AI-enabled delivery, we support customers in navigating complexity as they meet today's needs and transition to more sustainable solutions. The Role As a Senior Marine Pipelines Engineer with Worley, you will work closely with our existing team to deliver projects for our clients while continuing to develop your skills ...

Bangalore, भारत

Job Summary : We are looking for an experienced Senior Data Engineer to design, develop and maintain scalable data pipelines, data platforms and cloud-based data infrastructure. The ideal candidate should have strong expertise in data engineering, ETL/ELT processes, big data technologies, cloud platforms and data https://jobeax.com/link/17NlwZ4oSJJaCzVO ...

Calcutta, भारत

  • Hybrid
  • On-site
  • Full-time
  • Product Management
  • Backend
  • Oil & Gas
... https://jobeax.com/link/awICxNUvBQVTSW0s / Recruiter Search Keywords : Senior Data Engineer, Data Engineer, Global Data Engineer, Python Developer, SQL Developer, ETL Developer, ELT Developer, Snowflake Developer, Redshift, BigQuery, Data Pipeline Engineer, Data Integration Engineer, Cloud Data Engineer, Data Warehouse Engineer, ...

Gurgaon, भारत

... experience- Database Testing- ETL Tools experience (DataStage, Informatica, Data Warehouse tools, or similar)- Data Validation and Reconciliation- Reporting and Data Analysis experience- Experience validating data by executing SQL queries- Data Migration Testing- PostgreSQL Database experienceGood to have:- Insurance domain ...

Hyderabad, भारत

... experience- Database Testing- ETL Tools experience (DataStage, Informatica, Data Warehouse tools, or similar)- Data Validation and Reconciliation- Reporting and Data Analysis experience- Experience validating data by executing SQL queries- Data Migration Testing- PostgreSQL Database experienceGood to have:- Insurance domain ...

Chennai, भारत