Data Engineering Lead - ETL Pipelines in Bombay, India - Jobeax
Vacancy description
Data Engineering Lead - ETL Pipelines in Bombay, भारत
Savishty
Bombay, भारत
About the Role : We are looking for an experienced Data Engineering Lead to lead the data engineering track for a large-scale analytics platform supporting a major Oil & Gas https://jobeax.com/link/c386j5jUh3HKxNPb Technologies : - AWS Glue, AWS Lambda- Amazon Redshift, Aurora PostgreSQL- MSK Kafka, AWS SQS, AWS Transfer Family- Apache Airflow- SQL, PythonKey Responsibilities : - Lead a team of 3 Data Engineers.- Manage and enhance large-scale data assets and ETL pipelines.- Drive ETL performance, monitoring and optimization.- Handle production incidents and P1 issues as part of a 24x7 rotation.- Deliver enhancements within defined SLAs.- Collaborate with business and technical stakeholders.- Create and maintain runbooks and technical https://jobeax.com/link/vWEeQZKa3QDI2wJO : - 8+ years of experience in Data Engineering with leadership experience.- Strong expertise in AWS Glue, Redshift and Aurora.- Strong SQL and Python skills.- Experience managing production data pipelines at scale.- Willingness to work from the Mumbai client site as required.- Comfortable with weekend/night on-call https://jobeax.com/link/KOEGlAfOi9YwpfCT to Have : - Experience in the Oil & Gas domain.- Experience working on large-scale enterprise analytics platforms. (ref:hirist.tech)
... service https://jobeax.com/link/IsKeQIMhWwWxywXv Responsibilities : - Design and implement end-to-end ETL/ELT pipelines to ingest, process, and store massive datasets, ensuring seamless data flow for downstream analytics and machine learning applications.- Optimize data warehouse performance and data modeling strategies ...
Key Responsibilities :- Design, develop, and maintain scalable ETL pipelines using PySpark.- Build robust data ingestion frameworks for processing data from multiple source systems.- Develop efficient batch and near real-time data processing workflows.- Perform data extraction, transformation, cleansing, validation, and ...
... Science, Engineering, Data Science or a related field.- 10+ years of hands-on experience in data engineering, with at least 5 years in a people management role leading data platform or data infrastructure teams.- Deep expertise in data warehousing, data modeling (dimensional and Data Vault), ETL/ELT design and big data technologies.- ...
... hands-on expertise in Databricks, Microsoft Fabric and Azure Data https://jobeax.com/link/1qeQjISgyJor6MhL Overview :We are looking for an experienced Data Engineering Modernization Architect to lead the transformation of legacy data platforms, ETL pipelines, and data warehouses into modern, scalable, cloud-native data https://jobeax.com/link/UuxHBYkbQjke5gQz ...
Job Summary :Lead Azure Data Engineer with 5+ years of experience in designing and building scalable data lakes, data warehouses, and ETL pipelines using Azure Data Factory, Azure Databricks, SQL, and https://jobeax.com/link/Vk2Ax4dKU3remBk1 :- Develop, implement, and maintain the information data lake and use insight platforms ...
Job Summary :Lead Azure Data Engineer with 5+ years of experience in designing and building scalable data lakes, data warehouses, and ETL pipelines using Azure Data Factory, Azure Databricks, SQL, and https://jobeax.com/link/Vk2Ax4dKU3remBk1 :- Develop, implement, and maintain the information data lake and use insight platforms ...
... platforms from design through production deployment - Conduct technical discussions and design reviews with delivery partners and stakeholders - Implement and oversee ETL/ELT pipelines, data lakes, lakehouses, and BI integrations - Mentor data engineers and analysts on engineering standards and best practices - Ensure solutions ...
... Databricks Engineer with strong expertise in Azure Databricks, PySpark, Python, SQL, Azure Data Factory (ADF), and Delta Lake to develop and optimize scalable data engineering https://jobeax.com/link/XnflZD2dGSZYgXFG Responsibilities : - Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, Python, ...
... ecosystems.- Design and optimize large-scale batch and streaming data pipelines integrating data from multiple internal and external sources.- Establish reusable data engineering frameworks, standards, design patterns, and best practices across projects.- Lead the development of cloud-based data platforms leveraging AWS services ...
... orchestration.- Knowledge of data governance, lineage, and data quality frameworks.- Experience in banking, lending, credit risk, or financial services.- Experience leading data engineering or BI development https://jobeax.com/link/AoKAwxM6ihwDamXV : - Advanced prompt engineering experience.- Exposure to AI/ML data pipelines and ...