Data Engineering Lead - ETL Pipelines in Bombay, India - Jobeax
Vacancy description
Data Engineering Lead - ETL Pipelines in Bombay, भारत
Savishty
Bombay, भारत
About the Role : We are looking for an experienced Data Engineering Lead to lead the data engineering track for a large-scale analytics platform supporting a major Oil & Gas https://jobeax.com/link/c386j5jUh3HKxNPb Technologies : - AWS Glue, AWS Lambda- Amazon Redshift, Aurora PostgreSQL- MSK Kafka, AWS SQS, AWS Transfer Family- Apache Airflow- SQL, PythonKey Responsibilities : - Lead a team of 3 Data Engineers.- Manage and enhance large-scale data assets and ETL pipelines.- Drive ETL performance, monitoring and optimization.- Handle production incidents and P1 issues as part of a 24x7 rotation.- Deliver enhancements within defined SLAs.- Collaborate with business and technical stakeholders.- Create and maintain runbooks and technical https://jobeax.com/link/vWEeQZKa3QDI2wJO : - 8+ years of experience in Data Engineering with leadership experience.- Strong expertise in AWS Glue, Redshift and Aurora.- Strong SQL and Python skills.- Experience managing production data pipelines at scale.- Willingness to work from the Mumbai client site as required.- Comfortable with weekend/night on-call https://jobeax.com/link/KOEGlAfOi9YwpfCT to Have : - Experience in the Oil & Gas domain.- Experience working on large-scale enterprise analytics platforms. (ref:hirist.tech)
... Science, Engineering, Data Science or a related field.- 10+ years of hands-on experience in data engineering, with at least 5 years in a people management role leading data platform or data infrastructure teams.- Deep expertise in data warehousing, data modeling (dimensional and Data Vault), ETL/ELT design and big data technologies.- ...
... hands-on expertise in Databricks, Microsoft Fabric and Azure Data https://jobeax.com/link/1qeQjISgyJor6MhL Overview :We are looking for an experienced Data Engineering Modernization Architect to lead the transformation of legacy data platforms, ETL pipelines, and data warehouses into modern, scalable, cloud-native data https://jobeax.com/link/UuxHBYkbQjke5gQz ...
... entities, relationships, and data flows.- Establish the central data platform as the source of truth for lead, applicant, student, enrollment, and operational data.- Design and maintain scalable relational and NoSQL database architectures.- Build and maintain ETL/ELT pipelines required for operational and reporting use cases.- ...
Job Summary :Lead Azure Data Engineer with 5+ years of experience in designing and building scalable data lakes, data warehouses, and ETL pipelines using Azure Data Factory, Azure Databricks, SQL, and https://jobeax.com/link/Vk2Ax4dKU3remBk1 :- Develop, implement, and maintain the information data lake and use insight platforms ...
Job Summary :Lead Azure Data Engineer with 5+ years of experience in designing and building scalable data lakes, data warehouses, and ETL pipelines using Azure Data Factory, Azure Databricks, SQL, and https://jobeax.com/link/Vk2Ax4dKU3remBk1 :- Develop, implement, and maintain the information data lake and use insight platforms ...
... platforms from design through production deployment - Conduct technical discussions and design reviews with delivery partners and stakeholders - Implement and oversee ETL/ELT pipelines, data lakes, lakehouses, and BI integrations - Mentor data engineers and analysts on engineering standards and best practices - Ensure solutions ...
... Databricks Engineer with strong expertise in Azure Databricks, PySpark, Python, SQL, Azure Data Factory (ADF), and Delta Lake to develop and optimize scalable data engineering https://jobeax.com/link/XnflZD2dGSZYgXFG Responsibilities : - Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, Python, ...
... orchestration.- Knowledge of data governance, lineage, and data quality frameworks.- Experience in banking, lending, credit risk, or financial services.- Experience leading data engineering or BI development https://jobeax.com/link/AoKAwxM6ihwDamXV : - Advanced prompt engineering experience.- Exposure to AI/ML data pipelines and ...
... Good understanding of data validation, reconciliation, and data quality checks. - Working knowledge of Unix/Linux commands. - Experience working with relational databases such as Oracle, SQL Server, PostgreSQL, MySQL, or Teradata. Preferred Skills - Exposure to ETL tools such as Informatica, DataStage, Talend, SSIS, Ab Initio, ...
... and platform teams. - Professional data-engineering or data-platform experience. - Strong SQL and programming capability, preferably Python. - Experience with ETL/ELT, data warehousing, testing and cloud data services. - Senior and managerial roles require technical leadership and mentoring capability. Required Qualifications ...