Data Engineering Lead - ETL Pipelines in Bombay, India - Jobeax
Vacancy description
Data Engineering Lead - ETL Pipelines in Bombay, भारत
Savishty
Bombay, भारत
About the Role : We are looking for an experienced Data Engineering Lead to lead the data engineering track for a large-scale analytics platform supporting a major Oil & Gas https://jobeax.com/link/c386j5jUh3HKxNPb Technologies : - AWS Glue, AWS Lambda- Amazon Redshift, Aurora PostgreSQL- MSK Kafka, AWS SQS, AWS Transfer Family- Apache Airflow- SQL, PythonKey Responsibilities : - Lead a team of 3 Data Engineers.- Manage and enhance large-scale data assets and ETL pipelines.- Drive ETL performance, monitoring and optimization.- Handle production incidents and P1 issues as part of a 24x7 rotation.- Deliver enhancements within defined SLAs.- Collaborate with business and technical stakeholders.- Create and maintain runbooks and technical https://jobeax.com/link/vWEeQZKa3QDI2wJO : - 8+ years of experience in Data Engineering with leadership experience.- Strong expertise in AWS Glue, Redshift and Aurora.- Strong SQL and Python skills.- Experience managing production data pipelines at scale.- Willingness to work from the Mumbai client site as required.- Comfortable with weekend/night on-call https://jobeax.com/link/KOEGlAfOi9YwpfCT to Have : - Experience in the Oil & Gas domain.- Experience working on large-scale enterprise analytics platforms. (ref:hirist.tech)
... with an emphasis on code/system architecture and quality output- Experience designing and building data pipelines, data APIs, and ETL/ELT processes- Exposure to data modeling and data warehouse concepts- Hands-on experience in Python- Hands-on experience setting up, configuring, and maintaining SQL and no-SQL databases (MySQL/MariaDB, ...
... service https://jobeax.com/link/IsKeQIMhWwWxywXv Responsibilities : - Design and implement end-to-end ETL/ELT pipelines to ingest, process, and store massive datasets, ensuring seamless data flow for downstream analytics and machine learning applications.- Optimize data warehouse performance and data modeling strategies ...
Key Responsibilities :- Design, develop, and maintain scalable ETL pipelines using PySpark.- Build robust data ingestion frameworks for processing data from multiple source systems.- Develop efficient batch and near real-time data processing workflows.- Perform data extraction, transformation, cleansing, validation, and ...
... Science, Engineering, Data Science or a related field.- 10+ years of hands-on experience in data engineering, with at least 5 years in a people management role leading data platform or data infrastructure teams.- Deep expertise in data warehousing, data modeling (dimensional and Data Vault), ETL/ELT design and big data technologies.- ...
Job Summary :Lead Azure Data Engineer with 5+ years of experience in designing and building scalable data lakes, data warehouses, and ETL pipelines using Azure Data Factory, Azure Databricks, SQL, and https://jobeax.com/link/Vk2Ax4dKU3remBk1 :- Develop, implement, and maintain the information data lake and use insight platforms ...
... platforms from design through production deployment - Conduct technical discussions and design reviews with delivery partners and stakeholders - Implement and oversee ETL/ELT pipelines, data lakes, lakehouses, and BI integrations - Mentor data engineers and analysts on engineering standards and best practices - Ensure solutions ...
... ecosystems.- Design and optimize large-scale batch and streaming data pipelines integrating data from multiple internal and external sources.- Establish reusable data engineering frameworks, standards, design patterns, and best practices across projects.- Lead the development of cloud-based data platforms leveraging AWS services ...
... orchestration.- Knowledge of data governance, lineage, and data quality frameworks.- Experience in banking, lending, credit risk, or financial services.- Experience leading data engineering or BI development https://jobeax.com/link/AoKAwxM6ihwDamXV : - Advanced prompt engineering experience.- Exposure to AI/ML data pipelines and ...
... Good understanding of data validation, reconciliation, and data quality checks. - Working knowledge of Unix/Linux commands. - Experience working with relational databases such as Oracle, SQL Server, PostgreSQL, MySQL, or Teradata. Preferred Skills - Exposure to ETL tools such as Informatica, DataStage, Talend, SSIS, Ab Initio, ...
... and platform teams. - Professional data-engineering or data-platform experience. - Strong SQL and programming capability, preferably Python. - Experience with ETL/ELT, data warehousing, testing and cloud data services. - Senior and managerial roles require technical leadership and mentoring capability. Required Qualifications ...