Vacancy description
India, Bengaluru
Data Engineering Lead - ETL Workflows in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
Role : Lead Data EngineerResponsibilities :- Design and build scalable, reliable data pipelines and ETL/ELT workflows across batch and near-real-time processing scenarios.- Develop and maintain data models across relational (SQL Server) and NoSQL (MongoDB, Atlas) systems to support analytical and operational use cases.- Build and manage data solutions on Microsoft Fabric including Lakehouses, Warehouses, Dataflows, and Pipelines to deliver a unified analytics platform.- Drive AI-enabled development practices within the team leveraging AI coding assistants, LLM-based tools, and intelligent automation to accelerate pipeline development, improve code quality, and reduce manual effort.- Lead, mentor, and grow a team of data engineers; conduct code reviews, provide technical guidance, and support career development.- Collaborate with stakeholders, product owners, data scientists, and analysts to understand data needs and translate them into engineering solutions.- Build and maintain Power BI data models, semantic layers, and datasets to support self-service analytics and business reporting.- Continuously identify opportunities to optimize pipeline performance, reduce costs, and improve data reliability and quality.- Adhere to and enforce data engineering standards, data security, and governance practices across the https://jobeax.com/link/1dkmzToQOwmnlB8O Skills and Experience :- 8 to 10 years of experience in data engineering with a strong track record of delivering production-grade data solutions.- Strong proficiency in Python (PySpark, Pandas) and SQL for data transformation, pipeline development, and performance tuning.- Proficient with Microsoft Fabric including Lakehouses, Warehouses, Dataflows Gen2, and Data Pipelines.- Strong experience with SQL Server including schema design, stored procedures, indexing, and query optimization.- Experience with MongoDB and MongoDB Atlas for NoSQL data modeling, indexing, aggregation pipelines, and Atlas Search.- Solid experience designing and operating ETL/ELT pipelines in production, including error handling, monitoring, and SLA management.- Experience with Power BI including dataset design, DAX, semantic modeling, and enabling self-service reporting.- Strong exposure to AI-enabled development using AI coding assistants, prompt-driven development, or LLM-integrated tooling to build and accelerate data engineering workflows.- Experience leading or managing a small team of engineers task allocation, mentoring, and performance support.- Good understanding of data modeling concepts dimensional modeling, star/snowflake schemas, data vault.- Ability to communicate technical ideas clearly to both technical and non-technical https://jobeax.com/link/DwqtncDiGCX6AF3o to Have Qualities & Skills :- Hands-on experience with Databricks including Delta Lake, notebooks, jobs, clusters, and Unity Catalog.- Exposure to cloud data services on Azure (preferred), GCP, or AWS.- Experience with streaming and event-driven architectures using Apache Kafka, Azure Event Hubs, Azure Service Bus, or similar queue/messaging technologies.- Exposure to .NET for building data-adjacent services or APIs.- Familiarity with data governance, data cataloging, and data lineage tooling.- Exposure to MLOps or supporting ML pipeline infrastructure.- Exposure to Mortgage or Real Estate domain. (ref:hirist.tech)
Similar vacancies
consultancy
... https://jobeax.com/link/fYGlpInxuIv5PeS1 & Skills :- 4 - 7 years in data engineering: SQL, Python, ETL/ELT orchestration.- Cloud data platform experience (Azure preferred): pipelines, storage, APIs.- Strong understanding of data lake and data architecture.- Data modelling for analytics (star schema) and data quality frameworks. (ref:hirist.tech)
India, Mumbai
A client of People Impact
... validation, batch pipelines, reconciliation, production support, and audit-ready https://jobeax.com/link/0tczEVIPDdr4h8mr Have :- Strong experience developing data integration, ETL/ELT, batch processing, and scheduled data delivery solutions.- Proficiency in SQL and experience working with enterprise data sources, file-based ...
India, Bengaluru
calfus inc.
... empowering the organization to make reliable, governed, data-driven decisions. Data Platform Architecture: Design and own end-to-end data pipeline architecture — ETL/ELT, orchestration, and data modeling — across cloud-native platforms (Azure Databricks, Azure Data Factory, and/or Snowflake). Lakehouse Engineering: Architect ...
India, Bengaluru
novus hi-tech
I. Hiring specifications Job Purpose: OEM Engineering Lead will be responsible to drive the development and integration of Advanced Driver Assistance Systems (ADAS) products. This role requires deep technical expertise in ADAS technologies, system integration, and OEM collaboration. The ideal candidate will act as the technical ...
India, Gurugram
Larsen & Toubro
$30 USD
Business Unit: EPS Mobility We are seeking a seasoned engineering leader to own end to end design and industrialization of traction motors and related sub-systems (e.g., This role combines deep product design expertise with manufacturing, supply chain, operations, quality, and safety leadership to deliver robust, cost effective, ...
India, Bengaluru
Aurigo Software Technologies
40k
... You will be responsible for analysing the requirements, designing and developing software that is going to solve real world customer problems. You will have to lead and mentor your team members. You will be working on enhancing our award-winning flagship product suite Aurigo Masterworks. We are looking for energetic, self-driven, ...
India, Bengaluru
Publicis Sapient
20k
Manager – Data Engineering Publicis Sapient is seeking a Manager – Data Engineering to join our high-performing engineering team. In this role, you will lead the design and delivery of scalable, cloud native data engineering solutions, partnering with clients and cross-functional teams to solve complex business challenges. ...
India, Bengaluru
... for a data professional to join our Data Engineering team. Independently execute data engineering projects Undertake processing of structured and unstructured data Development of data processing codes for automation & building scalable solutions Develop and maintain data solutions for clients / projects Communicate and interact ...
India, Bengaluru
Rs 7.5 - 34.5 lakhs p.a.
Data Engineer: PySpark+AWS Glue 4-8 years in Data Engineering with hands-on expertise in Snowflake, AWS Glue, AWS (S3/Lambda/CloudWatch), Python, PySpark, and SQL. Strong experience in ETL/ELT, Data Warehousing, Data Pipelines, Performance Tuning, and Cloud Data Platforms. Exposure to AI/ML or GenAI solutions is a plus ...
India, Bengaluru
... Python, PySpark, SAP Datasphere, Power BI, SSIS or other cloud-based data systems Advanced experience with Azure DevOps, GitHub, CI/CD Advanced experience with database storage systems such as cloud, relational, mainframe, data lake, and data warehouse Advanced experience building cloud ETL pipelines using code or ETL platforms ...
India, Bengaluru
HiringBlaze
Role : Data Engineering Manager (E-commerce & AI-First Platform)Location : Bangalore, India Experience : 7 -10+ Years Role Overview : We are seeking a high-impact Data Engineering Manager to lead the end-to-end data foundation for a fast-scaling global e-commerce and marketplace operator. This is a strategic leadership ...
India, Bengaluru
Happiest Minds Technologies Limited
... continuous improvement.- Establish appropriate model monitoring and performance measurement frameworks.4. Business & Stakeholder Management:- Partner with product, engineering, business, and leadership teams to identify and prioritize data science use cases.- Translate complex analytical findings into actionable business recommendations.- ...
India, Bengaluru
... schedule, and monitor ETL/ELT pipelines using Apache Airflow. Programming: Proficiency in Python or Java for data processing, automation, and pipeline development. ETL & Data Integration: Designing and implementing end-to-end ETL/ELT workflows for structured and unstructured data. Database Management: Strong command of SQL; ...
India, Mannady
... JavaScript engineer that has a deep understanding of both backend service engineering and user interface development. In this role, you will be a vital part of our Workflows Integrated Development Environment team. You will share our passion and great pride in building elegant solutions and will join an engineering team that prioritizes ...
India, Bengaluru
Accenture
... integration within project workflows. Must To Have Skills: Proficiency in Talend ETL, Snowflake Data Warehouse. Strong experience in designing and implementing data integration workflows using Talend ETL tools. In-depth knowledge of data warehousing concepts and best practices, particularly with Snowflake Data Warehouse. ...
India, Rāniganj
NexionPro
... Overview :We are looking for a proactive Data Support Engineer to join our data engineering team. The role involves supporting, monitoring, and troubleshooting data pipelines and ETL processes, ensuring data reliability and smooth operations across Snowflake-based data https://jobeax.com/link/tlplQAnK5B36KMXq Responsibilities ...
India, Hyderabad
Mastercard
... Leverage new technologies and approaches to innovate with increasingly large data sets. Drive automation and efficiency in Data ingestion, data movement and data access workflows by innovation and collaboration. Understand, implement and enforce Software development standards and engineering principles in the Big Data ...
India, Pune
wowJobs
... data pipelines and ETL workflows on AWS.- Develop efficient data processing solutions using python and pySpark.- Write complex and optimized SQL queries for data extraction, transformation, and analysis.- Build and manage ETL pipelines using AWS Glue.- Work with AWS Glue Data Catalog for metadata management and data discovery.- ...
India, Pune
momentive software
20k
... the standards and guidelines set by the architects and leadership teams and must demonstrate quality, brevity, and timeliness in all deliverables. Technical lead have to raise the team's adoption of AI-driven engineering practices, and use AI strategically for delivery planning, risk assessment, and productivity gains. ...
India, Pune
Smart Analytica
... Impala, Spark, Kafka, Kudu, and related components. ETL Integration and Optimization: Oversee design, performance tuning, and operationalization of Informatica workflows and integrations with CDP. Migration Execution: Lead migrations from legacy platforms (for example Greenplum) to CDP, including cutover planning, data validation, ...
India, Mumbai