As a data engineering lead, you will be the key technical expert overseeing PepsiCo's data product build & operations and drive a strong vision for how data engineering can proactively create a positive impact on the business. You'll be empowered to create & lead a strong team of data engineers who build data pipelines into various source systems, rest data on the PepsiCo Data Lake, and enable exploration and access for analytics, visualization, machine learning, and product development efforts across the company. As a member of the data engineering team, you will help lead the development of very large and complex data applications into public cloud environments directly impacting the design, architecture, and implementation of PepsiCo's flagship data products around topics like revenue management, supply chain, manufacturing, and logistics. You will work closely with process owners, product owners and business users. You'll be working in a hybrid environment with in-house, on-premises data sources as well as cloud and remote systems.
Responsibilities
Manage a team of data engineers and data analysts by delegating project responsibilities and managing their flow of work as well as empowering them to realize their full potential.
Design, structure and store data into unified data models and link them together to make the data reusable for downstream products.
Manage and scale data pipelines from internal and external data sources to support new product launches and drive data quality across data products.
Create reusable AI enabled accelerators and solutions to automate L3 incident resolution and triage for business critical applications to drive productivity gains
Enable and accelerate standards-based development prioritizing reuse of code, adopt test-driven development, unit testing and test automation with end-to-end observability of data
Build and own the automation and monitoring frameworks that captures metrics and operational KPIs for data pipeline quality, performance and cost.
Collaborate with internal clients (product teams, sector leads, data science teams) and external partners (SI partners/data providers) to drive solutioning and clarify solution requirements.
Evolve the architectural capabilities and maturity of the data platform by engaging with enterprise architects to build and support the right domain architecture for each application following well-architected design standards.
Define and manage SLA’s for data products and processes running in production.
Qualifications
10+ years of overall technology experience that includes at least 5+ years of hands-on software development, data engineering, and systems architecture.
8+ years of experience with Data Lakehouse, Data Warehousing, and Data Analytics tools.
6+ years of experience in data modelling using specialized modelling tools such as CA Erwin
4+ years of experience in Python/Pyspark/Scala programming on big data platforms like Databricks
4+ years in cloud data engineering experience in Azure or AWS.
Fluent with Azure cloud services. Azure Data Engineering certification is a plus.
Experience with at least one business intelligence tool such as Power BI or Tableau
Domain Knowledge of CPG industry with Supply chain/GTM background is preferred.
Overview As a data engineering lead, you will be the key technical expert overseeing PepsiCo's data product build & operations and drive a strong vision for how data engineering can proactively create a positive impact on the business. You'll be empowered to create & lead a strong team of data engineers who build data pipelines ...
... their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity. Responsibilities Atlassian is looking for a Principal Data Engineer to join our Data Engineering Team and play a tech lead & architect role to build world-class data solutions and applications that power crucial ...
Voyager (94001), India, Bangalore, Karnātaka Principal Associate - Data Engineer At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. ...
... consumption. Operating at the intersection of Analytics, Data Engineering, Data Science, Governance, and AI Platform Engineering, this role ensures that enterprise data, metrics, models, and knowledge assets can be reliably discovered, understood, deployed, monitored, and reused. The Principal AI & Semantic Engineer provides ...
Mid-level data science role at Marsh McLennan in Pune. Needs 4+ years and a https://jobeax.com/link/2DENLGgQM7whDhaE, B.E. or B.Sc. Hybrid. What you'll do - Build and maintain complex data pipelines through various data systems to drive optimization and implement business strategies - Deploy API on the platform by understanding ...
Leadership data science role at Amgen in Hyderabad. Needs 12–17 years and a https://jobeax.com/link/2DENLGgQM7whDhaE, B.E. or B.Sc. What you'll do - Design, build, and maintain data ingestion and ETL/ELT pipelines using Python, SQL, Databricks, and Spark/PySpark - Integrate data from APIs, databases, files, and third-party ...
... requirements. Key Accountabilities: - Ensure meet the business expectations in terms of On time delivery (OTD) Cost and quality outputs. - Support Sales / BDMs / Junior engineers about engineering process & products. - Make sure error free quotation preparation, Clean & Clear order handover to execution team. - Responsible timely ...
... the team's delivery. Data Engineering and Platform Capabilities - Bring enough familiarity with modern data-platform patterns to collaborate effectively with data engineering teams - including Airflow, Glue/Spark, Kafka/MSK, and Lakehouse oriented architectures. - Apply platform engineering skills such as API design, service ...
... across digital and offline media https://jobeax.com/link/xN2Wix3DU1kEdKuU will work closely with Product, Engineering, and Business teams to translate complex data into actionable https://jobeax.com/link/c6rRUVKMFHSGnytv You Will Do :Lead & Build :- Lead, mentor, and scale a high-performing team of data scientists.- Set ...
... strategic planning skills WHAT YOU’LL WORK ON As a Principal Software Engineer, you will play a crucial role in architecting, modernizing, and leading the optimized data platforms. - Influence enterprise technology strategy and architecture decisions. - Drive innovation and adoption of modern data engineering practices. - Lead ...