Back to list

Vacancy description

Manager - Python/Data Engineering in Bangalore, भारत

Publicis Sapient

Bangalore, भारत

ROLE SUMMARY : We are looking for a hands-on Data Engineering Manager with strong expertise in Python, PySpark, SQL, and Apache Airflow. The role will lead a team of approximately 8 - 12 engineers, own delivery of scalable data platforms and pipelines, provide technical direction, and remain hands-on across architecture, development, performance optimization, data quality, and production https://jobeax.com/link/nyvIPyp1073tShWe RESPONSIBILITIES : - Lead the architecture, design, and delivery of scalable batch and near-real-time data pipelines using Python and PySpark.- Provide technical direction for Apache Airflow orchestration, including DAG standards, scheduling, dependencies, monitoring, retries, and recovery.- Guide development of optimized SQL for ingestion, transformation, reconciliation, controls, and analytical workloads.- Manage and mentor 8 - 12 data engineers while remaining hands-on with design reviews, code reviews, debugging, and complex problem solving.- Own delivery planning, estimation, execution, quality, risks, dependencies, release readiness, and production stability.- Drive data-quality controls, lineage, observability, security, auditability, and operational support standards.- Optimize Spark jobs, SQL queries, partitioning, caching, joins, resource utilization, cloud performance, and cost.- Partner with Product Owners, Architects, Governance, DevOps, QA, and client stakeholders to deliver measurable business https://jobeax.com/link/LwZvMEPWKoFQhpAM SKILLS : - 10+ years of data or software engineering experience, including proven technical, delivery, and people leadership.- Strong hands-on Python with OOP, modular architecture, testing, exception handling, and reusable framework development.- Deep PySpark expertise across DataFrames, Spark SQL, distributed processing, partitioning, joins, caching, and performance tuning.- Advanced SQL including CTEs, window functions, complex joins, validation, reconciliation, data modelling, and query optimization.- Strong Apache Airflow expertise covering DAG architecture, operators, sensors, dependencies, scheduling, monitoring, and troubleshooting.- Experience with relational databases, data lakes or warehouses, Parquet, schema evolution, and high-volume data processing.- Experience with Git, CI/CD, Linux, test automation, deployment governance, and production support practices.- Strong Agile delivery, stakeholder management, communication, risk management, and team-development https://jobeax.com/link/Cexs453KRiH2S1rJ SKILLS : - Financial Services / Capital Markets experience, including reconciliation, controls, risk, or regulatory data.- Azure or AWS data services, Databricks, Snowflake, Docker, Kubernetes, or Kafka exposure.- Knowledge of data governance, metadata management, security, observability, and cloud cost https://jobeax.com/link/gVGI4lK7EA34k1WQ CANDIDATE PROFILE : Hands-on Data Engineering Manager who can lead teams and delivery while architecting reliable pipelines, optimizing distributed workloads, strengthening data quality, and owning production https://jobeax.com/link/vT6FdUtXz117yZvZ POSITIONING : Technical Leadership + Data Engineering Delivery + People Management (ref:hirist.tech)

Similar vacancies

More like this role

Crescendo Global Leadership Hiring India Pvt Ltd

Python Developer - Data Engineering

  • On-site
  • Backend
... integrating third-party APIs, and engineering scalable data pipelines across on-premises and cloud https://jobeax.com/link/D97KR0fNczjlIZqw Responsibilities : - Data Processing & Analytics : Build high-performance data processing routines, transformations, and numerical computations using Python, Pandas, and NumPy.- Database ...

Gurgaon, भारत

Crescendo Global Leadership Hiring India Pvt Ltd

Python Developer - Data Engineering

  • On-site
  • Backend
... integrating third-party APIs, and engineering scalable data pipelines across on-premises and cloud https://jobeax.com/link/D97KR0fNczjlIZqw Responsibilities : - Data Processing & Analytics : Build high-performance data processing routines, transformations, and numerical computations using Python, Pandas, and NumPy.- Database ...

Noida, भारत

  • IT

$80 USD

... Azure data stack: ADLS Gen2, Azure Data Factory, Azure Key Vault, Entra ID service principals, Azure DevOps or GitHub Actions for deployment. • AWS depth: Glue (Python-shell and Spark), Athena v3/Trino internals, Iceberg on Athena, Step Functions, Batch, ECR, CloudFormation, CodeBuild/CodePipeline, Secrets Manager. • Infrastructure ...

Hyderabad, भारत

... Experience with reporting and alerting tools (Power BI or similar) and CI/CD for data (Azure DevOps or GitHub Actions). Experience and Skills - 7–14 years in data engineering, with 3+ years leading data teams as a tech lead or engineering manager. - Proven track record delivering reliable data platforms and reporting in ...

India, भारत

  • Full-time
... structured and unstructured data from the source to a new physical Data Model - Implement strategies for cleaning and preparing data for analysis, to develop data imputation algorithms, and optimize performance of big data and machine learning systems Above average skills in: - Big Data Engineering and Processing using ...

Hyderabad, भारत

  • Full-time
Role Summary:We are looking for a Technical Data Engineering Manager with 10 - 12 years of experience to lead modern data engineering programs across cloud data platforms, lakehouse architectures, data warehouses, batch and streaming pipelines, data quality, governance, and production operations. The role requires a strong ...

Bombay, भारत

  • Full-time
  • Customer Support
... building and innovation initiatives Required Skills Strong expertise in Python, SQL, and data engineering frameworks Hands-on experience with ETL/ELT tools and data pipeline development Experience working with cloud platforms (AWS / Azure / GCP) Strong understanding of data lakes, data warehouses, and big data technologies ...

Bangalore, भारत

  • Remote
  • Hybrid
  • On-site
  • Full-time
  • Contract
... and the executive team to rollout and launch data products. - Present data strategy and key findings to executives and other departments. - Enforce advanced data governance, security, lineage, and engineering practices. - Collaborate with engineering groups on data and machine learning systems for automation and data enrichment ...

Pune, भारत

  • Full-time
... operational data store enabling teams to make informed decisions and run their operations on trusted data and services. We're looking for a Senior Data Engineering Manager to join our growing Finance Data Engineering team within the Data Engineering department. Join us as we further democratize data and build exceptional data ...

Bangalore, भारत

  • Full-time
  • Backend
Senior software engineering role at Wipro in Pune. Needs 4+ years. What you'll do - Develop Python services for data extraction, transformation, validation, reconciliation, and reporting - Build and manage ETL pipelines using Pandas (PySpark where applicable) - Design and implement REST APIs using FastAPI or Flask What ...

Pune, भारत