Vacancy description

Senior Data Engineer in Bangalore, भारत

Bayer

  • Full-timeStandard weekly hours
  • ContractFixed-term or freelance

Bangalore, भारत

Senior Data Engineer POSITION PURPOSE:

  • The Data & Analytics organization enables Bayer’s Corporate Functions—including Finance, Supply Chain & Logistics, HR, Procurement, Legal, and Sustainability—to become more insight and data-driven. Our mission is to deliver a robust data foundation and FAIR—Findable, Accessible, Interoperable, and Reusable—data assets that improve business decision-making.
YOUR TASKS AND RESPONSIBILITIES:
  • Design, build, and maintain scalable, reliable, and cost-efficient data pipeline architectures.
  • Develop idempotent, automated ETL/ELT pipelines using Python, PySpark, Delta Lake, and MERGE INTO patterns.
  • Drive automation across deployments, monitoring, incident remediation, and operational processes to improve efficiency, quality, and reliability.
  • Implement robust DataOps practices, including data-contract enforcement, automated data-quality checks, and unit and integration testing.
  • Establish fine-grained data governance, lineage tracking, and security access controls across environments using Unity Catalog.
  • Define and manage Infrastructure as Code using Terraform and Azure DevOps for Databricks workspaces, compute clusters, serverless SQL warehouses, and storage integrations.
  • Build and maintain automated CI/CD pipelines using Databricks Asset Bundles, Databricks CLI, GitHub Actions, Azure DevOps, or GitLab.
  • Monitor compute consumption and costs, optimize cluster configurations, and implement cluster policies to promote efficient resource utilization.
WHO YOU ARE:
  • At least five years of experience in data engineering, DataOps, DevOps, or a comparable technical role.
  • Advanced hands-on experience with Python, PySpark, SQL, Git, and Databricks.
  • Strong experience with the Databricks ecosystem, including Delta Lake, Unity Catalog, and Databricks Serverless SQL.
  • Proven experience with Infrastructure as Code, preferably Terraform, and CI/CD tooling such as Databricks Asset Bundles, GitHub Actions, Azure DevOps, or GitLab.
  • Experience implementing data-quality controls, data contracts, automated testing, monitoring, and incident-management practices.
  • Strong knowledge of Azure cloud services, including security, networking, identity and access management, and storage integration. Experience with AWS or GCP is beneficial.
Ever feel burnt out by bureaucracy? Us too. That's why we're changing the way we work- for higher productivity, faster innovation, and better results. We call it Dynamic Shared Ownership (DSO). Learn more about what DSO will mean for you in your new role here Bayer does not charge any fees whatsoever for recruitment process. Please do not entertain such demand for payment by any individuals / entities in connection with recruitment with any Bayer Group entity(ies) worldwide under any pretext. Please don’t rely upon any unsolicited email from email addresses not ending with domain name “bayer.com” or job advertisements referring you to an email address that does not end with “bayer.com”. For checking the authenticity of such emails or advertisement you may approach us at [email protected]. YOUR APPLICATION Bayer is an equal opportunity employer that strongly values fairness and respect at work. We welcome applications from all individuals, regardless of race, religion, gender, age, physical characteristics, disability, sexual orientation etc. We are committed to treating all applicants fairly and avoiding discrimination. Location: India : Karnataka : Bangalore Division: Enabling Functions Reference Code: 891948 Contact Us + 022-25311234

Similar vacancies

More like this role

  • Full-time
... migrating data pipelines from on-prem or other cloud platforms Understanding of data governance, security, and access control on AWS Experience with CI/CD for data pipelines Nice to have AWS certification (Data Analytics Specialty or Data Engineer Associate) Experience with streaming data (Kinesis, MSK/Kafka) Familiarity ...

Bangalore, भारत

Merrill Communications

Senior Data Engineer

  • Full-time
... Spark (PySpark) – Strong experience in building distributed data pipelines . - Python – Proficiency in writing optimized and maintainable Python code for data engineering. - Unity Catalog – Hands-on experience implementing data governance, access controls, and lineage tracking . - SQL – Strong knowledge of SQL for data transformations ...

Chennai, भारत

GE HealthCare seeks a Senior Data Engineer to design and implement data engineering solutions, ETL pipelines, and analytics infrastructure. The role involves data profiling, metadata management, and automation using cloud and low-code tools to support data science outcomes. Responsibilities - Design and build automations ...

Bangalore, भारत

  • On-site
  • Full-time
... your world, creating more fulfilling work and projects for our people and clients. For more information, visit [ Job Description We’re looking for a skilled Senior Data Engineer with strong experience in distributed systems, Python/Scala, and modern data engineering tools to help design and implement an end-to-end data ...

Hyderabad, भारत

  • Full-time
Job Summary Valorem Reply is looking for a Data Engineer with experience building and contributing to the design of database systems, both normalized transactional systems and dimensional reporting systems. Strong experience with SQL Server as a database engine, as well as Microsoft and Databricks technology experience ...

Ernakulam, भारत

  • Remote
  • Hybrid
  • Full-time
  • Contract
... perfect your skills in a field filled with exciting challenges and opportunities. About the role As part of the Big Data B2B program, OBS set up a shared Big Data platform and a Data Lake for Use cases exploration and industrialization. We are looking for Senior Data Engineer 5-8 years of experience in building Data Pipelines ...

Gurgaon, भारत

  • On-site
  • Contract
... is a sophisticated technology ecosystem that processes billions of payment events with speed, resilience, and precision. As a Senior Data Engineer within the Data Collection & Engineering (DC&E) organisation, you will play a critical role in designing, building, and scaling Mastercard's next-generation data platforms and ...

Hyderabad, भारत

  • Hybrid
... innovation, and large-scale data engineering? If so, we have an exciting opportunity for you to make a meaningful impact on a global scale. About the Role As a Senior Data Engineer , you will be at the heart of our ambition to become a truly data-driven organisation. You will design and deliver best-in-class data engineering ...

Bangalore, भारत

  • Full-time
Mid-level data science role at KreditBee in Bengaluru. Needs 2–4 years and a https://jobeax.com/link/2DENLGgQM7whDhaE or B.E.. What you'll do - ⁠ ⁠Develop various RestFul APIs & Integrate with various data sources - ⁠ ⁠Develop tools & techniques related to ETL - ⁠ ⁠Exposure in AWS or Other Cloud Platform is advantageous ...

Bangalore, भारत

  • Full-time
  • IT
... networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Data Engineer Overview We are the global technology company behind the world’s fastest payments processing network. We are a vehicle for commerce, a connection ...

Pune, भारत