Back to list

Vacancy description

Calfus - Lead Data Engineer in Pune, भारत

Calfus Technologies India Pvt Ltd

Pune, भारत

About the Role : As a Lead Data Engineer, you'll own the design and delivery of our cloud data platforms on AWS and Azure. You'll architect lakehouse solutions built on Medallion Architecture, set the data modelling standards, and lead a team of data engineers delivering reliable, scalable pipelines. This is a hands-on leadership role : you'll make the architecture decisions and still be close enough to the code to write SQL and PySpark yourself. With 8 - 12 years of experience, you've designed data platforms, not just built pipelines on https://jobeax.com/link/soVHbNAhmnIQx6Gn You'll Do : Data Architecture & Platform Design : - Design scalable data lake, lakehouse, and warehouse architectures on AWS and Azure that meet business requirements.- Implement Medallion Architecture (bronze, silver, gold) using Databricks and Delta Lake.- Work with stakeholders to gather requirements and translate them into technical specifications and architecture https://jobeax.com/link/SH3XIHB7XPgGBBvi Integration & Pipelines : - Build and oversee ETL/ELT pipelines using Azure Data Factory, Airflow, SSIS, or equivalent tools.- Use Azure Databricks and PySpark for large-scale data processing.- Own pipeline reliability - orchestration, monitoring, failure handling, and https://jobeax.com/link/ZzwHA8eSBZLnmPSy Modelling : - Design and maintain dimensional and relational data models (star, snowflake) for analytical workloads.- Own schema design decisions and modelling standards across the https://jobeax.com/link/wpMbuWiMprVlt8Pc Engineering & Performance : - Write complex SQL queries, stored procedures, and transformations.- Optimise pipelines, queries, and Spark jobs for performance, scalability, reliability, and https://jobeax.com/link/JvrEVq0ILbh2xSp9 Quality & Governance : - Implement data quality checks, validation, and governance best practices to ensure accurate and compliant https://jobeax.com/link/kE6A9ivWuHaamYah Leadership : - Lead, mentor, and guide data engineers, review code, and build a culture of continuous learning and https://jobeax.com/link/CmImXHtuf7P9F8ph You'll Need - Must Have : - 8 - 12 years in data engineering, including experience leading data engineering teams.- Strong AWS or Azure experience (S3, Lambda, Glue / ADF, ADLS, Databricks) demonstrated through delivered projects.- Medallion Architecture - you've designed and implemented bronze/silver/gold layers on Databricks or Delta Lake.- Data Architecture - you've designed end-to-end data platforms, not only built pipelines on them.- Data Modelling - you've built dimensional and relational models, not only queried them.- Advanced SQL - SQL Server, Postgres, Snowflake, or Redshift, including stored procedures and query tuning.- ETL/ELT and orchestration tools such as SSIS, Azure Data Factory, or Airflow.- Python for data engineering - Pandas, NumPy, PySpark, scripting, and automation.- Experience with databases like Snowflake, Postgres, Redshift, and MongoDB.- Familiarity with data formats like JSON, CSV, Parquet, and Pickle.- Version control (Git), CI/CD, and code quality practices for data engineering projects.- Bachelor's degree in Computer Science, Information Systems, Data Science, or a related https://jobeax.com/link/f13LJ1GY1J6lKnmc to Have : - Hands-on experience across both AWS and Azure.- Azure SDK.- Working with REST APIs and web scraping.- Unity Catalog or other data governance and cataloguing https://jobeax.com/link/Hl33m3b0J3JM6NHe : At Calfus, we value our employees and offer a strong benefits package. This includes medical, group, and parental insurance, coupled with gratuity and provident fund options. Further, we support employee wellness and provide birthday leave as a valued benefit. (ref:hirist.tech)

Similar vacancies

More like this role

Cohere Health

Lead Data Engineer

... frameworks. This role combines deep hands-on engineering with technical leadership and collaboration across platform, analytics, and business teams. What you’ll do: - Lead Data Engineering Initiatives - Lead delivery of complex data engineering projects across multiple teams - Drive technical execution from design through production ...

Hyderabad, भारत

  • On-site
  • Full-time
  • Contract
... transaction is a sophisticated technology ecosystem that processes billions of payment events with speed, resilience, and precision. As a Lead Data Engineer within the Data Collection & Engineering (DC&E) organisation, you will play a critical role in designing, building, and scaling Mastercard's next-generation data platforms and ...

Hyderabad, भारत

  • Hybrid
  • Full-time
... potential. Title and Summary Lead Data Engineer Position Overview Have you ever wanted to be part of something BIG? Now is the time to make an immediate impact at a leading global technology company, Mastercard. This role is part of the AI&DPE Data Engineering platform team, responsible for building and evolving large scale backend ...

Pune, भारत

Referrals Only

Lead Data Engineer

  • Hybrid
  • Full-time
Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to ...

Bangalore, भारत

Dr Reddy's Laboratories Limited

Lead Data Engineer

  • Full-time
  • Contract

24k

... and diversity in our organization. " Job Description Role Summary We are looking for a Lead Data Engineer to design, build, and modernize DRL's cloud-native data platforms on Google Cloud. The role goes beyond pipeline development: the candidate will own data architecture and modeling, lead the move from legacy ETL platforms ...

Hyderabad, भारत

  • Full-time
... you'll do - Design, develop, and maintain robust, scalable, and efficient data pipelines on Google Cloud Platform (GCP) - Work extensively with BigQuery (BQ) for data warehousing, query optimization, and large-scale data analysis - Build and manage big data processing workflows using Dataproc (Hadoop/Spark ecosystem on GCP) ...

Chennai, भारत

  • On-site
  • Full-time
  • IT
Responsibilities - Lead and mentor a team of data engineers and platform developers. - Architect scalable and secure AWS-based data platforms. - Design and develop batch and near-real-time ingestion pipelines for structured and unstructured data. - Build and optimize Snowflake data platforms, including data modeling, governance, ...

Chennai, भारत

  • On-site
  • Full-time
... platforms for batch and real-time data processing - Build scalable data ingestion and processing frameworks to handle structured, semi-structured, and unstructured datasets - Solve complex business problems by leveraging data engineering best practices and advanced technologies What you need - SQL - ETL - Python - Spark - Azure ...

Pune, भारत

... perspective gives us a competitive advantage. Position: Data Engineer Location: Pune, Maharashtra Job Description The Data semantic solution team is looking for a Big Data Engineer to drive our mission to unlock potential of data assets by consistently innovating, eliminating friction in how users access data from its Big Data repositories ...

Pune, भारत

  • IT
Job Description Join us to advance your software engineering career while building impactful technology solutions. Grow your skills and make a difference with a collaborative team. As a Senior Lead Engineer at JPMorgan Chase within the Chief Technology Office team, you will design, develop, and deliver innovative software ...

Bangalore, भारत