Back to list

Vacancy description

Data Engineer in Noida, भारत

ScaleupAlly

  • Full-timeStandard weekly hours

Noida, भारत

Purpose of Job

We are looking for a Senior Data Engineer who is equally strong on the data side (modelling, data quality, SQL, understanding the business) and the engineering side (Python, PySpark, CI/CD, performance, reliability). You will own the design and delivery of production data platforms from requirements to production support, work directly with clients, and share your knowledge with the wider engineering team.

Your stack will include Python, SQL, PySpark, Azure Databricks or Microsoft Fabric, Azure Data Factory, Delta Lake, and Lakehouse and Data Warehouse designs. Essential Qualifications

  • Bachelor's degree in any discipline 

  • Information Systems, or a related field.

  • Holds at least 5-8 years in data engineering

Skills ADF l Microsoft Fabric l SQL l ETL/ELT l Power BI | Python

Duties

  • Own the design and delivery of data pipelines and platforms end to end: requirements, architecture, build, testing, deployment and production support.

  • Design data models (dimensional, SCD, Medallion Bronze/Silver/Gold) that match how the business actually uses the data.

  • Build and maintain scalable ETL/ELT pipelines using Python, SQL, PySpark and Azure Data Factory on Azure Databricks or Microsoft Fabric.

  • Implement batch, incremental/CDC and streaming loads, and tune Spark and SQL performance and cost.

  • Build data quality checks, monitoring and alerting into every pipeline, and apply governance, lineage and access controls.

  • Automate testing and deployment with Git and CI/CD, and follow engineering best practices in code reviews.

  • Work directly with client stakeholders to gather requirements, explain design choices and agree acceptance criteria.

  • Integrate data from APIs, transactional systems and external platforms.

  • Investigate and resolve complex production issues and document root causes.

  • Document your solutions and share knowledge with the team, including peer code reviews.

Requirements

Required Qualifications

  • Data side: strong SQL, dimensional and Medallion/Lakehouse modelling, data quality practices, and the ability to understand business requirements.

  • Engineering side: strong Python and PySpark, Git and CI/CD, automated testing, and performance tuning of high-volume workloads.

  • Hands-on experience with Azure Databricks or Microsoft Fabric, and Azure Data Factory or an equivalent orchestration tool.

  • Proven delivery of batch and incremental/CDC pipelines on Delta Lake or similar.

  • Client-facing experience: requirement gathering, stakeholder communication and clear technical documentation.

  • Measurable impact you can explain, such as runtime, cost or data quality improvements.

Good to Have

  • Streaming experience (Spark Structured Streaming, Kafka).

  • Governance and lineage tools (Unity Catalog, Azure Purview).

  • Infrastructure as code (Terraform).

  • Power BI and semantic-layer knowledge, to work effectively with BI teams.

  • Microsoft certifications such as DP-203 or DP-600.

Benefits

Benefits and Additional Information

  • Working hours: 10:00 AM – 7:00 PM

  • Working days: 5 days a week (plus 1st & 3rd Saturdays working)

  • Medical Insurance coverage for employees

  • Provident Fund (PF) facility

  • Quarterly parties and yearly outings/trips for team bonding

  • Regular check-ins with leadership for growth and feedback

  • Recognition awards to celebrate high performance

  • Fun activities and team engagement sessions throughout the year

Similar vacancies

More like this role

Take-Two Interactive Software, Inc.

Data Engineer

2k / month

... design discussions, and grow your skills in distributed data processing in a creative and fast-moving environment. You will build and maintain reliable, scalable data pipelines and contribute to the data systems that support marketing across our Labels. Working under the technical direction of senior engineers, you'll turn ...

Bangalore, भारत

Chalhoub Group

Data Engineer

  • Remote
  • Hybrid
... Net Zero by 2040. What you'll be doing Build, maintain, and monitor automated data pipelines on the Group's cloud data platform, transforming raw transactional data into reporting schemas and developing BI dashboards to deliver reliable, analytics-ready data. • Build, maintain, and monitor automated ETL/ELT data pipelines ...

Bangalore, भारत

Omnicom Media

Data Engineer

  • Full-time

$47 USD

... experienced Data Engineer to manage in-progress and upcoming data infrastructure projects. The candidate will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline ...

Pune, भारत

Take-Two Interactive Software, Inc.

Data Engineer

  • Full-time
... scalable data pipelines and third-party API integrations. - Work with business teams and analysts to interpret business rules and derive insights. - Implement data-quality processes, monitoring, and alerting to maintain accurate and available production data. - Analyze and troubleshoot data issues and assist with their resolution. ...

Bangalore, भारत

OSI Digital

Data Engineer

  • Full-time
... Data Frames using PySpark • Conduct complex data analysis and report on results. • Combine raw information from different sources. • Explore ways to enhance data quality and reliability. Required Skills: • 4-5 years of data engineering experience loading, analyzing and interpreting data. • Solid experience with AWS Glue, ...

Hyderabad, भारत

  • Full-time
... measurable business outcomes Overview We are seeking skilled Data Engineers to join our Data & Digital Twin Foundation team. You will design, build, and maintain data pipelines that power digital twin platforms, real-time operational systems, and AI/ML workloads. Working closely with data architects, simulation engineers, and ...

Hyderabad, भारत

Vrinda International

DATA ENGINEER

  • Full-time

Rs 17 lakh p.a.

... analysis and reporting. - Implement and monitor data quality frameworks to ensure the integrity, consistency, and reliability of all data assets. - Optimize database queries and data models to enhance system performance and reduce latency. - Engineer end-to-end ETL and ELT workflows to facilitate seamless data movement ...

Delhi, भारत

... effective solutions - Ensure adherence to best practices related to data governance, quality, and security across all data pipelines - Automate and optimize data processing tasks to improve reliability and reduce manual intervention - Drive adoption of emerging big data technologies, cloud engineering, and automation practices ...

Bangalore, भारत

Amgen seeks a Level 4 Data Engineer to design, build, and maintain data solutions that drive business decisions. The role involves developing ETL pipelines, managing large datasets, implementing data governance, and collaborating across teams to deliver scalable data infrastructure. Responsibilities - Design, develop, and ...

Hyderabad, भारत

Rs 12 - 15 lakhs p.a.

... and analytics. - Implement data quality checks, validation frameworks, monitoring, error handling, and pipeline performance improvements. - Collaborate with Data Analysts, Data Scientists, Product Teams, and Business Stakeholders to understand requirements and deliver scalable data solutions. - Follow data engineering ...

Bangalore, भारत