Vacancy description

Senior Data Engineer in Noida, भारत

wowJobs

Noida, भारत

Requirements : - Bachelor's or Master's degree in Computer Science, Engineering or a related field- 8+ years of experience in Data Engineering with strong big data expertise- Deep expertise in Databricks (2+ years of hands-on experience), Spark and SQL (including Spark SQL)- Strong data modeling and ETL experience with large-scale datasets- Hands-on experience orchestrating data pipelines with Airflow and CI/CD (GitHub Actions or similar)- Proven experience with Delta Live Tables, Unity Catalog, Delta Sharing and SQL Warehouse (server and serverless)- Proficiency in Python for data engineering workflows- Familiarity with analytics engineering and dbt- Experience with data governance, compliance and security in a cloud environment- Experience adopting software engineering best practices (testing, modularization, refactoring, automation)- Ability to optimize data systems for performance and cost efficiency in cloud environments- Exposure to AI/ML frameworks for development efficiency- Demonstrated ability to lead projects independently and mentor junior engineers- English : Upper-Intermediate or higherNice to have : - Experience with serverless architectures- Understanding of pricing / financial data domains- Experience with cascading formula-based financial calculations- Familiarity with enterprise client support workflowsSoft Skills : - Strong self-management : ability to work independently and meet deadlines- Proactive and ownership-driven mindset- Effective and clear communication, including in distributed teams- Collaborative, open to feedback, and focused on shared goals- Strong problem-solving skills, especially in ambiguous contexts- High attention to detail and code quality- Adaptability to shifting priorities and new technologiesResponsibilities : - Serverless migration : adapt existing pipelines / code to run on different cluster types (serverless) without issues- CI/CD ownership : maintain and improve CI/CD processes, propose architectural improvements- Pipeline monitoring : proactively check repositories, review merge requests and team members' changes- Functional and technical work : write pipeline code and understand the business logic (pricing domain) (ref:hirist.tech)

Similar vacancies

More like this role

  • Full-time
... migrating data pipelines from on-prem or other cloud platforms Understanding of data governance, security, and access control on AWS Experience with CI/CD for data pipelines Nice to have AWS certification (Data Analytics Specialty or Data Engineer Associate) Experience with streaming data (Kinesis, MSK/Kafka) Familiarity ...

Bangalore, भारत

Merrill Communications

Senior Data Engineer

  • Full-time
... Spark (PySpark) – Strong experience in building distributed data pipelines . - Python – Proficiency in writing optimized and maintainable Python code for data engineering. - Unity Catalog – Hands-on experience implementing data governance, access controls, and lineage tracking . - SQL – Strong knowledge of SQL for data transformations ...

Chennai, भारत

GE HealthCare seeks a Senior Data Engineer to design and implement data engineering solutions, ETL pipelines, and analytics infrastructure. The role involves data profiling, metadata management, and automation using cloud and low-code tools to support data science outcomes. Responsibilities - Design and build automations ...

Bangalore, भारत

  • On-site
  • Full-time
... your world, creating more fulfilling work and projects for our people and clients. For more information, visit [ Job Description We’re looking for a skilled Senior Data Engineer with strong experience in distributed systems, Python/Scala, and modern data engineering tools to help design and implement an end-to-end data ...

Hyderabad, भारत

  • Full-time
Job Summary Valorem Reply is looking for a Data Engineer with experience building and contributing to the design of database systems, both normalized transactional systems and dimensional reporting systems. Strong experience with SQL Server as a database engine, as well as Microsoft and Databricks technology experience ...

Ernakulam, भारत

  • Remote
  • Hybrid
  • Full-time
  • Contract
... perfect your skills in a field filled with exciting challenges and opportunities. About the role As part of the Big Data B2B program, OBS set up a shared Big Data platform and a Data Lake for Use cases exploration and industrialization. We are looking for Senior Data Engineer 5-8 years of experience in building Data Pipelines ...

Gurgaon, भारत

  • On-site
  • Contract
... is a sophisticated technology ecosystem that processes billions of payment events with speed, resilience, and precision. As a Senior Data Engineer within the Data Collection & Engineering (DC&E) organisation, you will play a critical role in designing, building, and scaling Mastercard's next-generation data platforms and ...

Hyderabad, भारत

  • Hybrid
... innovation, and large-scale data engineering? If so, we have an exciting opportunity for you to make a meaningful impact on a global scale. About the Role As a Senior Data Engineer , you will be at the heart of our ambition to become a truly data-driven organisation. You will design and deliver best-in-class data engineering ...

Bangalore, भारत

Leadership data science role at Commvault in Bengaluru. Needs 8+ years and a https://jobeax.com/link/wOcGjnRrrRFUZzB4, https://jobeax.com/link/2DENLGgQM7whDhaE or B.E.. What you'll do - Platform Architecture & Engineering - Design and implement secure, scalable platform services for Databricks, Azure Data Lake, Microsoft ...

Bangalore, भारत

  • Full-time
Mid-level data science role at KreditBee in Bengaluru. Needs 2–4 years and a https://jobeax.com/link/2DENLGgQM7whDhaE or B.E.. What you'll do - ⁠ ⁠Develop various RestFul APIs & Integrate with various data sources - ⁠ ⁠Develop tools & techniques related to ETL - ⁠ ⁠Exposure in AWS or Other Cloud Platform is advantageous ...

Bangalore, भारत

  • Full-time
  • Contract
Senior Data Engineer POSITION PURPOSE: - The Data & Analytics organization enables Bayer’s Corporate Functions—including Finance, Supply Chain & Logistics, HR, Procurement, Legal, and Sustainability—to become more insight and data-driven. Our mission is to deliver a robust data foundation and FAIR—Findable, Accessible, ...

Bangalore, भारत