Vacancy description
Wingify
India, Gurugram
Wingify - Senior Big Data Engineer in Gurugram, India is listed on Jobeax. Browse 30,000+ vacancies available.
About the Role : We are looking for a Big Data Engineer to design, build, and operate large-scale data pipelines and analytical infrastructure that transform high-volume raw data into reliable, query-ready datasets for analytics, reporting, and data-driven https://jobeax.com/link/HouIpt6AtbK1KWOU data platform ingests and processes data from multiple sources and serves analytics, data science, product, and downstream applications. In this role, you will own data pipelines end-to-end - from ingestion and transformation to warehousing, orchestration, data quality, and observability.A key part of the role is owning ClickHouse as our primary analytical data store. You will be responsible for designing scalable data models, optimizing query performance, and ensuring the platform remains reliable and cost-efficient as data volumes and workloads https://jobeax.com/link/6P8s6hBOPJeiA62U will work closely with data scientists, analysts, product engineers, and other engineering teams to build a modern, cloud-native data https://jobeax.com/link/2Y4cCTL2qZrUlGJ5 You'll Do : - Design, build, and maintain robust batch and streaming data pipelines that ingest data from multiple sources into analytical data stores.- Build and operate Apache Airflow DAGs, including scheduling, dependencies, retries, backfills, idempotency, concurrency, and failure handling.- Develop analytics-ready datasets using dbt, following well-structured staging, intermediate, and mart layers with appropriate tests, documentation, and incremental models.- Own ClickHouse as the primary analytical store, including schema and table design, partitioning, materialized views, distributed architectures, and performance tuning.- Work with BigQuery where cloud data-warehouse patterns are appropriate, including data modeling and query/cost optimization.- Design and operate NoSQL and key-value data stores, including Bigtable, DynamoDB, and Redis.- Build and maintain data-quality frameworks covering validation, testing, freshness, completeness, reconciliation, and anomaly detection.- Implement monitoring, alerting, structured logging, and observability for data pipelines and services.- Own pipeline SLAs, incident response, troubleshooting, and root-cause analysis.- Manage backfills, safe re-runs, schema evolution, and data migrations while minimizing downstream impact.- Build reproducible, containerized environments using Docker and contribute to CI/CD and Infrastructure as Code practices.- Partner with analysts, data scientists, product managers, and product engineers to translate business and technical requirements into scalable data models and pipelines.- Continuously improve pipeline reliability, scalability, performance, and infrastructure cost efficiency.Must-Have Requirements : - 4 - 6 years of experience in data engineering or a closely related field, with strong hands-on production experience.- Expert-level SQL and strong Python skills, with experience writing production-grade, maintainable, and well-tested code.- Strong hands-on experience with Apache Airflow or a comparable workflow orchestration platform.- Hands-on experience with dbt or a comparable transformation/ELT framework.- Expert-level production experience with ClickHouse, including MergeTree engine family, partitioning, materialized views, and performance tuning.- Production experience with a cloud-based columnar/OLAP warehouse, such as BigQuery.- Hands-on experience with NoSQL and key-value databases, such as Bigtable, DynamoDB, and Redis.- Strong understanding of ETL/ELT and dimensional/layered data modeling principles.- Experience with GCP and/or AWS and familiarity with Docker, Git, and CI/CD.- Strong focus on data quality, reliability, observability, and correctness.- Strong ownership, problem-solving, and communication skills.Nice-to-Have : - Experience with search platforms such as Elasticsearch, OpenSearch, Apache Solr, or Vespa.- Experience with Aerospike or other high-performance, low-latency distributed key-value/NoSQL systems.- Experience building streaming and event-driven pipelines using Kafka, Pub/Sub, or similar technologies.- Experience with Change Data Capture (CDC) patterns and technologies.- Experience with Apache Spark and data-lake architectures using object storage such as GCS or S3.- Experience with Terraform or other Infrastructure as Code tools and Kubernetes.- Experience with data-quality and observability tools such as Great Expectations, Soda, Monte Carlo, or advanced dbt testing.- Understanding of data platform cost optimization / FinOps practices.- Experience handling high-volume e-commerce, product catalog, behavioral, or event data.- Familiarity with a second backend programming language, particularly https://jobeax.com/link/I9PU5HmhrpVKwGOO Success Looks Like : - Data pipelines are reliable, well-tested, observable, and consistently meet freshness and completeness SLAs.- Data models are clean, scalable, documented, and trusted by analytics, data science, and product teams.- Data-quality issues are identified before they impact downstream consumers.- Pipeline failures are diagnosed and resolved quickly, with clear root-cause analysis and preventive actions.- ClickHouse and the broader analytical platform scale smoothly with growing data volumes and query workloads.- Data infrastructure remains performant and cost-efficient as usage grows.- Downstream teams can confidently rely on the platform for analytics, reporting, experimentation, and data-driven product experiences. (ref:hirist.tech)
Similar vacancies
Vensure Employer Solutions
... you an all-around data enthusiast with a knack for ETL We're hiring Data Engineers to help build and optimize the foundational architecture of our product's data. We've built a strong data engineering team to date, but have a lot of work ahead of us, Migrating from relational databases to a streaming and big data architecture, ...
India, Thiruvananthapuram
Sigmoid Analytics is a leading Data solutions company backed by Sequoia Capital. We offer best in- end-to-end data value chain spanning across Data Science, Data Engineering and Data Ops. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. The below role is for our ...
India, Bengaluru
Referrals Only
... leading the system design and implementation of technical solutions. Working with data excites you; You have created Big Data architecture, can build and operate data pipelines, and maintain data storage, all within distributed systems. You have a deep understanding of data modeling and experience with modern data engineering ...
India, Bengaluru
Mastercard
... looking for a Big Data Engineer to drive our mission to unlock potential of data assets by consistently innovating, eliminating friction in how users access data from its Big Data repositories and enforce standards and principles in the Big Data space. The candidate will be part of an exciting, fast paced environment developing ...
India, Pune
Recruitment Room
$ 62400 p.a.
Big Data Engineer Contract · Remote Annual Compensation Equivalent: $62,400–$166,400/year Hourly Rate: $30–$80/hour About the Role This contract role is for a Big Data Engineer experienced in designing and maintaining large-scale data infrastructure, pipelines, and processing systems. You’ll apply your engineering expertise ...
India
Recruitment Room
$ 62400 p.a.
Big Data Engineer Contract · Remote Annual Compensation Equivalent: $62,400–$166,400/year Hourly Rate: $30–$80/hour About the Role This contract role is for a Big Data Engineer experienced in designing and maintaining large-scale data infrastructure, pipelines, and processing systems. You’ll apply your engineering expertise ...
India
ShrinQ Consulting Group Inc
The ideal candidate will use their passion for big data and analytics to provide insights to the business covering a range of topics. They will be responsible for conducting both recurring and ad hoc analysis for business users. Responsibilities Understand the day-to-day issues that our business faces, which can be better ...
India, India
Publicis Sapient
20k
... and adoption of emerging technologies including GenAI-enabled data engineering solutions. Your Skills & Experience: 8+ years of IT experience, with 5+ years in data engineering, big data, or related technologies. Proven experience leading the design and delivery of enterprise-scale data engineering solutions. Strong hands-on ...
India, Bengaluru
... reporting and product development teams 3 to 6 years of experience in the field of data engineering - Graduate degree or higher with courses in programming, data analytics - Good programming skill in Python/scala or any scripting language - Good knowledge of SQL is a required - Basic knowledge and understanding of big ...
India, Bengaluru
MaimsD Technology
... https://jobeax.com/link/2luqtWY4b55DMQvB Skills and Qualifications :- Proven expertise in big data engineering with hands-on experience building and maintaining large-scale data pipelines.- Advanced proficiency in Python for data processing, automation, and integration.- Deep understanding of relational and NoSQL databases, including ...
India
Prudent Technologies and Consulting, Inc.
... Experience with data quality tooling (SODA, Collibra, or similar) Exposure to cloud platforms (Azure, AWS, or GCP) Experience in a regulated or enterprise-scale data environment Prior experience mentoring or leading a small pod of engineers EXPERIENCE - 8+ years in data engineering, with at least 4+ years focused on Snowflake ...
India, Hyderabad
Job Title: Senior Data Engineer Eperience - 10+ to 18 yrs Location: Remote Type: Contract( Comfortable with a 6-month contractual role) Requires strong hands-E xperience in AI and Data Engineering with strong expertise in Azure OpenAI, Azure AI Foundry, Agentic AI, RAG, LLMs, AutoGen, OCR, Databricks, PySpark, Python, Azure ...
India, Bengaluru
... to reinvent the food industry and remain the leading food company in the region. It also operates its Customer Experience Center in Amman, Jordan, and its Engineering Hub in Krakow, Poland. We're looking for a Senior Data Engineer to design, build, and scale the pipelines that power our analytics and AI platforms. You ...
India, Bengaluru
Kanerika Inc
Role: As a Senior Databricks Engineer you will be responsible for automating platform operations, managing CI/CD pipelines, and supporting deployments across multiple environments. The role ensures platform stability, security, and scalability while enabling faster and more reliable software delivery. Key Responsibilities: ...
India, Rāniganj
BAJAJ FINSERV HEALTH
... Engineer will own the end-to-end operationalisation of machine learning, large language model (LLM), and agentic AI workloads on the Bajaj Finance Enterprise Data Platform — a 5PB+ medallion lakehouse built on Azure Databricks and Unity Catalog. This role sits at the intersection of data engineering, model lifecycle management, ...
India, Pune
Job Summary We are looking for a skilled Data Engineer with a strong background in building scalable, high-performance data pipelines on Google Cloud Platform (GCP) . The ideal candidate will have hands-on experience with BigQuery , Airflow , and cloud-based ETL workflows , along with solid programming expertise in Java ...
India, Mannady
ganit inc.
Job Title: Senior Data Engineer At Ganit , we are not just data geeks – we are a family of scientists, refiners, and artisans. Our mission is to bridge the gap between intelligence and action, translating data into valuable insights and strategies. We work with businesses to create state-of-the-art solutions that push the ...
India, Bengaluru
KPI PARTNERS INDIA PRIVATE LIMITED
... advanced data engineering and analytics, fostering a culture of collaboration and continuous https://jobeax.com/link/yeka7e9uOhXV2ngJ the Role :We are seeking a Senior Fabric Data Engineer who can help with the design and building of data https://jobeax.com/link/jcqkTDCTdscBt8W9 :- Building Data Factory pipelines in Fabric- ...
India, Bengaluru
Azilen Technologies
Senior Data Engineer Start Date Starts Immediately CTC (ANNUAL) Competitive salary Competitive salary Experience 5 year(s) 5 year(s) Apply By Not Provided Posted 2 weeks ago Job Be an early applicant About the job Job Purpose: Design and implement scalable data engineering and data warehouse solutions while managing data ...
India, Ahmedabad