Back to list

Vacancy description

Data Engineer in Hyderabad, भारत

Blend360

  • On-siteWork from the office
  • Full-timeStandard weekly hours

Hyderabad, भारत

Company Description Blend360 is a data and AI services company specializing in data engineering, data science, MLOps, and governance to build scalable analytics solutions. It partners with enterprise and Fortune 1000 clients across industries including financial services, healthcare, retail, technology, and hospitality to drive data-driven decision making. Headquartered in Columbia, Maryland, the company is recognized for rapid growth and global delivery of AI solutions through the integration of people, data, and technology. We are seeking a hands-on Data Engineer with deep expertise in distributed systems, ETL/ELT development, and enterprise-grade database management. The engineer will design, implement, and optimize ingestion, transformation, and storage workflows to support the MMO platform. The role requires technical fluency across big data frameworks (HDFS, Hive, PySpark), orchestration platforms (NiFi), and relational systems (Postgres), combined with strong coding skills in Python and SQL for automation, custom transformations, and operational reliability.

Job Description

We are implementing a Media Mix Optimization (MMO) platform designed to analyze and optimize marketing investments across multiple channels. This initiative requires a robust on-premises data infrastructure to support distributed computing, large-scale data ingestion, and advanced analytics. The Data Engineer will be responsible for building and maintaining resilient pipelines and data systems that feed into MMO models, ensuring data quality, governance, and availability for Data Science and BI teams. The environment integrates HDFS for distributed storage, Apache NiFi for orchestration, Hive and PySpark for distributed processing, and Postgres for structured data management. This role is central to enabling seamless integration of massive datasets from disparate sources (media, campaign, transaction, customer interaction, etc.), standardizing data, and providing reliable foundations for advanced econometric modeling and insights. Responsibilities: Data Pipeline Development & Orchestration
  • Design, build, and optimize scalable data pipelines in Apache NiFi to automate ingestion, cleansing, and enrichment from structured, semi-structured, and unstructured sources.
  • Ensure pipelines meet low-latency and high-throughput requirements for distributed processing.
Data Storage & Processing
  • Architect and manage datasets on HDFS to support high-volume, fault-tolerant storage.
  • Develop distributed processing workflows in PySpark and Hive to handle large-scale transformations, aggregations, and joins across petabyte-level datasets.
  • Implement partitioning, bucketing, and indexing strategies to optimize query performance.
Database Engineering & Management
  • Maintain and tune Postgres databases for high availability, integrity, and performance.
  • Write advanced SQL queries for ETL, analysis, and integration with downstream BI/analytics systems.
Collaboration & Integration
  • Partner with Data Scientists to deliver clean, reliable datasets for model training and MMO analysis.
  • Work with BI engineers to ensure data pipelines align with reporting and visualization requirements.
Monitoring & Reliability Engineering
  • Implement monitoring, logging, and alerting frameworks to track data pipeline health.
  • Troubleshoot and resolve issues in ingestion, transformations, and distributed jobs.
Data Governance & Compliance
  • Enforce standards for data quality, lineage, and security across systems.
  • Ensure compliance with internal governance and external regulations.
Documentation & Knowledge Transfer
  • Develop and maintain comprehensive technical documentation for pipelines, data models, and workflows.
  • Provide knowledge sharing and onboarding support for cross-functional teams.

Qualifications

  • Bachelor’s degree in Computer Science, Information Technology, or related field (Master’s preferred).
  • Proven experience as a Data Engineer with expertise in HDFS, Apache NiFi, Hive, PySpark, Postgres, Python, and SQL.
  • Strong background in ETL/ELT design, distributed processing, and relational database management.
  • Experience with on-premises big data ecosystems supporting distributed computing.
  • Solid debugging, optimization, and performance tuning skills.
  • Ability to work in agile environments, collaborating with multi-disciplinary teams.
  • Strong communication skills for cross-functional technical discussions.
Preferred Qualifications:
  • Familiarity with data governance frameworks, lineage tracking, and data cataloging tools.
  • Knowledge of security standards, encryption, and access control in on- premises environments.
  • Prior experience with Media Mix Modeling (MMM/MMO) or marketing analytics projects.
  • Exposure to workflow schedulers (Airflow, Oozie, or similar).
  • Proficiency in developing automation scripts and frameworks in Python for CI/CD of data pipelines.

Similar vacancies

More like this role

Chalhoub Group

Data Engineer

... Net Zero by 2040. What you'll be doing Build, maintain, and monitor automated data pipelines on the Group's cloud data platform, transforming raw transactional data into reporting schemas and developing BI dashboards to deliver reliable, analytics-ready data. • Build, maintain, and monitor automated ETL/ELT data pipelines ...

Bangalore, भारत

NK Securities Research

Data Engineer

... the field of High-Frequency Trading (HFT) across different asset classes. About the Role: We are looking for a Data Engineer to join our team at NK Securities. Data is at the core of everything we do, and this role will own how we source, store, validate, and understand it. You'll build reliable pipelines that bring data ...

Gurgaon, भारत

snowflake

Data Engineer

... next level. We are looking for a Data Engineer to help build and operate the data pipelines and models that power internal decision-making on the Snowflake AI Data Cloud. You will work alongside senior engineers, learn our platform from the inside as customer zero, and grow your ownership of production data products over ...

Pune, भारत

... reliable, and secure data pipelines and infrastructure to support analytics, reporting, and business operations - Design and enforce data modeling standards, data lineage, and governance frameworks that ensure consistency, re-usability, and quality across systems - Lead design and code reviews, driving engineering best ...

Hyderabad, भारत

... and efficient data pipelines - Integrate, clean, and organize raw data from various sources into structured formats - Develop and maintain data warehouses and data lakes to support analytics and business intelligence needs What you need - SQL - Python - AWS - Hadoop - Spark - Kafka Good to have - Data warehousing - Redshift ...

Bangalore, भारत

Vrinda International

Data Engineer

Rs 12 - 14 lakhs p.a.

Summary We are seeking an experienced Data Engineer to join our IT Services division. In this pivotal role, you will design, build, and maintain robust data pipelines that facilitate seamless information flow across our Salesforce ecosystem and data warehouse. You will be instrumental in ensuring data integrity, optimizing ...

Chennai, भारत

Scry Analytics

Data Engineer

  • Full-time
... scalable ETL/ELT pipelines for processing structured and unstructured data - Build data ingestion and transformation workflows using Python, SQL, and relevant data engineering frameworks - Extract, clean, validate, normalize, and transform data from APIs, databases, files, and other sources What you need - Python - Spark ...

Hyderabad, भारत

  • Contract
... & Data Platform. You’ll design and maintain reliable, secure, and scalable data pipelines and models that power a new generation of reporting, insights, and data-driven products across the StarRez ecosystem. This role sits at the intersection of data, product, and engineering. You will work closely with Data Analysts, ...

Hyderabad, भारत

IND - 2025 Takeda Biopharmaceuticals

Data Engineer

  • Full-time
... architecture and pipelines that adhere to ETL principles and business goals - Define data requirements, gather and mine large-scale structured and unstructured data, and validate data using various data tools in the Big Data Environment - Support Data Scientists in data sourcing and preparation to visualize data and synthesize ...

Bangalore, भारत

... We’re confident enough to move fast and talented enough not to break things. Are you a Data Engineer looking to make a real impact? We are looking for a founding Data Engineer to architect the modern data stack that powers our Customer Success organization. In this role, you will move beyond simple data maintenance to design ...

Bangalore, भारत

Vrinda International

Data Engineer

  • Full-time

Rs 12 - 14 lakhs p.a.

Summary We are seeking an experienced Data Engineer to join our IT Services division. In this pivotal role, you will design, build, and maintain robust data pipelines that facilitate seamless information flow across our Salesforce ecosystem and data warehouse. You will be instrumental in ensuring data integrity, optimizing ...

Pune, भारत