Back to list

Vacancy description

Sunware Technologies - Data Engineering Specialist - Hadoop & NiFi in Pune, भारत

SUNWARE TECHNOLOGIES PRIVATE LIMITED

Pune, भारत

Role Summary:We are looking for an experienced Data Engineering Specialist to design, develop, and optimize scalable data ingestion and ETL pipelines across the Hadoop ecosystem. The ideal candidate should have strong hands-on experience with Apache NiFi, Spark/PySpark, Hadoop/HDFS, Apache Airflow, Cloudera Data Engineering (CDE), Hive, SQL, and https://jobeax.com/link/8biyCZiIJP1lG1LF Skills:- Apache NiFi- Spark / PySpark- Hadoop / HDFS- Apache Airflow- Cloudera Data Engineering (CDE)- Hive & SQL- PythonKey Responsibilities:- Design, develop, and maintain scalable ETL and data ingestion pipelines.- Build and optimize data processing solutions using Spark, PySpark, and NiFi.- Develop and manage Airflow workflows for scheduling and orchestration.- Work with Hadoop, HDFS, Hive, and CDE for enterprise data processing.- Write efficient Hive SQL and Python code for data transformation and automation.- Monitor, troubleshoot, and optimize production data pipelines.- Collaborate with cross-functional teams to deliver reliable data https://jobeax.com/link/qVQYcn8zRo6FsrUo Qualifications:- 8+ years of experience in Data Engineering and Big Data technologies.- Strong expertise in NiFi, Spark/PySpark, Hive SQL, Python, and Airflow.- Good understanding of Hadoop, HDFS, distributed data processing, and ETL best practices.- Hands-on experience with Cloudera Data Engineering (CDE) or similar enterprise data platforms.- Experience supporting and optimizing production data pipelines.- Strong analytical, problem-solving, and communication skills. (ref:hirist.tech)

Similar vacancies

More like this role

Colgate-Palmolive Company

Sr. Specialist, Data Engineering

  • Hybrid
  • On-site
... code standards, guidelines to manage and ensure data quality and integrity Optimize and scale data warehouse and data processing infrastructure Evaluate new technologies and constantly work towards continuous improvements in data engineering, our platform, and the organization Stay current on the evolving data engineering ...

Bombay, भारत

  • Full-time
... https://jobeax.com/link/wOcGjnRrrRFUZzB4, https://jobeax.com/link/2DENLGgQM7whDhaE or B.E.. What you'll do - Design & Build Investment Data Pipelines - Design, develop, and optimize investment data pipelines using ETL/ELT patterns - Integrate data from custodians, vendors, and internal platforms into curated datasets What you need - CI/CD - Docker - Terraform ...

Hyderabad, भारत

... of the energy transition. Our people are diverse, ambitious, and collaborative. We're on a mission to redefine the energy sector by unlocking the power of engineering, data, and science. The Baker Hughes internal title for this role is: Digital Technology Specialist - Data Visualization Engineering About Us: We are an energy ...

Hyderabad, भारत

Mid-level consulting role at Leading Edge in Gurugram. E. Sc. E. com/link/wOcGjnRrrRFUZzB4 or BCA or BBA - Employment type: Full-time - Languages: English [{"name": "full_time", "text": "Full time", "categoryName": "Type of employment"}]

Gurgaon, भारत

  • On-site
  • Contract
... expanding our team and seeking talented individuals to help drive industry leading innovation, With Heart®. About the Role We are seeking a Senior Digital Health Technologies Specialist to join our team in a Hyderabad On-site capacity. As a Senior Digital Health Technologies Specialist, you will support clinical research activities ...

Hyderabad, भारत

  • Data Science
... Hugging Face).- Proven expertise in NLP, Computer Vision, or Generative AI (Transformers, RAG, LLMs, CNNs, Vision Transformers).- Hands-on experience with Big Data technologies (Spark, Hadoop, Kafka, Hive).- Strong knowledge of SQL and data pipelines. Experience with cloud platforms (Azure ML, AWS SageMaker, or GCP AI Platform).- ...

Hyderabad, भारत

  • Remote
  • IT
  • Data Science
  • DevOps
  • Consulting
... for Data Science and Engineering projects that include the design and validation of data models, build systems to collect, manage and convert transactional raw data to usable data structures to generate insights for decision making. Our Data Engineers work with Data Scientists, Project Leads, Managers on implementation, upgrade, ...

Hyderabad, भारत

... Experience with reporting and alerting tools (Power BI or similar) and CI/CD for data (Azure DevOps or GitHub Actions). Experience and Skills - 7–14 years in data engineering, with 3+ years leading data teams as a tech lead or engineering manager. - Proven track record delivering reliable data platforms and reporting in ...

India, भारत

Colgate-Palmolive Company

Expert, Data Engineering

  • Hybrid
  • On-site
... standards, guidelines to manage and ensure data quality and integrity - Optimize and scale data warehouse and data processing infrastructure - Evaluate new technologies and constantly work towards continuous improvements in data engineering, our platform, and the organization - Stay current on the evolving data engineering ...

Bombay, भारत

  • Full-time
... physical Data Model - Implement strategies for cleaning and preparing data for analysis, to develop data imputation algorithms, and optimize performance of big data and machine learning systems Above average skills in: - Big Data Engineering and Processing using Hadoop stack (Hadoop, Hive, HDFS, Spark and HBase etc.) - Develop ...

Hyderabad, भारत