Back to list

Vacancy description

Senior Data Engineer in Hyderabad, भारत

Procter & Gamble

Hyderabad, भारत

HYDERABAD OFFICE APAC PSC GDOP

Job Description

CF-IT's TOP organization is seeking a Senior Data Engineer , located at the Hyderabad IT Hub. Specifically, you'll work within the Data & AI section that supports the Modern IT Service & Asset Management team. Responsibilities: Leading design and development of data and analytics cloud-based platform. Crafting integrated systems, implementing ELT/ ETL jobs to fulfil business deliverables. Performing sophisticated data operations such as data orchestration, transformation, and visualization with large datasets. You will be working with product managers to ensure superior product delivery to drive business value & transformation. Demonstrating standard coding practices to ensure delivery excellence and reusability.
  • Data Ingestion: Develop and maintain data pipelines to extract data from various sources and load it into Azure and Databricks environments.
  • Data Transformation: Design and implement data transformation processes, including data cleansing, normalization, and aggregation, to ensure data quality and consistency.
  • Data Modeling: Develop and maintain data models and schemas to support efficient data storage and retrieval in Azure and Databricks platforms.
  • Data Warehousing: Design and build data warehouses or data lakes using Azure services such as Azure Data Lake Storage, Databricks DeltaLake
  • Data Integration: Integrate data from multiple sources, both on-premises and cloud-based, using Azure Data Factory or other relevant tools.
  • Data Governance: Implement data governance practices, including data security, privacy, and compliance, to ensure data integrity and regulatory compliance.
  • Performance Optimization: Optimize data pipelines and queries for improved performance and scalability in Azure and Databricks environments.
  • Monitoring and Troubleshooting: Monitor data pipelines, identify and resolve performance issues, and troubleshoot data-related problems in collaboration with other teams.
  • Data Visualization: Build BI reports to enable faster decision making.
  • Collaboration: Work with product managers to ensure superior product delivery to drive business value & transformation
  • Documentation: Document data engineering processes, data flows, and system configurations for future reference and knowledge sharing.
  • Experience: Bachelor's or master's degree in computer science, data engineering, or a related field, along with 4+ year work experience in data engineering and cloud platforms.
  • Azure and Databricks: Strong proficiency in Azure services such as Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Data Lake Storage, and Azure Synapse Analytics.
  • ETL Tools: Experience with ETL (Extract, Transform, Load) tools and frameworks, such as Apache Spark, Databricks Delta, or Azure Data Factory, for data integration and transformation.
  • Programming: Proficiency in programming languages such as PySpark, Python, SQL, or Scala for data manipulation, scripting, and automation.
  • Data Modeling: Knowledge of data modeling techniques and experience with data modeling tools.
  • Database Technologies: Familiarity with relational databases (e.g., SQL Server) for data storage and retrieval.
  • Data Warehousing: Understanding of data warehousing concepts, dimensional modeling, and experience with data warehousing technologies such as Azure Synapse Analytics or Azure SQL Data Warehouse or Azure Databricks DeltaLake
  • Data Governance: Knowledge of data governance principles, data security, privacy regulations, and experience implementing data governance practices.
  • Data Visualization: Experience of working with Microsoft Power BI to build semantic data model & BI reports/dashboards.
  • Cloud Computing: Familiarity with cloud computing concepts and experience working with cloud platforms, particularly Microsoft Azure.
  • Problem-Solving: Strong analytical and problem-solving skills to identify and resolve data-related issues.
  • Proficiency in DevOps Tools and CICD tools (e.g. Azure DevOps, Chef, Puppet, Github)
Tempo pieno R000159103 Experienced Professionals

Similar vacancies

More like this role

... Java, Scala, or Golang. Big Data & Analytics Concepts: Data modeling, star schemas, slowly changing dimensions (SCD), Apache Beam, and dbt. Education & Experience: Typically a Bachelor’s or Master’s degree in Computer Science or Engineering, Nice to have Banking Other Languages English: C2 Proficient Seniority Senior []

Pune, भारत

  • Full-time
... migrating data pipelines from on-prem or other cloud platforms Understanding of data governance, security, and access control on AWS Experience with CI/CD for data pipelines Nice to have AWS certification (Data Analytics Specialty or Data Engineer Associate) Experience with streaming data (Kinesis, MSK/Kafka) Familiarity ...

Bangalore, भारत

Merrill Communications

Senior Data Engineer

  • Full-time
... Spark (PySpark) – Strong experience in building distributed data pipelines . - Python – Proficiency in writing optimized and maintainable Python code for data engineering. - Unity Catalog – Hands-on experience implementing data governance, access controls, and lineage tracking . - SQL – Strong knowledge of SQL for data transformations ...

Chennai, भारत

GE HealthCare seeks a Senior Data Engineer to design and implement data engineering solutions, ETL pipelines, and analytics infrastructure. The role involves data profiling, metadata management, and automation using cloud and low-code tools to support data science outcomes. Responsibilities - Design and build automations ...

Bangalore, भारत

  • On-site
  • Full-time
... your world, creating more fulfilling work and projects for our people and clients. For more information, visit [ Job Description We’re looking for a skilled Senior Data Engineer with strong experience in distributed systems, Python/Scala, and modern data engineering tools to help design and implement an end-to-end data ...

Hyderabad, भारत

  • Full-time
Job Summary Valorem Reply is looking for a Data Engineer with experience building and contributing to the design of database systems, both normalized transactional systems and dimensional reporting systems. Strong experience with SQL Server as a database engine, as well as Microsoft and Databricks technology experience ...

Ernakulam, भारत

Rs 10 - 20 lakhs p.a.

Senior data science role at CloudKaptan in Kolkata. Needs 5+ years and a https://jobeax.com/link/2DENLGgQM7whDhaE, B.E. or B.Sc. Pays ₹10–20 LPA. What you'll do - Architect, build and maintain data warehouses and our next-gen cloud data platform - Design and implement scalable data models and ETL/ELT pipelines using Databricks, ...

Calcutta, भारत

  • Remote
  • Hybrid
  • Full-time
  • Contract
... perfect your skills in a field filled with exciting challenges and opportunities. About the role As part of the Big Data B2B program, OBS set up a shared Big Data platform and a Data Lake for Use cases exploration and industrialization. We are looking for Senior Data Engineer 5-8 years of experience in building Data Pipelines ...

Gurgaon, भारत

  • On-site
  • Contract
... is a sophisticated technology ecosystem that processes billions of payment events with speed, resilience, and precision. As a Senior Data Engineer within the Data Collection & Engineering (DC&E) organisation, you will play a critical role in designing, building, and scaling Mastercard's next-generation data platforms and ...

Hyderabad, भारत

  • Hybrid
... innovation, and large-scale data engineering? If so, we have an exciting opportunity for you to make a meaningful impact on a global scale. About the Role As a Senior Data Engineer , you will be at the heart of our ambition to become a truly data-driven organisation. You will design and deliver best-in-class data engineering ...

Bangalore, भारत