Back to list

Vacancy description

Azure Data Engineer - Databricks/PySpark in Chennai, भारत

Pravi HR Advisory

  • HybridMix of office and remote
  • Full-timeStandard weekly hours

Chennai, भारत

Azure Data Engineer - Databricks / PySpark / SAP S/4HANAExperience : 6 - 12 YearsLocation : Chennai (Hybrid)Industry : FMCG / CPGAbout the Opportunity : We are looking for an experienced Azure Data Engineer to work on a large-scale enterprise data transformation initiative for a leading global FMCG / CPG https://jobeax.com/link/4cm92vbbidre6mQC role involves designing, developing and implementing a second enterprise data lake using Azure Databricks, Azure Data Lake Storage, Python, PySpark and https://jobeax.com/link/4BerqLlRG8sIBdN5 will collaborate with Data Architects, SAP specialists, BI developers and business stakeholders to integrate SAP S/4HANA and other enterprise data sources into a scalable Azure-based data https://jobeax.com/link/yxEskUFjM7mvrtl6 is a hands-on engineering opportunity involving data pipeline development, data integration, performance optimisation, data quality and production https://jobeax.com/link/nyvIPyp1073tShWe Responsibilities : - Design, develop and maintain scalable ETL / ELT pipelines using Azure Databricks, PySpark, SQL and Azure services.- Integrate data from SAP S/4HANA and other enterprise applications into Azure Data Lake.- Develop curated data layers using Delta Lake and lakehouse architecture principles.- Implement incremental data processing, pipeline orchestration, monitoring and error handling.- Build reliable datasets for business reporting, analytics and downstream applications.- Implement data quality checks, reconciliation and validation against source systems.- Optimise data pipeline performance, processing efficiency and cloud resource utilisation.- Apply version control, CI / CD, automated deployment and testing practices.- Support data governance, access controls, lineage and technical documentation.- Troubleshoot production issues and support ongoing data platform operations.- Collaborate with cross-functional teams across SAP, Data Architecture, BI and business https://jobeax.com/link/j4Pis43RdYWHkCeP Skills and Experience : - 6 - 12 years of relevant professional experience, including strong hands-on experience in Azure Data Engineering.- Strong proficiency in Azure Databricks, Python, PySpark and SQL.- Experience with Azure Data Lake Storage (ADLS).- Hands-on experience with Azure Data Factory (ADF) or Databricks Workflows.- Good understanding of Delta Lake, ETL / ELT pipelines and dimensional data modelling.- Experience integrating or processing SAP S/4HANA data.- Understanding of SAP business objects, data structures and enterprise data integration.- Experience implementing incremental data processing, data quality controls and performance optimisation.- Ability to collaborate effectively with technical and business https://jobeax.com/link/FfNN38MjANEx2m9w Skills : - Experience in FMCG / CPG, retail, manufacturing or supply chain domains.- Experience building enterprise data lakes or lakehouse platforms.- Knowledge of SAP extraction approaches such as CDS Views, ODP or SLT.- Experience preparing data for Power BI reporting.- Exposure to CI / CD, infrastructure as code and data governance tools.- Experience working with international or global https://jobeax.com/link/ZjtZL9dC68KcIiLJ Details : This is a full-time, permanent opportunity on the payroll of our staffing https://jobeax.com/link/UaO9CDmYjEkru3IG selected candidate will work directly with the technology and data teams of a leading global FMCG / CPG organisation, contributing to enterprise-scale data engineering and analytics https://jobeax.com/link/YUBmU34RM6RmeYEg note : The employment relationship will be with the staffing partner, while the day-to-day project responsibilities will be aligned with the FMCG https://jobeax.com/link/9feDTRXdKcNa7EWT Consider This Opportunity : - Work on an enterprise-scale Azure Data Lake and modern data engineering initiative.- Gain exposure to SAP S/4HANA integration and complex enterprise datasets.- Collaborate with international Data Architecture, SAP and Analytics teams.- Work with modern technologies including Azure Databricks, PySpark and Delta Lake.- Contribute to data solutions supporting critical FMCG business functions such as supply chain, sales, inventory and https://jobeax.com/link/hQvsufarMdWZbfK4 candidates with relevant Azure Data Engineering and SAP integration experience are encouraged to apply. (ref:hirist.tech)

Similar vacancies

More like this role

Hawk Sense Business Solution pvt. ltd.

Azure Data Engineer - PySpark/Databricks

Role : Azure Data EngineerExperience : 5.5 - 8.5 YearsMandatory Skills : - Python- PySpark- Databricks- Azure Services - ADLS, Azure Data Factory (ADF), Azure Databricks (ADB)- Advanced SQLKey Responsibilities : - Design, develop, and maintain scalable ETL/ELT data pipelines.- Ensure data quality, reliability, and timely ...

Bangalore, भारत

Black And White Business Solutions

Azure Data Engineer - Python/Databricks

Azure Data EngineerKey Responsibilities:- Design, develop, and maintain scalable data pipelines using Azure Data Factory (ADF).- Build and optimize data processing workflows using Azure Databricks and Python.- Develop ETL/ELT processes to extract, transform, and load data from multiple sources.- Work with structured and ...

Chennai, भारत

Hawk Sense Business Solution pvt. ltd.

Forward Deployed Engineer - Data Engineering

  • Hybrid
... Vectors)- Right-size and configure Databricks clusters- Configure Unity Catalog (data lineage, access controls, workspace federation)Performance & Production Engineering :- Diagnose performance bottlenecks using Spark UI- Implement CI/CD pipelines using Databricks Asset Bundles (DABs), GitHub Actions, or Azure DevOps- Define ...

India, भारत

SUPERSOURCING TECHNOLOGIES PRIVATE LIMITED

Senior Big Data Engineer - Azure/AWS Databricks

... improve data processing efficiency.- Implement real-time and streaming data solutions using technologies such as Spark Streaming and Kafka.- Work with cloud-native data services and integrate Databricks with Azure or AWS environments.- Collaborate with architects, data engineers, and cross-functional teams to deliver robust data ...

Gurgaon, भारत

  • Full-time
... and make an impact in the community. Job Description Senior Data Engineer We are looking for a Senior Data Engineer with 4 to 5 years of experience to build data pipelines for an enterprise finance data platform on Azure, Databricks and Snowflake. You will develop ingestion and transformation jobs, build Gold data products ...

Bangalore, भारत

Calfus Technologies India Pvt Ltd

Calfus - Lead Data Engineer

... Have : - 8 - 12 years in data engineering, including experience leading data engineering teams.- Strong AWS or Azure experience (S3, Lambda, Glue / ADF, ADLS, Databricks) demonstrated through delivered projects.- Medallion Architecture - you've designed and implemented bronze/silver/gold layers on Databricks or Delta Lake.- ...

Pune, भारत

Vrinda International

DATA ENGINEER (AZURE)

  • Full-time

Rs 24 lakh p.a.

... skilled in developing ETL pipelines using Azure Data Factory (ADF) and executing big data processing with PySpark. - Have a solid command of Python and SQL for data manipulation, scripting, and query optimization. - Experience working within Databricks environments for collaborative data analysis and engineering is essential. ...

भारत

About the Job Position : Role : Data Engineer - Databricks & PySparkExperience : 3 - 6 yearsLocation : Gurgaon, IndiaWork Mode : Work from Office (Mon - Fri)Shift : 2 : 00 PM - 11 : 00 PM ISTMantriAI is hiring for a leading global analytics and advisory firm, helping banks and financial institutions drive revenue growth, ...

Gurgaon, भारत

ScaleupAlly

Data Engineer

  • Full-time
... design and delivery of production data platforms from requirements to production support work directly with clients and share your knowledge with the wider engineering team. Your stack will include Python SQL PySpark Azure Databricks or Microsoft Fabric Azure Data Factory Delta Lake and Lakehouse and Data Warehouse designs. ...

Noida, भारत

... micro services using Django.- Design and implement scalable and secure APIs.- Integrate Azure Cloud services for application deployment and management.- Utilize Azure Databricks for big data processing and analytics.- Implement data processing pipelines using PySpark.- Collaborate with front-end developers, product managers, ...

Indhur, भारत

... automated data quality checks and validation frameworks.- Perform data profiling, anomaly detection, and root cause analysis using Python and SQL.- Integrate data quality processes into ETL/ELT pipelines using PySpark and Databricks.- Monitor and resolve data quality issues across Azure/AWS-based data platforms.- Develop ...

Pune, भारत