Vacancy description
Azure Data Engineer in Chennai, भारत
Valam Solutions
Chennai, भारत
Azure Data Engineer – Offshore, India
Experience: 8–10+ years
Engagement: 3 months
Location: Offshore, India
Role Summary:
We are looking for an experienced Azure Data Engineer to design, develop, and optimize data integration and ETL/ELT pipelines using Microsoft Azure technologies. The resource will work with the CIT Data Team to build scalable data solutions and integration feeds across various applications.
Key Responsibilities:
Design and develop data pipelines using Azure Data Factory (ADF) .
Build and optimize integrations across ADLS, Azure Synapse, Databricks, Azure SQL, SAP, XML, flat files, and databases .
Develop ETL/ELT solutions using SQL, Python/PySpark, Spark , and Azure services.
Perform data modeling, data warehousing, data governance, metadata, and data quality activities.
Optimize pipeline performance and ensure adherence to IFC technical standards.
Develop unit/integration test cases and support application feed testing.
Prepare technical/functional design documents and other project artifacts.
Work in an Agile/SDLC environment and collaborate with project leads and business/data teams.
Mandatory Skills:
Strong hands-on experience with Azure Data Factory, Azure Databricks, ADLS, Azure Synapse, Azure SQL .
Strong SQL Server/Oracle and complex SQL query skills.
Experience with Python/PySpark and Spark .
Strong ETL/ELT and data warehouse/data lake experience.
Experience with Informatica and/or SSIS is an advantage.
Knowledge of Azure Functions, Logic Apps, Automation, PowerShell, AzCopy, Azure DevOps/ARM templates .
Strong understanding of data architecture, modeling, ingestion, curation, and raw/enriched/curated data layers.
Experience delivering end-to-end data warehousing, BI, and analytics projects .
Bachelor’s degree in Computer Science, Engineering, MIS, or related field.
Preferred: Experience with real-time/near-real-time data warehousing and enterprise data integration.