We are looking for an experienced Azure Data Engineer with 8+ years of experience in Data Engineering, ETL/ELT development, Data Warehousing, and Azure Data Platform services. The ideal candidate should have strong expertise in Azure Data Factory (ADF), Azure Databricks, Azure Synapse, ADLS, Informatica PowerCenter, PySpark, and SQL to build scalable data integration and analytics solutions.
Key Responsibilities
- Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory and Informatica PowerCenter .
- Build data integration solutions across multiple sources including databases, SAP, XML, and flat files.
- Develop and optimize data pipelines using Azure Databricks, PySpark, and Azure Synapse .
- Design and implement data lake architectures (Raw, Enriched, Curated layers).
- Perform data modeling, data governance, metadata management, and data quality activities.
- Optimize data processing performance and troubleshoot pipeline failures.
- Develop technical design documents and support project deliverables.
- Work closely with business, analytics, and project teams in an Agile environment.
Required Skills
- 8+ years of Data Engineering / Data Warehousing experience.
- Strong expertise in:
- Azure Data Factory (ADF)
- Azure Databricks
- Azure Synapse Analytics
- Azure Data Lake Storage (ADLS)
- PySpark / Spark
- Python
- Informatica PowerCenter
- SQL Server / Oracle
- ETL / ELT Development
- Strong understanding of:
- Data Modeling
- Data Warehousing
- Data Governance
- Metadata Management
- Master Data Management (MDM)
- Data Quality
- Experience with Azure DevOps, ARM Templates, PowerShell, Azure Automation.
Preferred Skills
- SSIS
- Real-time Data Processing
- Big Data Architecture
- Enterprise Analytics & BI Solutions
Qualifications
[Some qualifications you may want to include are Skills, Education, Experience, or Certifications.]
Example: Excellent verbal and written communication skills