Responsibilities

Design and develop scalable batch and incremental data pipelines using Fabric Data Factory or Azure Data Factory.
Build Fabric Lakehouse and Warehouse solutions using OneLake, Delta tables, SQL, and Spark.
Develop reusable Python and PySpark notebooks for transformations and data-quality processing.
Implement full-load, incremental-load, CDC, and parameter-driven pipeline patterns.
Create curated data layers for reporting, analytics, and downstream consumption.
Implement logging, exception handling, alerts, retry mechanisms, and audit controls.
Optimize SQL queries, Spark jobs, pipelines, data models, and storage structures.
Support deployments across development, test, and production environments.
Troubleshoot production incidents and conduct root-cause analysis.
Collaborate with business analysts, architects, report developers, and source-system teams.
Perform peer reviews and mentor Level 1 engineers.

Requirements

Strong SQL skills, including joins, window functions, CTEs, stored procedures, and performance tuning.
Hands-on experience with Python and/or PySpark.
Experience with Azure Data Factory or Fabric Data Factory.
Experience with Lakehouse, data warehouse, or enterprise data-platform solutions.
Knowledge of Delta Lake, Parquet, partitioning, and medallion architecture.
Understanding of data modeling, including star and snowflake schemas.
Experience using Git and CI/CD tools such as Azure DevOps.
Working knowledge of Power BI semantic models and reporting requirements.
Understanding of identity, role-based access, secrets, and cloud security.
Bachelor-level BTECH or BCA education.
Preferred experience with Fabric OneLake, shortcuts, Warehouse, Data Engineering, or Real-Time Intelligence.
Preferred experience migrating data workloads from on-premises or legacy platforms to Azure or Fabric.
Preferred knowledge of Azure SQL, ADLS Gen2, Synapse Analytics, Azure Functions, or Databricks.
Preferred experience with REST APIs, JSON, event-based ingestion, or streaming data.
Microsoft Fabric Analytics Engineer or Azure Data Engineer certification is preferred.