Consultant Microsoft Azure Kolkata Engineering in Calcutta, भारत

Responsibilities

• Design and develop scalable batch and incremental data pipelines using Fabric Data Factory or Azure Data Factory.
• Build Fabric Lakehouse and Warehouse solutions using OneLake, Delta tables, SQL, and Spark.
• Develop reusable Python and PySpark notebooks for transformations and data-quality processing.
• Implement full-load, incremental-load, CDC, and parameter-driven pipeline patterns.
• Create curated data layers for reporting, analytics, and downstream consumption.
• Implement logging, exception handling, alerts, retry mechanisms, and audit controls.
• Optimize SQL queries, Spark jobs, pipelines, data models, and storage structures.
• Support deployments across development, test, and production environments.
• Troubleshoot production incidents and conduct root-cause analysis.
• Collaborate with business analysts, architects, report developers, and source-system teams.
• Perform peer reviews and mentor Level 1 engineers.

Requirements

• Strong SQL skills, including joins, window functions, CTEs, stored procedures, and performance tuning.
• Hands-on experience with Python and/or PySpark.
• Experience with Azure Data Factory or Fabric Data Factory.
• Experience with Lakehouse, data warehouse, or enterprise data-platform solutions.
• Knowledge of Delta Lake, Parquet, partitioning, and medallion architecture.
• Understanding of data modeling, including star and snowflake schemas.
• Experience using Git and CI/CD tools such as Azure DevOps.
• Working knowledge of Power BI semantic models and reporting requirements.
• Understanding of identity, role-based access, secrets, and cloud security.
• Bachelor-level BTECH or BCA education.
• Preferred experience with Fabric OneLake, shortcuts, Warehouse, Data Engineering, or Real-Time Intelligence.
• Preferred experience migrating data workloads from on-premises or legacy platforms to Azure or Fabric.
• Preferred knowledge of Azure SQL, ADLS Gen2, Synapse Analytics, Azure Functions, or Databricks.
• Preferred experience with REST APIs, JSON, event-based ingestion, or streaming data.
• Microsoft Fabric Analytics Engineer or Azure Data Engineer certification is preferred.