Senior Data Engineer in भारत

Location: Abu Dhabi United Arab Emirates (UAE)
Employment Type: Full-Time Permanent
Work Model: Onsite
Required Experience: 610 Years

Job Summary

We are seeking an experienced Senior Data Engineer to design develop and manage modern data platforms scalable data pipelines and cloud-based analytics solutions. The ideal candidate will have strong hands-on expertise in Microsoft Azure Data Services large-scale data processing data warehousing ETL/ELT frameworks and cloud-native data architectures.

The role involves building secure reliable and high-performance data solutions that support enterprise analytics business intelligence reporting and AI/ML initiatives. The successful candidate will collaborate with cross-functional teams to deliver robust data engineering solutions aligned with business and technical requirements.

Key Responsibilities

• Design develop and maintain scalable data platforms and data pipelines using Microsoft Azure services.
• Build and optimize batch and real-time data ingestion frameworks for structured semi-structured and unstructured data sources.
• Design and implement data lake data warehouse and lakehouse architectures to support analytics and reporting requirements.
• Develop manage and optimize ETL/ELT pipelines using modern cloud-native data engineering practices.
• Implement data transformation cleansing validation and data quality frameworks to ensure data accuracy and consistency.
• Collaborate with business stakeholders data analysts data scientists and application teams to translate requirements into scalable data solutions.
• Optimize data storage processing and query performance across enterprise data platforms.
• Implement data security governance monitoring metadata management and compliance best practices across Azure environments.
• Integrate enterprise data platforms with AI/ML solutions business intelligence tools and enterprise applications.
• Develop and maintain data models reusable components and efficient data processing workflows.
• Participate in architecture reviews code reviews technical troubleshooting and continuous improvement initiatives.
• Support data platform reliability scalability high availability and operational excellence.
• Implement version control CI/CD pipelines and DevOps practices for data engineering workloads.
• Contribute to technical documentation knowledge sharing and mentoring of team members where required.

Required Skills and Qualifications

• Bachelors degree in Computer Science Information Technology Software Engineering or a related field.
• 610 years of professional experience in Data Engineering Data Warehousing or Enterprise Data Platform development.
• Strong hands-on experience with Microsoft Azure Data Services and cloud-based data engineering solutions.
• Practical expertise in Azure Data Factory (ADF) Azure Synapse Analytics Azure Data Lake Storage Gen2 (ADLS Gen2) and Azure SQL Database.
• Experience designing developing and maintaining large-scale ETL/ELT pipelines and data integration frameworks.
• Strong proficiency in SQL query optimization and database performance tuning.
• Hands-on experience with PySpark Apache Spark and distributed data processing frameworks.
• Strong programming skills in Python with exposure to Scala or Java being an advantage.
• Solid understanding of dimensional modeling data warehousing principles and modern lakehouse architectures.
• Experience processing structured semi-structured and unstructured data.
• Knowledge of data governance data quality metadata management and data security best practices.
• Experience with REST APIs enterprise data integration patterns and connectivity with business applications.
• Familiarity with Git CI/CD pipelines and DevOps practices.
• Strong analytical troubleshooting and problem-solving skills.
• Effective communication and collaboration skills with the ability to work across technical and business teams.

Preferred Qualifications

• Experience with Microsoft Fabric OneLake Dataflows and Fabric Data Engineering workloads.
• Hands-on experience with Databricks Delta Lake and lakehouse implementations.
• Knowledge of real-time streaming technologies such as Azure Event Hubs Apache Kafka or Azure Stream Analytics.
• Experience supporting AI/ML and advanced analytics workloads through enterprise data platforms.
• Familiarity with Power BI datasets semantic models and enterprise reporting architectures.
• Experience with data governance tools such as Microsoft Purview.
• Microsoft Azure Data Engineering certifications are highly desirable.
• Experience working in Agile/Scrum environments.

Additional Skills: Nice to Have

• Experience with Microsoft Fabric Data Engineering and analytics solutions.
• Exposure to DataOps and MLOps practices.
• Knowledge of containerization technologies such as Docker and Kubernetes.
• Experience with Infrastructure as Code tools including Terraform ARM templates or Bicep.
• Familiarity with Snowflake Google BigQuery or other cloud data warehouse platforms.
• Experience with enterprise-scale data migration modernization and cloud transformation projects.
• Understanding of Generative AI vector databases and data platforms supporting AI workloads.

Work Location and Employment Details

• Location: Abu Dhabi United Arab Emirates (UAE)
• Employment Type: Full-Time Permanent
• Work Model: Onsite
• Required Experience: 610 Years

Why Join Us

• Work on modern enterprise data platforms and cloud-based analytics solutions.
• Gain exposure to advanced Azure data engineering and lakehouse technologies.
• Contribute to data initiatives supporting business intelligence analytics and AI/ML applications.
• Collaborate with multidisciplinary teams in a technology-driven environment.
• Participate in enterprise data modernization and continuous improvement initiatives.

Required Experience:

Senior IC