Location: Abu Dhabi, United Arab Emirates (UAE) Employment Type: Full-Time, Permanent Work Model: Onsite Required Experience: 6–10 Years
Job Summary
We are seeking an experienced Senior Data Engineer to design, develop, and manage modern data platforms, scalable data pipelines, and cloud-based analytics solutions. The ideal candidate will have strong hands-on expertise in Microsoft Azure Data Services, large-scale data processing, data warehousing, ETL/ELT frameworks, and cloud-native data architectures.
The role involves building secure, reliable, and high-performance data solutions that support enterprise analytics, business intelligence, reporting, and AI/ML initiatives. The successful candidate will collaborate with cross-functional teams to deliver robust data engineering solutions aligned with business and technical requirements.
Key Responsibilities
Design, develop, and maintain scalable data platforms and data pipelines using Microsoft Azure services.
Build and optimize batch and real-time data ingestion frameworks for structured, semi-structured, and unstructured data sources.
Design and implement data lake, data warehouse, and lakehouse architectures to support analytics and reporting requirements.
Develop, manage, and optimize ETL/ELT pipelines using modern cloud-native data engineering practices.
Implement data transformation, cleansing, validation, and data quality frameworks to ensure data accuracy and consistency.
Collaborate with business stakeholders, data analysts, data scientists, and application teams to translate requirements into scalable data solutions.
Optimize data storage, processing, and query performance across enterprise data platforms.
Implement data security, governance, monitoring, metadata management, and compliance best practices across Azure environments.
Integrate enterprise data platforms with AI/ML solutions, business intelligence tools, and enterprise applications.
Develop and maintain data models, reusable components, and efficient data processing workflows.
Participate in architecture reviews, code reviews, technical troubleshooting, and continuous improvement initiatives.
Support data platform reliability, scalability, high availability, and operational excellence.
Implement version control, CI/CD pipelines, and DevOps practices for data engineering workloads.
Contribute to technical documentation, knowledge sharing, and mentoring of team members where required.
Required Skills and Qualifications
Bachelor’s degree in Computer Science, Information Technology, Software Engineering, or a related field.
6–10 years of professional experience in Data Engineering, Data Warehousing, or Enterprise Data Platform development.
Strong hands-on experience with Microsoft Azure Data Services and cloud-based data engineering solutions.
Practical expertise in Azure Data Factory (ADF), Azure Synapse Analytics, Azure Data Lake Storage Gen2 (ADLS Gen2), and Azure SQL Database.
Experience designing, developing, and maintaining large-scale ETL/ELT pipelines and data integration frameworks.
Strong proficiency in SQL, query optimization, and database performance tuning.
Hands-on experience with PySpark, Apache Spark, and distributed data processing frameworks.
Strong programming skills in Python, with exposure to Scala or Java being an advantage.
Solid understanding of dimensional modeling, data warehousing principles, and modern lakehouse architectures.
Experience processing structured, semi-structured, and unstructured data.
Knowledge of data governance, data quality, metadata management, and data security best practices.
Experience with REST APIs, enterprise data integration patterns, and connectivity with business applications.
Familiarity with Git, CI/CD pipelines, and DevOps practices.
Strong analytical, troubleshooting, and problem-solving skills.
Effective communication and collaboration skills, with the ability to work across technical and business teams.
Preferred Qualifications
Experience with Microsoft Fabric, OneLake, Dataflows, and Fabric Data Engineering workloads.
Hands-on experience with Databricks, Delta Lake, and lakehouse implementations.
Knowledge of real-time streaming technologies such as Azure Event Hubs, Apache Kafka, or Azure Stream Analytics.
Experience supporting AI/ML and advanced analytics workloads through enterprise data platforms.
Familiarity with Power BI datasets, semantic models, and enterprise reporting architectures.
Experience with data governance tools such as Microsoft Purview.
Microsoft Azure Data Engineering certifications are highly desirable.
Experience working in Agile/Scrum environments.
Additional Skills: Nice to Have
Experience with Microsoft Fabric Data Engineering and analytics solutions.
Exposure to DataOps and MLOps practices.
Knowledge of containerization technologies such as Docker and Kubernetes.
Experience with Infrastructure as Code tools, including Terraform, ARM templates, or Bicep.
Familiarity with Snowflake, Google BigQuery, or other cloud data warehouse platforms.
Experience with enterprise-scale data migration, modernization, and cloud transformation projects.
Understanding of Generative AI, vector databases, and data platforms supporting AI workloads.
Work Location and Employment Details
Location: Abu Dhabi, United Arab Emirates (UAE)
Employment Type: Full-Time, Permanent
Work Model: Onsite
Required Experience: 6–10 Years
Why Join Us?
Work on modern enterprise data platforms and cloud-based analytics solutions.
Gain exposure to advanced Azure data engineering and lakehouse technologies.
Contribute to data initiatives supporting business intelligence, analytics, and AI/ML applications.
Collaborate with multidisciplinary teams in a technology-driven environment.
Participate in enterprise data modernization and continuous improvement initiatives.
... Azure Data Fundamentals, Azure Data Engineer, Microsoft Fabric, Snowflake, Databricks, Apache Spark, Airflow or equivalent orchestration tools, dbt, Informatica, data quality, data governance, or cloud data platforms Experience (Career Level Guide) Senior-Level: 5 to 8 years of experience in data engineering, ETL/ELT development, ...
Department: Commercial & Consumer Data Engineering, Enterprise IT & Quality Location:Novo Nordisk Global Business Services (GBS) Bengaluru, India (hybrid – minimum three days per week in the office) Your impact begins here As Senior Data Engineer, you will build and run the data pipelines that keep the right data mov-ing ...
Position : Senior Data Engineer / Data Engineer Desired Experience : 3-8 years You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for ...
Role Overview We are looking for a Senior Data Engineer (15+ years) with deep hands-on experience in database development, Oracle PL/SQL, and large-scale Azure cloud migration to independently own and deliver complex migration and integration workstreams with minimal supervision. The role covers reverse-engineering legacy ...
... continuous learning. A place where we move fast, trust you to make an impact, encourage innovation, and support your growth. Job Summary: ProArch is seeking a Senior Data Engineer with 5–8 years of experience to join our Data & Analytics practice. In this role, you will design, develop, and optimize scalable cloud-based data solutions ...
Senior data engineers at Thoughtworks are engineers who build, maintain and test the software architecture and infrastructure for managing data applications. They are involved in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are ...
Senior Data Engineer role within Thermo Fisher Scientific's IT team, responsible for designing and maintaining data pipelines, performing data modeling, and ensuring data quality across enterprise analytics solutions. The position involves collaborating with IT and business functions to translate requirements into technical ...
Job Description: - 6+ years of experience in Data Engineering. - Strong data architecture and system design skills with the ability to make sound trade-offs around data modeling, partitioning, and scalability. - Demonstrated end-to-end ownership of production data pipelines, including design, deployment, monitoring, and ...
Job Req Number: 124988 Time Type: Full Time Job Description: Senior Data Engineer Industry • Information Technology: Logistics & Supply Chain Employment Type • Full-time Are you ready to develop your career in a rapidly growing and successful global company acting in a fast-paced role? If you are someone looking for a position ...
... Senior Data Engineer Position Purpose The Senior Analyst – Data Engineering is part of TTEC Digital’s Analytics & Insights Experience (AIX) team, supporting Data Science and Engineering initiatives involving data modeling, data pipelines, cloud platforms, APIs, and analytics solutions. The role works closely with Data ...