Data Engineer (Azure Data Platforms) in Bangalore, भारत
Vrinda International
Full-timeStandard weekly hours
Rs 10 lakh p.a.
Bangalore, भारत
Data Engineer (Azure Data Platforms)
Summary
We are seeking a skilled Data Engineer to design, build, and maintain robust data solutions within the IT Services sector. In this pivotal role, you will leverage advanced Azure technologies to architect scalable data pipelines and ensure the integrity and accessibility of critical business information. Your expertise will drive the optimization of data workflows, enabling seamless integration across diverse platforms and supporting strategic decision-making through reliable data infrastructure.
Responsibilities
Architect and develop end-to-end data solutions utilizing the Azure ecosystem, including Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
Implement real-time data streaming and processing capabilities using Apache Airflow, Kafka, and Azure Functions.
Manage and optimize data storage strategies across Cosmos DB and Blob Storage to ensure high availability and performance.
Establish comprehensive data governance and lineage tracking frameworks using Azure Purview to maintain compliance and data quality.
Collaborate with cross-functional teams to translate business requirements into technical data specifications and scalable architectures.
Monitor data pipeline performance, troubleshoot issues, and implement continuous improvements to enhance system efficiency.
Requirements
Requirements:
Possess 3-6 years of hands-on professional experience in data engineering within the IT Services industry.
Demonstrate proven proficiency with Azure data services, specifically Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Functions.
Exhibit strong expertise in managing NoSQL databases (Cosmos DB) and object storage solutions (Blob Storage).
Have practical experience implementing streaming data architectures using Apache Airflow and Kafka.
Understand and apply data governance principles using tools like Azure Purview.
Hold a competitive salary expectation aligned with the market rate of ₹10 LPA for the specified experience level.
... Experience & Qualifications • 5–7 years of overall experience in Data Engineering / ETL development. • Minimum 3+ years of hands-on experience in Microsoft Azure Data Engineering. • Strong hands-on experience in: o Azure Data Factory (ADF) o Azure Databricks o Azure Data Lake Storage (ADLS) o Azure SQL Database o Azure Synapse ...
... platform stability. ExpertiseYoullBring: - 4-8 years of experience in Data Engineering Big Data and Data Integration projects. - Strong hands-on experience with Azure Databricks and PySpark. - Solid experience designing and developing ETL/ELT pipelines for enterprise-scale data platforms. - Strong proficiency in SQL data analysis ...
... scalable data platforms and pipelines using Databricks Snowflake PySpark and SQL. You will work closely with business and technology teams to build reliable data solutions optimize performance and ensure operational excellence across enterprise data platforms. - Role: Azure Data Engineer - Location: All Persistent Locations ...
Role Overview : We are looking for a skilled Data Engineer with strong hands-on experience in Snowflake, Azure Data Factory (ADF), SQL, Python, and dbt to build, maintain, and optimize scalable cloud-based data https://jobeax.com/link/7yDwjVoYn8HZ8pTw Responsibilities : - Develop data ingestion pipelines from relational ...
... Design efficient data models and optimize database performance.- Integrate data pipelines with AI/ML applications, vector databases, and RAG workflows.- Ensure data quality, consistency, lineage, and governance.- Optimize data processing for performance, scalability, and cost efficiency.- Collaborate with AI engineers and ...
Azure Data EngineerKey Responsibilities:- Design, develop, and maintain scalable data pipelines using Azure Data Factory (ADF).- Build and optimize data processing workflows using Azure Databricks and Python.- Develop ETL/ELT processes to extract, transform, and load data from multiple sources.- Work with structured and ...
... role, you will bridge the gap between complex raw data and actionable business strategy by architecting and deploying scalable machine learning models within the Azure ecosystem. You will collaborate closely with cross-functional product managers, data engineers, and executive stakeholders to translate ambiguous business challenges ...
About Durapid Durapid Technologies is a Microsoft Data & AI Solutions Partner and Databricks partner. We build data platforms, AI solutions and enterprise software for clients across India, the USA, the UK, the Middle East and Singapore. The Role We’re looking for a Databricks Developer with 2-4 years of experience, who ...
... and query optimization.- Hands-on experience with Azure Databricks for data engineering and transformation workloads.- Experience building and orchestrating data pipelines using Azure Data Factory (ADF).- Strong understanding of data engineering principles, ETL/ELT processes, data transformation, and pipeline orchestration.- ...
... exceptional experience for yourself, and a better working world for all. EY GDS – Data and Analytics (D&A) – Azure Data engineers As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest ...