Data Engineer (Azure Data Platforms) in Bangalore, भारत
Vrinda International
Full-timeStandard weekly hours
Rs 10 lakh p.a.
Bangalore, भारत
Data Engineer (Azure Data Platforms)
Summary
We are seeking a skilled Data Engineer to design, build, and maintain robust data solutions within the IT Services sector. In this pivotal role, you will leverage advanced Azure technologies to architect scalable data pipelines and ensure the integrity and accessibility of critical business information. Your expertise will drive the optimization of data workflows, enabling seamless integration across diverse platforms and supporting strategic decision-making through reliable data infrastructure.
Responsibilities
Architect and develop end-to-end data solutions utilizing the Azure ecosystem, including Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
Implement real-time data streaming and processing capabilities using Apache Airflow, Kafka, and Azure Functions.
Manage and optimize data storage strategies across Cosmos DB and Blob Storage to ensure high availability and performance.
Establish comprehensive data governance and lineage tracking frameworks using Azure Purview to maintain compliance and data quality.
Collaborate with cross-functional teams to translate business requirements into technical data specifications and scalable architectures.
Monitor data pipeline performance, troubleshoot issues, and implement continuous improvements to enhance system efficiency.
Requirements
Requirements:
Possess 3-6 years of hands-on professional experience in data engineering within the IT Services industry.
Demonstrate proven proficiency with Azure data services, specifically Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Functions.
Exhibit strong expertise in managing NoSQL databases (Cosmos DB) and object storage solutions (Blob Storage).
Have practical experience implementing streaming data architectures using Apache Airflow and Kafka.
Understand and apply data governance principles using tools like Azure Purview.
Hold a competitive salary expectation aligned with the market rate of ₹10 LPA for the specified experience level.
... Experience & Qualifications • 5–7 years of overall experience in Data Engineering / ETL development. • Minimum 3+ years of hands-on experience in Microsoft Azure Data Engineering. • Strong hands-on experience in: o Azure Data Factory (ADF) o Azure Databricks o Azure Data Lake Storage (ADLS) o Azure SQL Database o Azure Synapse ...
... platform stability. ExpertiseYoullBring: - 4-8 years of experience in Data Engineering Big Data and Data Integration projects. - Strong hands-on experience with Azure Databricks and PySpark. - Solid experience designing and developing ETL/ELT pipelines for enterprise-scale data platforms. - Strong proficiency in SQL data analysis ...
... scalable data platforms and pipelines using Databricks Snowflake PySpark and SQL. You will work closely with business and technology teams to build reliable data solutions optimize performance and ensure operational excellence across enterprise data platforms. - Role: Azure Data Engineer - Location: All Persistent Locations ...
... Understanding of data ingestion, transformation, Delta-based storage, and end-to-end data engineering workflows. • Experience migrating or modernizing existing data pipelines on Microsoft Fabric is desirable. 3. Azure Databricks and PySpark • Experience developing scalable data processing solutions using Azure Databricks, ...
Position : Azure Data EngineerLocation : BengaluruExperience : 6 - 13 yrsKey Responsibilities : - Architect and develop end-to-end data pipelines using Azure Data Factory to ensure seamless data integration across disparate source systems.- Optimize complex data processing workflows within Azure Databricks to improve performance ...
Role Overview : We are looking for a skilled Data Engineer with strong hands-on experience in Snowflake, Azure Data Factory (ADF), SQL, Python, and dbt to build, maintain, and optimize scalable cloud-based data https://jobeax.com/link/7yDwjVoYn8HZ8pTw Responsibilities : - Develop data ingestion pipelines from relational ...
Role Overview : We are looking for a skilled Data Engineer with strong hands-on experience in Snowflake, Azure Data Factory (ADF), SQL, Python, and dbt to build, maintain, and optimize scalable cloud-based data https://jobeax.com/link/7yDwjVoYn8HZ8pTw Responsibilities : - Develop data ingestion pipelines from relational ...
... https://jobeax.com/link/X4PrHCRSFELTNBzT Skillset :- Demonstrated expertise in building end-to-end data solutions using Snowflake DB and Azure Databricks, with a deep understanding of modern data warehousing principles.- Advanced proficiency in SQL for complex query optimization and data manipulation, alongside a strong command of cloud platforms including ...
... Design efficient data models and optimize database performance.- Integrate data pipelines with AI/ML applications, vector databases, and RAG workflows.- Ensure data quality, consistency, lineage, and governance.- Optimize data processing for performance, scalability, and cost efficiency.- Collaborate with AI engineers and ...
Azure Data EngineerKey Responsibilities:- Design, develop, and maintain scalable data pipelines using Azure Data Factory (ADF).- Build and optimize data processing workflows using Azure Databricks and Python.- Develop ETL/ELT processes to extract, transform, and load data from multiple sources.- Work with structured and ...