Vacancy description

DATA ENGINEER (AZURE) in भारत

Vrinda International

  • Full-timeStandard weekly hours

Rs 24 lakh p.a.

भारत

Data Engineer (Azure)

Summary

We are seeking a skilled Data Engineer to design, build, and maintain robust data infrastructure within the IT Services sector. This pivotal role focuses on architecting scalable data solutions using Microsoft Azure technologies to ensure seamless data flow, integrity, and accessibility. The successful candidate will play a critical part in transforming raw data into actionable insights, supporting strategic business decisions through advanced data warehousing and analytics capabilities.

Responsibilities

  • Design and implement scalable data storage and processing architectures utilizing Azure Data Lake Storage (ADLS) and Delta Lake.
  • Develop and optimize complex ETL pipelines using Azure Data Factory (ADF) and PySpark to ensure efficient data movement and transformation.
  • Build and manage data models and warehouses, leveraging Azure Synapse Analytics for high-performance querying and reporting.
  • Construct and maintain data pipelines that integrate diverse data sources, ensuring accuracy and consistency across the ecosystem.
  • Write and refine Python and SQL scripts to automate data processes, perform data quality checks, and support analytical workflows.
  • Collaborate with cross-functional teams to define data requirements and deliver solutions that align with organizational goals.

Requirements

Requirements:

  • Possess 4 to 9 years of professional experience in data engineering or a related technical field.
  • Demonstrate deep proficiency with Azure cloud services, specifically Azure Data Lake Storage (ADLS) and Azure Synapse Analytics.
  • Show strong expertise in data modeling, data warehousing concepts, and the implementation of Delta Lake architecture.
  • Be highly skilled in developing ETL pipelines using Azure Data Factory (ADF) and executing big data processing with PySpark.
  • Have a solid command of Python and SQL for data manipulation, scripting, and query optimization.
  • Experience working within Databricks environments for collaborative data analysis and engineering is essential.
  • Target compensation range is approximately ₹24 LPA, commensurate with experience and skill level.

Similar vacancies

More like this role

SUPERSOURCING TECHNOLOGIES PRIVATE LIMITED

Senior Big Data Engineer - Azure/AWS Databricks

... improve data processing efficiency.- Implement real-time and streaming data solutions using technologies such as Spark Streaming and Kafka.- Work with cloud-native data services and integrate Databricks with Azure or AWS environments.- Collaborate with architects, data engineers, and cross-functional teams to deliver robust data ...

Gurgaon, भारत

  • Remote
  • Contract
... sets that meet functional / non-functional business requirements - Build the infrastructure required for optimal extrssaction, transformation What you need - Azure - SQL - Python - ETL - Databricks - Azure Data Factory Good to have - Spark - NoSQL - Root cause analysis - Data structures Job details - Location: Remote, anywhere ...

Bangalore, भारत

$1.33 USD

... 6+ years of hands‑on experience in Data Engineering or Data Platform roles - Strong proficiency in Python, PySpark, and Spark SQL - Extensive experience with Databricks (jobs, notebooks, workflows, Delta Live Tables) - Strong experience with Azure Cloud services, including: - Azure Data Lake Storage (ADLS Gen2) - Azure ...

Bangalore, भारत

  • On-site
  • Full-time
  • Contract
... reverse-engineer existing IBM Stack (Datapower, App Connect, MQ) and MuleSoft integration services to develop Azure migration strategies. Required Skills: - Azure Logic Apps - Azure Functions - Azure Service Bus - Azure Event Grid / Event Hub - Azure Data Factory (ADF) - Integration Account (B2B) - Azure Application Gateway ...

Bangalore, भारत

Merrill Communications

Senior Data Engineer

  • Full-time
... Workflows or Azure Data Factory . - Monitor and troubleshoot failures in job execution and cluster performance . - Collaborate with Stakeholders - Work with Data Analysts, Scientists, and Business Teams to understand requirements. - Translate business needs into scalable data engineering solutions . - API expertise - Ability ...

Chennai, भारत

  • Full-time
  • IT
  • QA
... models, SQL queries, XML data models. Extensive experience with software test automation tools and working in fast-paced Agile environments. Experience with Azure Data Factory for pipeline execution and analysis. Experience with Azure Databricks to access data from Azure Data Lakes. Experience with Azure Notebooks Experience ...

Pune, भारत

  • Contract
... tenant isolation, RBAC) - Proficiency with one or more public cloud providers such as Azure, AWS or GCP - Experience building foundations for modern analytics/data platforms and cloud data warehouses (e.g., Snowflake, Azure Synapse, Microsoft Fabric) - Experience with data pipeline tooling and patterns (e.g., Azure Data ...

Hyderabad, भारत

Scry Analytics

Data Engineer

  • Full-time
... scalable ETL/ELT pipelines for processing structured and unstructured data - Build data ingestion and transformation workflows using Python, SQL, and relevant data engineering frameworks - Extract, clean, validate, normalize, and transform data from APIs, databases, files, and other sources What you need - Python - Spark ...

Hyderabad, भारत

  • Full-time
... Proficiency in Python and Apache Spark. - Develop and manage Databricks notebooks for data transformation, exploration, and model deployment. - Expertise in Microsoft Azure services, including Azure SQL, Azure Data Factory (ADF), Azure Data Warehouse (Synapse Analytics), Azure Data Lake, and Stream Analytics Preferred Qualifications ...

Ernakulam, भारत

Commvault

Data Engineer

  • Hybrid
  • DevOps
... planning, testing, documentation, and continuous-improvement activities. Who you are? - 3+ years of experience in cloud engineering, DevOps, platform operations, data platform support, or a related role. - Hands-on experience with Microsoft Azure and familiarity with Databricks or a comparable data platform. - Experience with ...

Bangalore, भारत