Azure Data Engineer - PySpark/Databricks in Pune, India - Jobeax
Vacancy description
Azure Data Engineer - PySpark/Databricks in Pune, भारत
Burgeon It Services Pvt Ltd
Pune, भारत
Job Title : Azure Data Engineer (Pyspark, Databricks, Delta lake)We are looking for a Data Engineer with 8 - 10 years of experience, including 4+ years of hands-on expertise in Azure Databricks and Azure data https://jobeax.com/link/v8qrFLRTZgSSorDg Skills : - Azure Databricks, PySpark/Scala, Spark SQL, Delta Lake- Azure Data Factory (ADF), ADLS Gen2- Azure SQL/Synapse, Event Hubs/Kafka- Power BI, SQL Optimization- CI/CD (Azure DevOps/GitLab), Git- Unity Catalog, Data Governance & SecurityResponsibilities : - Design, build, and optimize scalable batch and real-time data pipelines on Azure.- Develop ETL/ELT workflows using Databricks and Azure Data Factory.- Implement Lakehouse architectures using Delta Lake and Medallion (Bronze-Silver-Gold) layers.- Integrate data from multiple enterprise and external sources.- Ensure data quality, performance, security, and governance standards.- Collaborate with business and technical stakeholders to deliver analytics solutions and dashboards. (ref:hirist.tech)
... Skills and Experience : - 6 - 12 years of relevant professional experience, including strong hands-on experience in Azure Data Engineering.- Strong proficiency in Azure Databricks, Python, PySpark and SQL.- Experience with Azure Data Lake Storage (ADLS).- Hands-on experience with Azure Data Factory (ADF) or Databricks Workflows.- ...
About the Job : We are looking for a skilled Senior Data Engineer with 7+ years of experience in designing, building, and maintaining scalable data https://jobeax.com/link/hEiNRx4W5ZDbjxHN ideal candidate will have strong expertise in PySpark, SQL, Databricks, Azure, and Azure Data Factory (ADF).You will be responsible ...
... medallion architecture (Bronze, Silver, Gold).- Define data ingestion, transformation, integration, and orchestration strategies.- Develop and optimize complex data pipelines using PySpark, Spark SQL, and Python.- Design and implement ETL/ELT pipelines using Azure Data Factory and Azure Databricks.- Implement data governance, ...
... - Relevant Azure or Databricks certifications are preferred. Nice to Have Certifications - Databricks Certified Data Engineer Associate - Microsoft Certified Azure Data Engineer Associate Requirements Required Skills - Strong hands-on experience with Databricks - Proficiency in PySpark and Spark SQL - SSIS, Essbase, SQL ...
भारत
View vacancy
CGI Information Systems and Management Consultants
... maintain robust ETL/ELT pipelines to move data from various sources into our Azure Data Lake and Data Warehouse.- Coding & Transformation : Write clean, efficient PySpark and Python code in Azure Databricks to clean, transform, and aggregate data.- Data Integration : Utilize Azure Data Factory (ADF) to orchestrate data movement ...
... Databricks Engineer with strong expertise in Azure Databricks, PySpark, Python, SQL, Azure Data Factory (ADF), and Delta Lake to develop and optimize scalable data engineering https://jobeax.com/link/XnflZD2dGSZYgXFG Responsibilities : - Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, Python, ...
... - Lead the design and development of scalable, cloud-native data engineering solutions on Azure.- Build and optimize data pipelines using Azure Databricks, PySpark, Python, and Azure Data Factory (ADF).- Design and implement modern Lakehouse and data platform architectures using Azure services.- Work with Azure Data Lake ...
... experience in Data Engineering, ETL/ELT development, Data Warehousing, and Azure Data Platform services. The ideal candidate should have strong expertise in Azure Data Factory (ADF), Azure Databricks, Azure Synapse, ADLS, Informatica PowerCenter, PySpark, and SQL to build scalable data integration and analytics solutions. ...
... performance, code quality, and https://jobeax.com/link/Bf9g48PT6fDmqfC0 :- 6 - 11 years of experience in data engineering, with hands-on experience building large-scale data pipelines.- Strong experience with Azure Data Factory or similar Azure data integration tools.- Proficiency in Azure Databricks and PySpark for big data processing ...
... experienced Data Engineer with strong hands-on expertise in Python, PySpark, SQL, and cloud-based data engineering. The role involves designing and developing scalable data processing solutions, building reusable frameworks, optimizing data transformation pipelines, and delivering reliable data solutions using Azure Databricks and ...