Azure Data Engineer - PySpark/Databricks in Pune, India - Jobeax
Vacancy description
Azure Data Engineer - PySpark/Databricks in Pune, भारत
Burgeon It Services Pvt Ltd
Pune, भारत
Job Title : Azure Data Engineer (Pyspark, Databricks, Delta lake)We are looking for a Data Engineer with 8 - 10 years of experience, including 4+ years of hands-on expertise in Azure Databricks and Azure data https://jobeax.com/link/v8qrFLRTZgSSorDg Skills : - Azure Databricks, PySpark/Scala, Spark SQL, Delta Lake- Azure Data Factory (ADF), ADLS Gen2- Azure SQL/Synapse, Event Hubs/Kafka- Power BI, SQL Optimization- CI/CD (Azure DevOps/GitLab), Git- Unity Catalog, Data Governance & SecurityResponsibilities : - Design, build, and optimize scalable batch and real-time data pipelines on Azure.- Develop ETL/ELT workflows using Databricks and Azure Data Factory.- Implement Lakehouse architectures using Delta Lake and Medallion (Bronze-Silver-Gold) layers.- Integrate data from multiple enterprise and external sources.- Ensure data quality, performance, security, and governance standards.- Collaborate with business and technical stakeholders to deliver analytics solutions and dashboards. (ref:hirist.tech)
... Skills and Experience : - 6 - 12 years of relevant professional experience, including strong hands-on experience in Azure Data Engineering.- Strong proficiency in Azure Databricks, Python, PySpark and SQL.- Experience with Azure Data Lake Storage (ADLS).- Hands-on experience with Azure Data Factory (ADF) or Databricks Workflows.- ...
... Responsibilities : - Design, develop, and maintain scalable data pipelines using Azure Databricks, PySpark, and Spark SQL.- Build and orchestrate complex, parameterized data pipelines using Azure Data Factory (ADF).- Develop and implement end-to-end data engineering solutions using Azure Data Lakehouse and Medallion Architecture.- ...
About the Job : We are looking for a skilled Senior Data Engineer with 7+ years of experience in designing, building, and maintaining scalable data https://jobeax.com/link/hEiNRx4W5ZDbjxHN ideal candidate will have strong expertise in PySpark, SQL, Databricks, Azure, and Azure Data Factory (ADF).You will be responsible ...
... :- 8+ years of experience in Data Engineering, Big Data, or related technologies.- Strong hands-on experience with Azure Databricks.- Excellent knowledge of PySpark and Apache Spark.- Strong programming experience in Python.- Strong experience developing ETL/ELT data pipelines.- Hands-on experience with Azure Data Lake ...
... medallion architecture (Bronze, Silver, Gold).- Define data ingestion, transformation, integration, and orchestration strategies.- Develop and optimize complex data pipelines using PySpark, Spark SQL, and Python.- Design and implement ETL/ELT pipelines using Azure Data Factory and Azure Databricks.- Implement data governance, ...
... scalable ETL/ELT pipelines to integrate disparate data sources, ensuring high data quality and availability for downstream analytics.- Develop and optimize complex data models within Snowflake and Databricks environments to support high-performance reporting and business intelligence requirements.- Collaborate with engineering ...
... - Relevant Azure or Databricks certifications are preferred. Nice to Have Certifications - Databricks Certified Data Engineer Associate - Microsoft Certified Azure Data Engineer Associate Requirements Required Skills - Strong hands-on experience with Databricks - Proficiency in PySpark and Spark SQL - SSIS, Essbase, SQL ...
भारत
View vacancy
CGI Information Systems and Management Consultants
... maintain robust ETL/ELT pipelines to move data from various sources into our Azure Data Lake and Data Warehouse.- Coding & Transformation : Write clean, efficient PySpark and Python code in Azure Databricks to clean, transform, and aggregate data.- Data Integration : Utilize Azure Data Factory (ADF) to orchestrate data movement ...
Job Overview : We are seeking a highly experienced Senior Data Engineer to design, develop, and optimize scalable data pipelines in a cloud-based https://jobeax.com/link/2rce0yCTCWx0P6oA ideal candidate will have deep expertise in PySpark, SQL, Azure Databricks, and experience with either AWS or GCP.A strong foundation ...
... Databricks Engineer with strong expertise in Azure Databricks, PySpark, Python, SQL, Azure Data Factory (ADF), and Delta Lake to develop and optimize scalable data engineering https://jobeax.com/link/XnflZD2dGSZYgXFG Responsibilities : - Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, Python, ...