Azure Data Engineer - PySpark/Databricks in Pune, भारत
Burgeon It Services Pvt Ltd
Pune, भारत
Job Title : Azure Data Engineer (Pyspark, Databricks, Delta lake)We are looking for a Data Engineer with 8 - 10 years of experience, including 4+ years of hands-on expertise in Azure Databricks and Azure data https://jobeax.com/link/v8qrFLRTZgSSorDg Skills : - Azure Databricks, PySpark/Scala, Spark SQL, Delta Lake- Azure Data Factory (ADF), ADLS Gen2- Azure SQL/Synapse, Event Hubs/Kafka- Power BI, SQL Optimization- CI/CD (Azure DevOps/GitLab), Git- Unity Catalog, Data Governance & SecurityResponsibilities : - Design, build, and optimize scalable batch and real-time data pipelines on Azure.- Develop ETL/ELT workflows using Databricks and Azure Data Factory.- Implement Lakehouse architectures using Delta Lake and Medallion (Bronze-Silver-Gold) layers.- Integrate data from multiple enterprise and external sources.- Ensure data quality, performance, security, and governance standards.- Collaborate with business and technical stakeholders to deliver analytics solutions and dashboards. (ref:hirist.tech)
... Responsibilities : - Design, develop, and maintain scalable data pipelines using Azure Databricks, PySpark, and Spark SQL.- Build and orchestrate complex, parameterized data pipelines using Azure Data Factory (ADF).- Develop and implement end-to-end data engineering solutions using Azure Data Lakehouse and Medallion Architecture.- ...
... :- 8+ years of experience in Data Engineering, Big Data, or related technologies.- Strong hands-on experience with Azure Databricks.- Excellent knowledge of PySpark and Apache Spark.- Strong programming experience in Python.- Strong experience developing ETL/ELT data pipelines.- Hands-on experience with Azure Data Lake ...
... scalable ETL/ELT pipelines to integrate disparate data sources, ensuring high data quality and availability for downstream analytics.- Develop and optimize complex data models within Snowflake and Databricks environments to support high-performance reporting and business intelligence requirements.- Collaborate with engineering ...
Job Overview : We are seeking a highly experienced Senior Data Engineer to design, develop, and optimize scalable data pipelines in a cloud-based https://jobeax.com/link/2rce0yCTCWx0P6oA ideal candidate will have deep expertise in PySpark, SQL, Azure Databricks, and experience with either AWS or GCP.A strong foundation ...
... leveraging the Azure ecosystem to process and manage large-scale https://jobeax.com/link/izyK9Gp1149KIRva Responsibilities :- Design, develop, and maintain scalable data pipelines using Apache Spark, PySpark, and Databricks.- Build efficient batch and near-real-time data processing solutions for large and complex datasets.- Develop ...
Role Overview :We are seeking a Senior Data Engineer to drive cloud data modernization and build scalable, AI-ready data platforms. This role emphasizes expertise in Databricks, PySpark, Azure Data Factory, Logic Apps, and Airflow, with a strong focus on orchestration, pipeline reliability, and end-to-end data workflow ...
... experience in Data Engineering, ETL/ELT development, Data Warehousing, and Azure Data Platform services. The ideal candidate should have strong expertise in Azure Data Factory (ADF), Azure Databricks, Azure Synapse, ADLS, Informatica PowerCenter, PySpark, and SQL to build scalable data integration and analytics solutions. ...
... with multi-source and multi-country data environments- Support data modelling across Student, Test, Application, Institution, Agent and Payment domains- Work on Azure Databricks Lakehouse environments- Support Bronze, Silver and Gold data layers- Apply SCD Type 2 modelling techniques- Collaborate with data engineering and ...
... implement data engineering projects using Azure technology stacks.- Develop and maintain data solutions using Azure Databricks and Azure Data Factory.- Work with Azure data components, including Azure SQL Database, Azure SQL Warehouse, and Azure Synapse Analytics.- Develop data processing solutions using Python and PySpark.- ...
... business, and engineering https://jobeax.com/link/oq8ejQTdCrDGJkvA Skills : - Strong experience in Azure Databricks, PySpark, SQL.- Hands-on experience with Azure Data Factory, Data Lake, Synapse.- Experience supporting Power BI or Tableau reporting environments.- Understanding of data warehousing concepts and dimensional ...