Job Description : - 3+ years of experience in Azure Databricks with PySpark.- 2+ years of experience in Databricks workflow & Unity Catalog.- 2+ years of experience in ADF (Azure Data Factory).- 2+ years of experience in ADLS Gen 2.- 2+ years of experience in Azure SQL.- 3+ years of experience in Azure Cloud platform.- ...
... services using Django.- Design and implement scalable and secure APIs.- Integrate Azure Cloud services for application deployment and management.- Utilize Azure Databricks for big data processing and analytics.- Implement data processing pipelines using PySpark.- Collaborate with front-end developers, product managers, and other ...
... business requirements into technical designs.- Lead migrations from legacy ETL (SSIS, Informatica, on-prem SQL) and from Azure Synapse to Microsoft Fabric and Databricks.- Design, develop and implement scalable data pipelines using Microsoft Fabric Data Factory, Azure Data Factory and Azure Databricks.- Set up security across ...
... global engineering and analytics teams while managing delivery, stakeholder engagement, talent development, and technology outcomes aligned to business KPIs. -Lead executive presentations, solution demonstrations, and business reviews. Required Skills & Expertise Technical Skills Hadoop / Cloudera Ecosystem , Data Warehousing ...
... : - 8 - 12 years in data engineering, including experience leading data engineering teams.- Strong AWS or Azure experience (S3, Lambda, Glue / ADF, ADLS, Databricks) demonstrated through delivered projects.- Medallion Architecture - you've designed and implemented bronze/silver/gold layers on Databricks or Delta Lake.- ...
ROLE SUMMARY : We are looking for a hands-on Data Engineering Manager with strong expertise in Python, PySpark, SQL, and Apache Airflow. The role will lead a team of approximately 8 - 12 engineers, own delivery of scalable data platforms and pipelines, provide technical direction, and remain hands-on across architecture, ...
... at least 3+ years of hands-on leadership within the Databricks ecosystem.- Expert-level knowledge of the Spark framework (PySpark/Scala), Delta Lake, and Databricks SQL.- Proven experience building and deploying AI solutions, with a deep understanding of the Agentic AI landscape.- Specific experience in Databricks cost ...
... knowledge of Databricks, PySpark, Delta Lake, notebooks, workflows/jobs, data transformation, and ETL/ELT concepts.- Should be comfortable remaining hands-on while leading the team.- Act as a key technical point of contact for client stakeholders.- Independently participate in discussions with business and technical teams, understand ...
... Position Overview: We are seeking a self-driven Lead Data Engineer with 7–10 years of experience to build and optimize scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. The role involves working across scrum teams to develop data solutions, ensure data governance with Unity Catalog, and support real-time ...