Back to list

Vacancy description

Databricks + PySpark - Technical Lead-Data Engg in Indi, भारत

Birlasoft

Indi, भारत

Junior data science role at Birlasoft in Pune and Indi. Needs 2–3 years.

What you'll do

  • Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity
  • Developing Modern Data Warehouse solutions using Azure Stack ( Azure Data Lake , Azure Databricks) and PySpark
  • Develop batch processing and integration solutions and process Structured and Non-Structured Data

What you need

  • Databricks
  • Spark
  • SQL
  • ETL
  • Data warehousing
  • Azure

Job details

  • Location: Pune, Indi
  • Experience: 2–3 years
  • Education: Any graduate
  • Employment type: Full-time
  • Languages: English

Similar vacancies

More like this role

$30 USD

Job Description : - 3+ years of experience in Azure Databricks with PySpark.- 2+ years of experience in Databricks workflow & Unity Catalog.- 2+ years of experience in ADF (Azure Data Factory).- 2+ years of experience in ADLS Gen 2.- 2+ years of experience in Azure SQL.- 3+ years of experience in Azure Cloud platform.- ...

Bangalore, भारत

  • Backend
... services using Django.- Design and implement scalable and secure APIs.- Integrate Azure Cloud services for application deployment and management.- Utilize Azure Databricks for big data processing and analytics.- Implement data processing pipelines using PySpark.- Collaborate with front-end developers, product managers, and other ...

Indhur, भारत

... business requirements into technical designs.- Lead migrations from legacy ETL (SSIS, Informatica, on-prem SQL) and from Azure Synapse to Microsoft Fabric and Databricks.- Design, develop and implement scalable data pipelines using Microsoft Fabric Data Factory, Azure Data Factory and Azure Databricks.- Set up security across ...

Bangalore, भारत

  • Full-time
... global engineering and analytics teams while managing delivery, stakeholder engagement, talent development, and technology outcomes aligned to business KPIs. -Lead executive presentations, solution demonstrations, and business reviews. Required Skills & Expertise Technical Skills Hadoop / Cloudera Ecosystem , Data Warehousing ...

Ernakulam, भारत

Calfus Technologies India Pvt Ltd

Calfus - Lead Data Engineer

... : - 8 - 12 years in data engineering, including experience leading data engineering teams.- Strong AWS or Azure experience (S3, Lambda, Glue / ADF, ADLS, Databricks) demonstrated through delivered projects.- Medallion Architecture - you've designed and implemented bronze/silver/gold layers on Databricks or Delta Lake.- ...

Pune, भारत

... monitoring, telemetry, and incident support. - Ensure Databricks solutions follow least-privilege RBAC/ABAC, access reviews, environment segregation, audit logging, data protection, lineage, and Responsible AI controls. - Provide technical leadership, mentoring, and guidance to data engineers, analytics engineers, platform admins, ...

Pune, भारत

ROLE SUMMARY : We are looking for a hands-on Data Engineering Manager with strong expertise in Python, PySpark, SQL, and Apache Airflow. The role will lead a team of approximately 8 - 12 engineers, own delivery of scalable data platforms and pipelines, provide technical direction, and remain hands-on across architecture, ...

Bangalore, भारत

... at least 3+ years of hands-on leadership within the Databricks ecosystem.- Expert-level knowledge of the Spark framework (PySpark/Scala), Delta Lake, and Databricks SQL.- Proven experience building and deploying AI solutions, with a deep understanding of the Agentic AI landscape.- Specific experience in Databricks cost ...

Thiruvananthapuram, भारत

Gyansys Infotech Pvt ltd.

GyanSys - Lead Databricks Developer

... knowledge of Databricks, PySpark, Delta Lake, notebooks, workflows/jobs, data transformation, and ETL/ELT concepts.- Should be comfortable remaining hands-on while leading the team.- Act as a key technical point of contact for client stakeholders.- Independently participate in discussions with business and technical teams, understand ...

Bangalore, भारत

NationsBenefits, LLC

Lead Data Engineer

... Position Overview: We are seeking a self-driven Lead Data Engineer with 7–10 years of experience to build and optimize scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. The role involves working across scrum teams to develop data solutions, ensure data governance with Unity Catalog, and support real-time ...

Hyderabad, भारत