Back to list

Vacancy description

Databricks PySpark Developer in Chennai, भारत

DoublU

Chennai, भारत

Role Summary :We are looking for an experienced Databricks PySpark Developer to design, develop, and enhance scalable data https://jobeax.com/link/hEiNRx4W5ZDbjxHN role requires strong hands-on expertise in PySpark and Databricks, along with experience working on cloud data platforms and ETL https://jobeax.com/link/XnflZD2dGSZYgXFG Responsibilities :- Design, develop, and maintain scalable data pipelines using Databricks and PySpark- Understand existing data pipelines and implement enhancements based on project requirements- Develop robust ETL/data processing workflows- Collaborate with technical leads, data engineers, product managers, and business stakeholders- Translate business requirements into effective technical solutions- Troubleshoot, optimize, and improve data pipeline performance- Work with distributed data processing and cloud-based data platforms- Independently manage assigned development activities and deliver within timelines- Provide regular updates on development progress and technical deliverablesMandatory Skills :- 5 - 7 years of relevant IT experience- Strong hands-on experience with PySpark- Strong hands-on experience with Databricks- Good experience in ETL/Data Engineering- Experience with at least one Cloud Data Platform- Experience with Kafka / Pub-Sub for streaming data processing- Experience with Apache Airflow for data pipeline orchestration- Strong understanding of data engineering conceptsGood to Have :- Experience with GCP- Hands-on experience with GCP Data Services- Experience in the Healthcare domain- Experience working with large-scale data processing and cloud data pipelinesCandidate Profile :- Strong problem-solving and analytical skills- Good communication and stakeholder collaboration skills- Ability to work independently with minimal supervision- Comfortable collaborating with teams across India and the US (ref:hirist.tech)

Similar vacancies

More like this role

  • Full-time

$14.68 USD

... degree in Computer Science or related field or higher with minimum 7 years of relevant experience. Position Description: We are looking for an experienced Databricks Developer with strong expertise in Databricks, Apache Spark, PySpark, Teradata, and modern data engineering practices. The ideal candidate will be responsible ...

भारत

  • Backend
Role Overview:We are looking for an experienced Python Developer with strong expertise in backend development, Django, Azure cloud services, and big data processing. The role involves designing scalable backend services, developing secure APIs, building data processing pipelines using Azure Databricks and PySpark, and delivering ...

Bangalore, भारत

  • Full-time
  • IT
... Prometheus/Grafana).Certifications (Preferred):- Microsoft Certified: Fabric Data Engineer Associate (DP-700)- Any of: Azure Data Engineer Associate (DP-203), Databricks Data Engineer Professional, Azure Developer (AZ-204), Certified Kubernetes Application Developer (CKAD)Education:Bachelor's degree in Engineering, Computer ...

भारत

  • Backend
... microservices using Django.- Design and implement scalable and secure APIs.- Integrate Azure Cloud services for application deployment and management.- Utilize Azure Databricks for big data processing and analytics.- Implement data processing pipelines using PySpark.- Collaborate with front-end developers, product managers, and other ...

Pune, भारत

  • Backend
... microservices using Django.- Design and implement scalable and secure APIs.- Integrate Azure Cloud services for application deployment and management.- Utilize Azure Databricks for big data processing and analytics.- Implement data processing pipelines using PySpark.- Collaborate with front-end developers, product managers, and other ...

Indhur, भारत

INFO ORIGIN TECHNOLOGIES PRIVATE LIMITED

Info Origin - Smile CDR Integration Developer

Job Description : We are seeking a Smile CDR Integration Developer to design, develop, and support enterprise interoperability solutions that enable healthcare data exchange across payer, provider, and regulatory https://jobeax.com/link/ZjwtbDzaKMLhOuHB role will focus on building scalable integrations utilizing Smile CDR, ...

भारत

... Fabric, Fabric Data Pipelines and Dataflows Gen2.- Develop and maintain scalable ETL/ELT pipelines using: Azure Data Factory, Azure Synapse Analytics, Azure Databricks.- Implement transformations using PySpark / Python https://jobeax.com/link/jpltULmz7uIFw3oa Modeling & Architecture Implementation :- Implement Medallion Architecture ...

Hyderabad, भारत

Job Summary : We are looking for an experienced Lead Databricks Engineer with strong expertise in Azure Databricks, PySpark, Python, SQL, Azure Data Factory (ADF), and Delta Lake to develop and optimize scalable data engineering https://jobeax.com/link/XnflZD2dGSZYgXFG Responsibilities : - Design, develop, and maintain ...

Bangalore, भारत

... (Bronze, Silver, Gold).- Define data ingestion, transformation, integration, and orchestration strategies.- Develop and optimize complex data pipelines using PySpark, Spark SQL, and Python.- Design and implement ETL/ELT pipelines using Azure Data Factory and Azure Databricks.- Implement data governance, security, access ...

Bangalore, भारत

  • Hybrid
  • Full-time
... https://jobeax.com/link/4cm92vbbidre6mQC role involves designing, developing and implementing a second enterprise data lake using Azure Databricks, Azure Data Lake Storage, Python, PySpark and https://jobeax.com/link/4BerqLlRG8sIBdN5 will collaborate with Data Architects, SAP specialists, BI developers and business stakeholders to integrate SAP ...

Chennai, भारत