Lead Databricks Engineer - ETL/PySpark in Bangalore, India - Jobeax
Vacancy description
Lead Databricks Engineer - ETL/PySpark in Bangalore, भारत
IT Firm
Bangalore, भारत
Job Summary : We are looking for an experienced Lead Databricks Engineer with strong expertise in Azure Databricks, PySpark, Python, SQL, Azure Data Factory (ADF), and Delta Lake to develop and optimize scalable data engineering https://jobeax.com/link/XnflZD2dGSZYgXFG Responsibilities : - Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, Python, and ADF.- Build and optimize scalable data processing solutions using Delta Lake.- Perform SQL query optimization, Spark performance tuning, and pipeline troubleshooting.- Develop batch and real-time data processing pipelines.- Lead technical design discussions and contribute to data architecture.- Implement CI/CD, DevOps, and cloud migration best practices.- Ensure data quality, security, and reliability.- Mentor engineers and collaborate with analytics, BI, and business https://jobeax.com/link/b98mNqN2dpm2gqBN Skills : - Azure Databricks- PySpark and Python- SQL and query optimization- Azure Data Factory (ADF)- Delta Lake- ETL/ELT pipeline development- Performance tuning and data architecture- Technical leadership (ref:hirist.tech)
... (Bronze, Silver, Gold).- Define data ingestion, transformation, integration, and orchestration strategies.- Develop and optimize complex data pipelines using PySpark, Spark SQL, and Python.- Design and implement ETL/ELT pipelines using Azure Data Factory and Azure Databricks.- Implement data governance, security, access ...
... Cloud to design, develop, and optimize scalable data pipelines and modern data platforms. The ideal candidate should have expertise in big data technologies, ETL development, and cloud-based data engineering. Key Responsibilities - Design and develop scalable ETL/ELT pipelines using Databricks and PySpark . - Build and ...
Azure Data Engineer - Databricks / PySpark / SAP S/4HANAExperience : 6 - 12 YearsLocation : Chennai (Hybrid)Industry : FMCG / CPGAbout the Opportunity : We are looking for an experienced Azure Data Engineer to work on a large-scale enterprise data transformation initiative for a leading global FMCG / CPG https://jobeax.com/link/4cm92vbbidre6mQC ...
Job Title : Azure Data Engineer (Pyspark, Databricks, Delta lake)We are looking for a Data Engineer with 8 - 10 years of experience, including 4+ years of hands-on expertise in Azure Databricks and Azure data https://jobeax.com/link/v8qrFLRTZgSSorDg Skills : - Azure Databricks, PySpark/Scala, Spark SQL, Delta Lake- Azure ...
... support the scalability, reliability, and high performance of core back office functions in the insurance domain. Position Overview: We are seeking a self-driven Lead Data Engineer with 7–10 years of experience to build and optimize scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. The role involves ...
... scalable data pipelines using Databricks and PySpark- Understand existing data pipelines and implement enhancements based on project requirements- Develop robust ETL/data processing workflows- Collaborate with technical leads, data engineers, product managers, and business stakeholders- Translate business requirements into ...
Job Description :We are looking for an experienced Azure Data Engineer with strong expertise in Azure Data Factory, Azure Databricks, PySpark, and Snowflake to design, develop, and maintain scalable data https://jobeax.com/link/hEiNRx4W5ZDbjxHN ideal candidate should have hands-on experience in ETL development, big data ...
... maintain robust ETL/ELT pipelines to move data from various sources into our Azure Data Lake and Data Warehouse.- Coding & Transformation : Write clean, efficient PySpark and Python code in Azure Databricks to clean, transform, and aggregate data.- Data Integration : Utilize Azure Data Factory (ADF) to orchestrate data movement ...
About the Job : We are looking for a skilled Senior Data Engineer with 7+ years of experience in designing, building, and maintaining scalable data https://jobeax.com/link/hEiNRx4W5ZDbjxHN ideal candidate will have strong expertise in PySpark, SQL, Databricks, Azure, and Azure Data Factory (ADF).You will be responsible ...