Lead Databricks Engineer - ETL/PySpark in Bangalore, भारत
IT Firm
Bangalore, भारत
Job Summary : We are looking for an experienced Lead Databricks Engineer with strong expertise in Azure Databricks, PySpark, Python, SQL, Azure Data Factory (ADF), and Delta Lake to develop and optimize scalable data engineering https://jobeax.com/link/XnflZD2dGSZYgXFG Responsibilities : - Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, Python, and ADF.- Build and optimize scalable data processing solutions using Delta Lake.- Perform SQL query optimization, Spark performance tuning, and pipeline troubleshooting.- Develop batch and real-time data processing pipelines.- Lead technical design discussions and contribute to data architecture.- Implement CI/CD, DevOps, and cloud migration best practices.- Ensure data quality, security, and reliability.- Mentor engineers and collaborate with analytics, BI, and business https://jobeax.com/link/b98mNqN2dpm2gqBN Skills : - Azure Databricks- PySpark and Python- SQL and query optimization- Azure Data Factory (ADF)- Delta Lake- ETL/ELT pipeline development- Performance tuning and data architecture- Technical leadership (ref:hirist.tech)
... (Bronze, Silver, Gold).- Define data ingestion, transformation, integration, and orchestration strategies.- Develop and optimize complex data pipelines using PySpark, Spark SQL, and Python.- Design and implement ETL/ELT pipelines using Azure Data Factory and Azure Databricks.- Implement data governance, security, access ...
Azure Data Engineer - Databricks / PySpark / SAP S/4HANAExperience : 6 - 12 YearsLocation : Chennai (Hybrid)Industry : FMCG / CPGAbout the Opportunity : We are looking for an experienced Azure Data Engineer to work on a large-scale enterprise data transformation initiative for a leading global FMCG / CPG https://jobeax.com/link/4cm92vbbidre6mQC ...
Job Title : Azure Data Engineer (Pyspark, Databricks, Delta lake)We are looking for a Data Engineer with 8 - 10 years of experience, including 4+ years of hands-on expertise in Azure Databricks and Azure data https://jobeax.com/link/v8qrFLRTZgSSorDg Skills : - Azure Databricks, PySpark/Scala, Spark SQL, Delta Lake- Azure ...
... https://jobeax.com/link/tUNKhTSumiAniKVx Skills & Experience :- 8+ years of experience in Data Engineering, Big Data, or related technologies.- Strong hands-on experience with Azure Databricks.- Excellent knowledge of PySpark and Apache Spark.- Strong programming experience in Python.- Strong experience developing ETL/ELT data pipelines.- Hands-on ...
... tools.- Strong understanding of Distributed Systems & Big Data https://jobeax.com/link/cxnOo7ojYhC3TUoj You'll Do :- Lead the design and development of scalable Databricks data engineering solutions, optimize Spark workloads, build robust ETL/ELT pipelines, and provide technical leadership to the data engineering team. (ref:hirist.tech) ...
... Cloud to design, develop, and optimize scalable data pipelines and modern data platforms. The ideal candidate should have expertise in big data technologies, ETL development, and cloud-based data engineering. Key Responsibilities - Design and develop scalable ETL/ELT pipelines using Databricks and PySpark . - Build and ...
... support the scalability, reliability, and high performance of core back office functions in the insurance domain. Position Overview: We are seeking a self-driven Lead Data Engineer with 7–10 years of experience to build and optimize scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. The role involves ...
Experience : 7 - 11 YearsLocation : Hyderabad / Chennai / BangaloreRole & Responsibilities : - Design, develop, and maintain scalable data pipelines using Azure Databricks, PySpark, and Spark SQL.- Build and orchestrate complex, parameterized data pipelines using Azure Data Factory (ADF).- Develop and implement end-to-end data ...
Key Responsibilities :- Design, develop, and maintain scalable ETL pipelines using PySpark.- Build robust data ingestion frameworks for processing data from multiple source systems.- Develop efficient batch and near real-time data processing workflows.- Perform data extraction, transformation, cleansing, validation, and ...
Job Description :We are looking for an experienced Azure Data Engineer with strong expertise in Azure Data Factory, Azure Databricks, PySpark, and Snowflake to design, develop, and maintain scalable data https://jobeax.com/link/hEiNRx4W5ZDbjxHN ideal candidate should have hands-on experience in ETL development, big data ...