Vacancy description
Path Mentors Staffing Solution
India, Bengaluru
Data Engineer - Python/SQL in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
Role Overview : We are looking for a Data Engineer with strong hands-on experience in Python, SQL, and Spark to build and maintain scalable data pipelines and integration solutions. The ideal candidate should have experience with Azure data technologies and ETL/ELT https://jobeax.com/link/OfTNakiwtq51n9YB Responsibilities : - Develop and maintain scalable data pipelines using Python, SQL, and Spark/PySpark.- Build and manage data workflows using Azure Data Factory, Azure Databricks, and Synapse Analytics.- Design and implement ETL/ELT processes for data ingestion and transformation.- Integrate data from multiple sources and ensure reliable data movement across platforms.- Optimize data processing jobs, queries, and pipelines for performance and scalability.- Perform data validation, quality checks, and troubleshooting of pipeline failures.- Monitor data pipelines and resolve issues across development and production environments.- Collaborate with data scientists, analysts, and technology teams to deliver data https://jobeax.com/link/Gpaa4oyRTNYXQU0V Stack & Requirements : - Strong proficiency in Python, SQL, and Spark/PySpark.- Hands-on experience with Azure Data Factory, Azure Databricks, and/or Synapse Analytics.- Experience with ETL/ELT frameworks and data integration tools.- Good understanding of data engineering concepts and data pipeline architecture.- Experience with data transformation, processing, and optimization.- Strong troubleshooting and analytical skills.- Good understanding of cloud-based data platforms. (ref:hirist.tech)