Senior Azure Data Engineer - Python/PySpark in work… - Jobeax
Vacancy description
Senior Azure Data Engineer - Python/PySpark in भारत
hirezy.ai
भारत
Job Description :Responsibilities :- Engage with business and technical stakeholders to understand data requirements and translate them into robust technical designs and architecture.- Own solution planning, task breakdown, and end-to-end delivery execution.- Design and develop optimized ETL/ELT pipelines, ensuring high data quality, reliability, and performance.- Collaborate effectively with cross-functional and internal teams to deliver technical solutions.- Troubleshoot data and system issues, optimize performance, and ensure timely delivery.- Mentor and guide junior developers, ensuring adherence to best practices and engineering standards.- Resolve complex technical challenges and provide support throughout the development lifecycle.- Maintain BI platforms, optimize performance, and ensure accuracy and consistency of https://jobeax.com/link/kCClhAuUGzf1T34c & Skills :- 10 - 13 years of experience in Data & Analytics, with 5+ years of hands-on experience in Azure data engineering technologies.- Strong hands-on expertise in Python, SQL, and PySpark.- Strong experience with Databricks Unity Catalog for data governance and security.- Strong sense of ownership, accountability, and execution discipline across multiple initiatives.- Excellent communication skills, with the ability to effectively engage and manage business stakeholders. (ref:hirist.tech)
... :- 8+ years of experience in Data Engineering, Big Data, or related technologies.- Strong hands-on experience with Azure Databricks.- Excellent knowledge of PySpark and Apache Spark.- Strong programming experience in Python.- Strong experience developing ETL/ELT data pipelines.- Hands-on experience with Azure Data Lake ...
... Responsibilities : - Design, develop, and maintain scalable data pipelines using Azure Databricks, PySpark, and Spark SQL.- Build and orchestrate complex, parameterized data pipelines using Azure Data Factory (ADF).- Develop and implement end-to-end data engineering solutions using Azure Data Lakehouse and Medallion Architecture.- ...
... high-performance data pipelines using Python and PySpark within AWS cloud environments.- Proven ability to manage and query large-scale datasets using both SQL and NoSQL databases, with a focus on performance optimization.- Strong proficiency in container orchestration using Kubernetes to manage and scale data-intensive workloads.- ...
... in Data Engineering and building enterprise-scale data platforms.- Strong proficiency in Python and PySpark.- Hands-on experience with Azure data services and Databricks.- Experience designing and developing ETL/ELT data pipelines.- Strong understanding of data engineering concepts, distributed computing, and data architecture.- ...
... https://jobeax.com/link/HwwG40NHoRUUleVl with data processing frameworks and platforms (Hadoop, Presto, Tez, Hive, Spark etc.Hands-on experience in work with bigdata platforms and related programming languages (https://jobeax.com/link/UVPpUiV6Uuv02TIK, Python, PySpark, GIT, Jenkins).Behavioral Competencies : Business Acumens ...
Job Summary : We are seeking an experienced Senior Data Engineer with strong expertise in Databricks, Apache Airflow, SQL, and Python to design and optimize data pipelines, ETL workflows, and cloud-based data solutions. The ideal candidate will have deep experience in big data processing, cloud-based analytics, and automation ...
... years of experience as a Data Engineer, with a focus on ADF, Pyspark, Python, and SQL.- Proficiency in SQL and experience with programming languages such as Python or Scala.- Familiarity with Azure data services, including Azure Data Lake, Azure SQL Database, and Azure Synapse Analytics.- Strong analytical and problem-solving ...
... years of professional experience in data engineering or related software development roles. - Core Programming: Proficiency in Python and Scala for developing data-intensive applications. - Big Data Technologies: Strong expertise in PySpark for distributed data processing and analytics. - Data Engineering: Demonstrated ability ...
... and analyze large-scale datasets from distributed storage environments.- Build and maintain robust data pipelines using Python and Spark to ensure high-quality data availability for downstream engineering and research teams.- Collaborate with autonomous vehicle domain experts to identify data gaps and implement automated ...
Role Overview :We are seeking a Senior Data Engineer to drive cloud data modernization and build scalable, AI-ready data platforms. This role emphasizes expertise in Databricks, PySpark, Azure Data Factory, Logic Apps, and Airflow, with a strong focus on orchestration, pipeline reliability, and end-to-end data workflow ...