Senior Data Engineer - Azure Databricks in Hyderabad, India - Jobeax
Vacancy description
Senior Data Engineer - Azure Databricks in Hyderabad, भारत
US TECHNOLOGY INTERNATIONAL PRIVATE LIMITED
Hyderabad, भारत
Job Overview : We are seeking a highly experienced Senior Data Engineer to design, develop, and optimize scalable data pipelines in a cloud-based https://jobeax.com/link/2rce0yCTCWx0P6oA ideal candidate will have deep expertise in PySpark, SQL, Azure Databricks, and experience with either AWS or GCP.A strong foundation in data warehousing, ELT/ETL processes, and dimensional modeling (Kimball/star schema) is essential for this https://jobeax.com/link/ZNQqU5E5annp3g9v Requirements : - Strong proficiency in PySpark and SQL for data transformation and pipeline development.- Experience working in Azure Databricks or equivalent Spark-based cloud platforms.- Practical knowledge of cloud data environments - Azure, AWS, or GCP.- Solid understanding of data warehousing concepts, including Kimball methodology and star/snowflake schema design.- Proven experience designing and maintaining ETL/ELT pipelines in production.- Familiarity with version control (e.g., Git), CI/CD practices, and data pipeline orchestration tools (e.g., Airflow, Azure Data Factory).- Experience in the financial domain or understanding of investment banking https://jobeax.com/link/C0Mci7VFqmf0Rl7S Experience : 7 to 9 years. (ref:hirist.tech)
... Responsibilities : - Design, develop, and maintain scalable data pipelines using Azure Databricks, PySpark, and Spark SQL.- Build and orchestrate complex, parameterized data pipelines using Azure Data Factory (ADF).- Develop and implement end-to-end data engineering solutions using Azure Data Lakehouse and Medallion Architecture.- ...
Role : Senior Data Engineer - Azure, Databricks & GenAIAbout the Role : We are looking for a Senior Data Engineer to design, build, and operate an enterprise-scale data platform on Microsoft Azure and Databricks, with strong hands-on experience in Generative AI, LLMs, and RAG-based https://jobeax.com/link/uTkIfl1tAHKRWQPa ...
Role Overview :We are seeking a Senior Data Engineer to drive cloud data modernization and build scalable, AI-ready data platforms. This role emphasizes expertise in Databricks, PySpark, Azure Data Factory, Logic Apps, and Airflow, with a strong focus on orchestration, pipeline reliability, and end-to-end data workflow ...
... scalable ETL/ELT pipelines to integrate disparate data sources, ensuring high data quality and availability for downstream analytics.- Develop and optimize complex data models within Snowflake and Databricks environments to support high-performance reporting and business intelligence requirements.- Collaborate with engineering ...
... concepts.- Strong understanding of Data Structures and Algorithms (DSA) fundamentals.- Strong SQL skills and experience working with relational and analytical data.- Experience working with Microsoft Azure and Azure-based data engineering services.- Strong understanding of data warehousing, data modelling, ETL/ELT, and data ...
... with multi-source and multi-country data environments- Support data modelling across Student, Test, Application, Institution, Agent and Payment domains- Work on Azure Databricks Lakehouse environments- Support Bronze, Silver and Gold data layers- Apply SCD Type 2 modelling techniques- Collaborate with data engineering and ...
... maintain scalable data transformation pipelines using Python (with tools like PySpark, ADF) and SQL in Azure Databricks.- Implement transformation logic to move data from Bronze to Silver/Gold layers following data engineering best practices.- Apply strong data engineering principles to ensure data reliability, quality, performance, ...
Bangalore, भारत
View vacancy
HOLLISTER GLOBAL BUSINESS SERVICES INDIA PRIVATE L
... Mentor junior and mid-level data engineers and contribute to technical https://jobeax.com/link/tUNKhTSumiAniKVx Skills & Experience :- 8+ years of experience in Data Engineering, Big Data, or related technologies.- Strong hands-on experience with Azure Databricks.- Excellent knowledge of PySpark and Apache Spark.- Strong programming ...
Role Overview:Seeking a highly skilled Senior Data Engineer with deep expertise in Databricks, Real-Time Data Processing, Lakehouse Architecture, and AI-driven solutions. The role involves designing, developing, and supporting scalable data platforms and streaming pipelines, leveraging modern Databricks capabilities such ...