Senior Data Engineer - Azure Databricks in Hyderabad, India - Jobeax
Vacancy description
Senior Data Engineer - Azure Databricks in Hyderabad, भारत
US TECHNOLOGY INTERNATIONAL PRIVATE LIMITED
Hyderabad, भारत
Job Overview : We are seeking a highly experienced Senior Data Engineer to design, develop, and optimize scalable data pipelines in a cloud-based https://jobeax.com/link/2rce0yCTCWx0P6oA ideal candidate will have deep expertise in PySpark, SQL, Azure Databricks, and experience with either AWS or GCP.A strong foundation in data warehousing, ELT/ETL processes, and dimensional modeling (Kimball/star schema) is essential for this https://jobeax.com/link/ZNQqU5E5annp3g9v Requirements : - Strong proficiency in PySpark and SQL for data transformation and pipeline development.- Experience working in Azure Databricks or equivalent Spark-based cloud platforms.- Practical knowledge of cloud data environments - Azure, AWS, or GCP.- Solid understanding of data warehousing concepts, including Kimball methodology and star/snowflake schema design.- Proven experience designing and maintaining ETL/ELT pipelines in production.- Familiarity with version control (e.g., Git), CI/CD practices, and data pipeline orchestration tools (e.g., Airflow, Azure Data Factory).- Experience in the financial domain or understanding of investment banking https://jobeax.com/link/C0Mci7VFqmf0Rl7S Experience : 7 to 9 years. (ref:hirist.tech)
... Responsibilities : - Design, develop, and maintain scalable data pipelines using Azure Databricks, PySpark, and Spark SQL.- Build and orchestrate complex, parameterized data pipelines using Azure Data Factory (ADF).- Develop and implement end-to-end data engineering solutions using Azure Data Lakehouse and Medallion Architecture.- ...
Role : Senior Data Engineer - Azure, Databricks & GenAIAbout the Role : We are looking for a Senior Data Engineer to design, build, and operate an enterprise-scale data platform on Microsoft Azure and Databricks, with strong hands-on experience in Generative AI, LLMs, and RAG-based https://jobeax.com/link/uTkIfl1tAHKRWQPa ...
Role Overview :We are seeking a Senior Data Engineer to drive cloud data modernization and build scalable, AI-ready data platforms. This role emphasizes expertise in Databricks, PySpark, Azure Data Factory, Logic Apps, and Airflow, with a strong focus on orchestration, pipeline reliability, and end-to-end data workflow ...
... scalable ETL/ELT pipelines to integrate disparate data sources, ensuring high data quality and availability for downstream analytics.- Develop and optimize complex data models within Snowflake and Databricks environments to support high-performance reporting and business intelligence requirements.- Collaborate with engineering ...
... concepts.- Strong understanding of Data Structures and Algorithms (DSA) fundamentals.- Strong SQL skills and experience working with relational and analytical data.- Experience working with Microsoft Azure and Azure-based data engineering services.- Strong understanding of data warehousing, data modelling, ETL/ELT, and data ...
... Azure Data Engineer with 6 - 15 years of hands-on experience in designing, developing, and implementing scalable data engineering solutions on the Microsoft Azure platform. The ideal candidate should have strong expertise in Azure Databricks, Azure Data Factory, and PySpark, along with good exposure to Azure Synapse, Logic ...
... with multi-source and multi-country data environments- Support data modelling across Student, Test, Application, Institution, Agent and Payment domains- Work on Azure Databricks Lakehouse environments- Support Bronze, Silver and Gold data layers- Apply SCD Type 2 modelling techniques- Collaborate with data engineering and ...
Senior Software Engineer-Azure Databricks Developer Position Description Founded in 1976, CGI is among the largest independent IT and business consulting services firms in the world. With 94,000 consultants and professionals across the globe, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business ...
... maintain scalable data transformation pipelines using Python (with tools like PySpark, ADF) and SQL in Azure Databricks.- Implement transformation logic to move data from Bronze to Silver/Gold layers following data engineering best practices.- Apply strong data engineering principles to ensure data reliability, quality, performance, ...
Bangalore, भारत
View vacancy
HOLLISTER GLOBAL BUSINESS SERVICES INDIA PRIVATE L