Senior Data Engineer - Azure Databricks in Hyderabad, India - Jobeax
Vacancy description
Senior Data Engineer - Azure Databricks in Hyderabad, भारत
US TECHNOLOGY INTERNATIONAL PRIVATE LIMITED
Hyderabad, भारत
Job Overview : We are seeking a highly experienced Senior Data Engineer to design, develop, and optimize scalable data pipelines in a cloud-based https://jobeax.com/link/2rce0yCTCWx0P6oA ideal candidate will have deep expertise in PySpark, SQL, Azure Databricks, and experience with either AWS or GCP.A strong foundation in data warehousing, ELT/ETL processes, and dimensional modeling (Kimball/star schema) is essential for this https://jobeax.com/link/ZNQqU5E5annp3g9v Requirements : - Strong proficiency in PySpark and SQL for data transformation and pipeline development.- Experience working in Azure Databricks or equivalent Spark-based cloud platforms.- Practical knowledge of cloud data environments - Azure, AWS, or GCP.- Solid understanding of data warehousing concepts, including Kimball methodology and star/snowflake schema design.- Proven experience designing and maintaining ETL/ELT pipelines in production.- Familiarity with version control (e.g., Git), CI/CD practices, and data pipeline orchestration tools (e.g., Airflow, Azure Data Factory).- Experience in the financial domain or understanding of investment banking https://jobeax.com/link/C0Mci7VFqmf0Rl7S Experience : 7 to 9 years. (ref:hirist.tech)
... Responsibilities : - Design, develop, and maintain scalable data pipelines using Azure Databricks, PySpark, and Spark SQL.- Build and orchestrate complex, parameterized data pipelines using Azure Data Factory (ADF).- Develop and implement end-to-end data engineering solutions using Azure Data Lakehouse and Medallion Architecture.- ...
... scalable ETL/ELT pipelines to integrate disparate data sources, ensuring high data quality and availability for downstream analytics.- Develop and optimize complex data models within Snowflake and Databricks environments to support high-performance reporting and business intelligence requirements.- Collaborate with engineering ...
We are looking for an experienced Azure Data Engineer with 8+ years of experience in Data Engineering, ETL/ELT development, Data Warehousing, and Azure Data Platform services. The ideal candidate should have strong expertise in Azure Data Factory (ADF), Azure Databricks, Azure Synapse, ADLS, Informatica PowerCenter, PySpark, ...
Job Title : Azure Data Engineer (Pyspark, Databricks, Delta lake)We are looking for a Data Engineer with 8 - 10 years of experience, including 4+ years of hands-on expertise in Azure Databricks and Azure data https://jobeax.com/link/v8qrFLRTZgSSorDg Skills : - Azure Databricks, PySpark/Scala, Spark SQL, Delta Lake- Azure ...
... with multi-source and multi-country data environments- Support data modelling across Student, Test, Application, Institution, Agent and Payment domains- Work on Azure Databricks Lakehouse environments- Support Bronze, Silver and Gold data layers- Apply SCD Type 2 modelling techniques- Collaborate with data engineering and ...
Senior Azure Data Engineer - AnalyticsExperience : 6 - 10 Years (Strict Requirement)Role Overview : We are seeking an experienced Senior Azure Data Engineer with a strong background in building scalable data pipelines, enterprise data modeling, and modern cloud architectures. The ideal candidate will bring deep expertise ...
Role : Lead - Senior Data Engineer | Azure & DatabricksLocation : MumbaiRole : Lead - Senior Data Engineer / Azure & Databricks LeadIndustry : Banking / Financial ServicesAbout the Role : IndusInd Bank is looking for an experienced Lead - Senior Data Engineer to drive the design, development, and scaling of its cloud-native ...
... Mentor junior and mid-level data engineers and contribute to technical https://jobeax.com/link/tUNKhTSumiAniKVx Skills & Experience :- 8+ years of experience in Data Engineering, Big Data, or related technologies.- Strong hands-on experience with Azure Databricks.- Excellent knowledge of PySpark and Apache Spark.- Strong programming ...
... Fiscal 2024 reported revenue is CA$14.68 billion, and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more about us at cgi.com. Job Title: Senior Azure Data Engineer / Azure Integration Specialist Experience: 6+ years in Azure Data Engineering, Azure Integration, or Azure Application Development. Job Location: ...
... unstructured data handling, data modeling, and streaming from Kafka/Event Hubs Requirements Required Qualifications: - 7-8+ years in data engineering, with deep Azure Databricks expertise for big data processing in high-demand environments - Advanced proficiency in Python/PySpark, SQL, Scala; strong data architecture and distributed ...