Back to list

Vacancy description

Lead Azure Data Engineer - ETL/Python in Hyderabad, भारत

SMARTWORK IT SERVICES

Hyderabad, भारत

Job Summary :Lead Azure Data Engineer with 5+ years of experience in designing and building scalable data lakes, data warehouses, and ETL pipelines using Azure Data Factory, Azure Databricks, SQL, and https://jobeax.com/link/Vk2Ax4dKU3remBk1 :- Develop, implement, and maintain the information data lake and use insight platforms to enable decision support systems.- Partner with business and customers to understand data and reporting requirements.- Bring data sets together to answer business questions and drive growth.- Design ETLs to ingest data into the data warehouse and data lake, as well as end-user facing reporting applications.- Collaborate with business customers and development teams to define requirements and deliver flexible, scalable, end-to-end solutions.- Work with new technologies while driving business intelligence solutions end-to-end: business requirements, data modelling, ETL, metadata, reporting, and dashboarding.- Apply expertise in the design, creation, management, and business use of large datasets.- Define SLA for all areas of https://jobeax.com/link/wqlHD4SkskvnzHpx Stack & Requirements:- Experience with Data modelling, SQL, ETL, Data Warehousing and Data lakes.- Experience in writing SQL and Python scripts.- Experience in building dashboards and reports using Microsoft Power BI.- Experience in transforming data using Azure Data Factory.- Experience working with Spark and Azure Databricks.- Ability to balance and prioritize multiple conflicting requirements with high attention to detail.- Strong verbal/written communication & data presentation skills.- Familiarity with scripting languages such as Python, PySpark, or JavaScript.- Knowledge of Azure Databricks and MPP databases.- Exposure to NoSQL databases (such as Cosmos DB, MongoDB).- Experience following Agile processes.- Experience working with distributed version control systems like Git.- Experience with Mulesoft/Kingswaysoft/Marketo. (ref:hirist.tech)

Similar vacancies

More like this role

Job Summary :Lead Azure Data Engineer with 5+ years of experience in designing and building scalable data lakes, data warehouses, and ETL pipelines using Azure Data Factory, Azure Databricks, SQL, and https://jobeax.com/link/Vk2Ax4dKU3remBk1 :- Develop, implement, and maintain the information data lake and use insight platforms ...

Bangalore, भारत

Job Summary :Lead Azure Data Engineer with 5+ years of experience in designing and building scalable data lakes, data warehouses, and ETL pipelines using Azure Data Factory, Azure Databricks, SQL, and https://jobeax.com/link/Vk2Ax4dKU3remBk1 :- Develop, implement, and maintain the information data lake and use insight platforms ...

Gurgaon, भारत

  • Hybrid
  • Backend
... manage cloud resources within the Azure environment, ensuring optimal performance, security, and cost-effectiveness for enterprise applications.- Collaborate with data engineers to design robust ETL pipelines that ensure data integrity and availability across various cloud-hosted databases.- Troubleshoot and resolve technical ...

Hyderabad, भारत

RANDOMTREES PRIVATE LIMITED

Azure Data Engineer - ETL Development

... https://jobeax.com/link/Bf9g48PT6fDmqfC0 :- 6 - 11 years of experience in data engineering, with hands-on experience building large-scale data pipelines.- Strong experience with Azure Data Factory or similar Azure data integration tools.- Proficiency in Azure Databricks and PySpark for big data processing and ETL development.- Strong SQL skills, ...

Hyderabad, भारत

... validation.- Implement automated data processing and orchestration https://jobeax.com/link/NPjYcfEkgZ7Gj84R Stack : - Data Platforms : Azure Synapse Analytics, Azure Data Factory, Databricks, Azure Data Lake Storage (ADLS Gen2)- Programming Languages : Python, SQL, PySpark- Data Orchestration : Apache Airflow, Azure Data ...

Noida, भारत

  • Data Analytics
... data analytics and data engineering.- Strong hands-on experience with SQL and Python.- Experience with ETL/ELT pipelines and data integration.- Knowledge of data modeling and data warehousing.- Experience with Power BI or Tableau for reporting and visualization.- Familiarity with cloud data platforms such as Azure, AWS, ...

Bangalore, भारत

... reliability.- Mentor engineers and collaborate with analytics, BI, and business https://jobeax.com/link/b98mNqN2dpm2gqBN Skills : - Azure Databricks- PySpark and Python- SQL and query optimization- Azure Data Factory (ADF)- Delta Lake- ETL/ELT pipeline development- Performance tuning and data architecture- Technical leadership ...

Bangalore, भारत

... data warehouse solutions.- Expertise in SQL, including developing stored procedures (SP) and applying advanced data design concepts.- Proficiency in Spark (Python/Scala) and Spark Streaming for real-time data pipelines.- Experience with AWS or Azure services (e.g., AWS Glue, Azure Data Factory, Redshift, Snowflake).- Familiarity ...

Chennai, भारत

MOVATE TECHNOLOGIES PRIVATE LIMITED

Movate - Senior Data Engineer - Python/SQL/ETL

Role : We are looking for an experienced Data Engineering professional with strong expertise in designing, building, and owning scalable data platforms. The ideal candidate will have hands-on experience in data architecture, data modeling, ETL/ELT development, and production-grade data pipeline management, with a strong ...

Bangalore, भारत

  • Full-time
  • IT
  • QA
... experience with ETL concepts & technologies, Data migration testing, Data warehouse testing, and BI Reporting Extensive experience in data automation using Python High level of Proficiency in writing complex SQL queries in Azure Databricks from Business requirements to read data from source DB hosted in Azure and compare ...

Bangalore, भारत