Back to list

Vacancy description

Lead Azure Data Engineer - ETL/Python in Bangalore, भारत

SMARTWORK IT SERVICES

Bangalore, भारत

Job Summary :Lead Azure Data Engineer with 5+ years of experience in designing and building scalable data lakes, data warehouses, and ETL pipelines using Azure Data Factory, Azure Databricks, SQL, and https://jobeax.com/link/Vk2Ax4dKU3remBk1 :- Develop, implement, and maintain the information data lake and use insight platforms to enable decision support systems.- Partner with business and customers to understand data and reporting requirements.- Bring data sets together to answer business questions and drive growth.- Design ETLs to ingest data into the data warehouse and data lake, as well as end-user facing reporting applications.- Collaborate with business customers and development teams to define requirements and deliver flexible, scalable, end-to-end solutions.- Work with new technologies while driving business intelligence solutions end-to-end: business requirements, data modelling, ETL, metadata, reporting, and dashboarding.- Apply expertise in the design, creation, management, and business use of large datasets.- Define SLA for all areas of https://jobeax.com/link/wqlHD4SkskvnzHpx Stack & Requirements:- Experience with Data modelling, SQL, ETL, Data Warehousing and Data lakes.- Experience in writing SQL and Python scripts.- Experience in building dashboards and reports using Microsoft Power BI.- Experience in transforming data using Azure Data Factory.- Experience working with Spark and Azure Databricks.- Ability to balance and prioritize multiple conflicting requirements with high attention to detail.- Strong verbal/written communication & data presentation skills.- Familiarity with scripting languages such as Python, PySpark, or JavaScript.- Knowledge of Azure Databricks and MPP databases.- Exposure to NoSQL databases (such as Cosmos DB, MongoDB).- Experience following Agile processes.- Experience working with distributed version control systems like Git.- Experience with Mulesoft/Kingswaysoft/Marketo. (ref:hirist.tech)

Similar vacancies

More like this role

Job Summary :Lead Azure Data Engineer with 5+ years of experience in designing and building scalable data lakes, data warehouses, and ETL pipelines using Azure Data Factory, Azure Databricks, SQL, and https://jobeax.com/link/Vk2Ax4dKU3remBk1 :- Develop, implement, and maintain the information data lake and use insight platforms ...

Gurgaon, भारत

Job Summary :Lead Azure Data Engineer with 5+ years of experience in designing and building scalable data lakes, data warehouses, and ETL pipelines using Azure Data Factory, Azure Databricks, SQL, and https://jobeax.com/link/Vk2Ax4dKU3remBk1 :- Develop, implement, and maintain the information data lake and use insight platforms ...

Hyderabad, भारत

  • Hybrid
  • Backend
... manage cloud resources within the Azure environment, ensuring optimal performance, security, and cost-effectiveness for enterprise applications.- Collaborate with data engineers to design robust ETL pipelines that ensure data integrity and availability across various cloud-hosted databases.- Troubleshoot and resolve technical ...

Hyderabad, भारत

RANDOMTREES PRIVATE LIMITED

Azure Data Engineer - ETL Development

... https://jobeax.com/link/Bf9g48PT6fDmqfC0 :- 6 - 11 years of experience in data engineering, with hands-on experience building large-scale data pipelines.- Strong experience with Azure Data Factory or similar Azure data integration tools.- Proficiency in Azure Databricks and PySpark for big data processing and ETL development.- Strong SQL skills, ...

Hyderabad, भारत

... validation.- Implement automated data processing and orchestration https://jobeax.com/link/NPjYcfEkgZ7Gj84R Stack : - Data Platforms : Azure Synapse Analytics, Azure Data Factory, Databricks, Azure Data Lake Storage (ADLS Gen2)- Programming Languages : Python, SQL, PySpark- Data Orchestration : Apache Airflow, Azure Data ...

Noida, भारत

  • Data Analytics
... data analytics and data engineering.- Strong hands-on experience with SQL and Python.- Experience with ETL/ELT pipelines and data integration.- Knowledge of data modeling and data warehousing.- Experience with Power BI or Tableau for reporting and visualization.- Familiarity with cloud data platforms such as Azure, AWS, ...

Bangalore, भारत

... reliability.- Mentor engineers and collaborate with analytics, BI, and business https://jobeax.com/link/b98mNqN2dpm2gqBN Skills : - Azure Databricks- PySpark and Python- SQL and query optimization- Azure Data Factory (ADF)- Delta Lake- ETL/ELT pipeline development- Performance tuning and data architecture- Technical leadership ...

Bangalore, भारत

... data warehouse solutions.- Expertise in SQL, including developing stored procedures (SP) and applying advanced data design concepts.- Proficiency in Spark (Python/Scala) and Spark Streaming for real-time data pipelines.- Experience with AWS or Azure services (e.g., AWS Glue, Azure Data Factory, Redshift, Snowflake).- Familiarity ...

Chennai, भारत

MOVATE TECHNOLOGIES PRIVATE LIMITED

Movate - Senior Data Engineer - Python/SQL/ETL

Role : We are looking for an experienced Data Engineering professional with strong expertise in designing, building, and owning scalable data platforms. The ideal candidate will have hands-on experience in data architecture, data modeling, ETL/ELT development, and production-grade data pipeline management, with a strong ...

Bangalore, भारत

Smartstream Limited

Senior Software Engineer

  • IT
... Power BI and Tableau - Azure Data Factory and/or AWS Glue - Apache Airflow - Git, CI/CD, DevOps Preferred - Microsoft Azure Data Engineer Certification - AWS Data Analytics Certification - SnowPro Certification - Experience with Collibra, Alation, or Informatica Data Governance - Experience leading ETL modernization programs ...

Pune, भारत