Azure Data Engineer - PySpark/Databricks in Bangalore, भारत
Hawk Sense Business Solution pvt. ltd.
Bangalore, भारत
Role : Azure Data EngineerExperience : 5.5 - 8.5 YearsMandatory Skills : - Python- PySpark- Databricks- Azure Services - ADLS, Azure Data Factory (ADF), Azure Databricks (ADB)- Advanced SQLKey Responsibilities : - Design, develop, and maintain scalable ETL/ELT data pipelines.- Ensure data quality, reliability, and timely data processing.- Build and manage seamless data integration solutions across multiple systems and sources.- Develop and optimize data models for analytics and reporting.- Manage and optimize relational and NoSQL databases for performance, scalability, and security.- Work on data warehousing, data modeling, data strategy, and data quality initiatives.- Collaborate with data analysts, data scientists, and business stakeholders to deliver effective data solutions. (ref:hirist.tech)
... optimizing scalable ETL pipelines and data workflows using Databricks and Apache https://jobeax.com/link/qJHt5WugbDWc6yxl Responsibilities : 1. ETL Development & Data Engineering : - Design, develop, and maintain scalable ETL processes using Databricks PySpark.- Extract, transform, and load data from heterogeneous sources into ...
Job Description Be part of a dynamic team where your distinctive skills will contribute to a winning culture and team. As a Data Engineer III - Databricks, Pyspark, Python, AWS at JPMorgan Chase within the Commercial & Investment Bank, you'll serve as a seasoned member of an agile team to design and deliver trusted data ...
Azure Data EngineerKey Responsibilities:- Design, develop, and maintain scalable data pipelines using Azure Data Factory (ADF).- Build and optimize data processing workflows using Azure Databricks and Python.- Develop ETL/ELT processes to extract, transform, and load data from multiple sources.- Work with structured and ...
... Governance: Experience implementing data quality frameworks, data observability, and Unity Catalog-based https://jobeax.com/link/jNu8rE2vHzGnMJ64 Qualifications:- Databricks Certified Data Engineer Professional or Associate; AWS Certified Data Engineer or Azure Data Engineer Associate.- Experience delivering data platforms across ...
... optimisation and marketing mix modelling. - Monitor pipeline health, data quality and cluster cost, and tune them as needed. Must-Have Skills - 2–4 years of hands-on data engineering experience, including at least 1.5 years on Databricks. - Strong skills in PySpark, SQL and Python. - Experience with Delta Lake, including MERGE/upserts, ...
... analytics, and automation to drive efficient and scalable data engineering https://jobeax.com/link/XnflZD2dGSZYgXFG Responsibilities : - Design, develop, and optimize data pipelines using Databricks and Apache Airflow.- Implement PySpark-based transformations and processing in Databricks for handling large-scale data.- Develop and ...
... warehouse solutions, and working with Azure data services, Spark, PySpark, and SQL. Your future duties and responsibilities - Design, develop, and maintain scalable data engineering solutions using Microsoft Azure services. - Build and optimize ETL/ELT pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics. ...
... improve data processing efficiency.- Implement real-time and streaming data solutions using technologies such as Spark Streaming and Kafka.- Work with cloud-native data services and integrate Databricks with Azure or AWS environments.- Collaborate with architects, data engineers, and cross-functional teams to deliver robust data ...
... design and delivery of production data platforms from requirements to production support, work directly with clients, and share your knowledge with the wider engineering team. Your stack will include Python, SQL, PySpark, Azure Databricks or Microsoft Fabric, Azure Data Factory, Delta Lake, and Lakehouse and Data Warehouse ...