Consultant Data Engineer - Azure Databricks in Bengaluru,… - Jobeax
Vacancy description
Consultant Data Engineer - Azure Databricks in Bengaluru, India
India, Bengaluru
Consultant Data Engineer - Azure Databricks in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
Consultant Data Engineer DatabricksLocation : Bangalore, Hyderabad, GurgaonExperience : 4 to 8 YearsEmployment Type : Full-timeJob Summary : We are looking for an experienced Consultant Data Engineer Databricks with 4 to 8 years of experience in designing, developing, and optimizing scalable data engineering solutions on Azure and Databricks. The ideal candidate should have strong hands-on experience with PySpark, Azure Data Factory (ADF), Databricks, ETL pipelines, SQL, and cloud-based data https://jobeax.com/link/tlplQAnK5B36KMXq Responsibilities : - Design, develop, and maintain scalable ETL/ELT data pipelines using Azure and Databricks.- Develop and optimize data processing solutions using PySpark.- Build and manage data pipelines using Azure Data Factory (ADF).- Work with Databricks for data ingestion, transformation, processing, and optimization.- Write complex and optimized SQL queries for data extraction and transformation.- Implement data integration solutions across multiple data sources.- Perform data cleansing, transformation, validation, and quality checks.- Troubleshoot and optimize data pipelines for performance, reliability, and scalability.- Collaborate with data architects, developers, business teams, and clients to understand requirements.- Participate in technical discussions and contribute to solution design.- Ensure adherence to data engineering best practices, coding standards, and project requirements.- Support deployment, monitoring, and troubleshooting of data engineering solutions across https://jobeax.com/link/72xljNf4GfrhBYcv Skills : - 48 years of relevant experience in Data Engineering.- Strong hands-on experience with Databricks.- Strong proficiency in PySpark.- Hands-on experience with Azure Data Factory (ADF).- Strong knowledge of ETL/ELT concepts and data pipeline development.- Strong SQL skills.- Good understanding of Microsoft Azure data services.- Experience working with large datasets and distributed data https://jobeax.com/link/GtFiATZzFkWlSrud Qualifications : - Experience with Azure-based data engineering projects.- Knowledge of data lake/data warehouse concepts.- Experience in performance tuning of Spark/Databricks jobs.- Experience working in client-facing consulting https://jobeax.com/link/D97KR0fNczjlIZqw Skills : Databricks, PySpark, Azure Data Factory, ETL, Azure, SQL, Data Engineering (ref:hirist.tech)
... experience in data engineering or data application development (ETL/ELT/BI) - 2+ years of experience in cloud-based data platform development - Expertise in building Azure-based data pipelines, including: - Azure Data Factory / Synapse - DataBricks / Synapse Spark Pool - Cosmos DB - Azure Data Lake Storage (ADLS) - Dedicated SQL ...
... Knowledge of data security patterns: PII masking, tokenization, column/row-level security Informatica, ODI, or SSIS exposure Education & Certifications Bachelor's/Master's in Computer Science, Engineering, or equivalent AWS Certified Data Engineer, AWS Solutions Architect, Databricks, or Snowflake certifications are a plus
Data Engineer III/ IV - IN (Operation/ Supports) Work Location - Remote Work From Home Shift: Rotation Shifts (24/7) Experience: 7-12 years The Data engineer is responsible for managing and operating upon Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI/Tableau. The engineer will work closely with the customer ...
... enhancement, and production support of enterprise applications built using https://jobeax.com/link/6WcBICn0LM558SP0, https://jobeax.com/link/JSd7UYCSg572jJDY, Databricks, and AWS, while driving engineering best practices, automation, and team https://jobeax.com/link/AtRBdjzDZvZmLq7q Responsibilities : - Lead the design, ...
... support data-driven decision-making. Develop and maintain data pipelines using Databricks and other ETL tools. Collaborate with cross-functional teams to define data requirements and ensure data quality. Create and maintain dashboards and reports to visualize key metrics and trends. Perform data modeling and data integration ...
Role OverviewWe are seeking a high-caliber Data Migration Consultant Developer with proven expertise in Guidewire Data Migration methodology and tools . The ideal candidate must hold a Mammoth Certification (Data Migration Track) and bring extensive, hands-on experience in migrating client data from legacy Policy systems ...
... evaluating and implementing data-engineering and software technologies - In addition, you have experience in programming languages and frameworks: SQL, Python, Spark, Databricks (Delta Lake) - Experience in data storages - SQL and NoSQL databases, Azure Data Lake Storage- and in developing data solutions, models, API and software ...
... concepts. - Familiarity with Git. - Eagerness to learn Databricks, Power BI, and related tools quickly. - Interest in statistics, experimentation, feature engineering, or applied data science. - Exposure to Azure Cloud services such as Azure Data Lake, Azure Databricks, Azure Functions, or Azure DevOps. - Exposure to Power ...
... and translate business questions into technical solutions Champion data quality, governance and security in all BI processes Monitor, troubleshoot and enhance data workflows for reliability and performance Stay current with best practices in BI and data engineering, including new Power BI features and Databricks capabilities. ...
... part of a team of smart, highly skilled technologists who are passionate about learning and supporting cutting-edge technologies such as Spark, Scala, Pyspark, Databricks, Airflow, SQL, Docker, Kubernetes, and other Data engineering tools. These technologies are deployed using DevOps pipelines leveraging Azure, Kubernetes, ...
... existing business processes, identify gaps, and recommend data-driven improvements. - Build modern real-time data solutions using Scala , Apache Spark , and Azure Databricks . - Partner with data scientists and business stakeholders to operationalize machine learning models. - Champion data governance, metadata management, ...
... PySpark Experienced in Azure Data bricks, Azure Blob Storage, Azure Data Lake, Delta lake. Experience working with Spark SQL Experience in creating pipelines and databricks dashboards Experience with Azure cloud environments Experience with acquiring and preparing data from primary and secondary disparate data sources Experience ...
... Directory/LDAP Experience with Network Applications, SQL Server, ODBC NET, SQL Server Mathematics background to develop implementation of signal processing or data analysis algorithms Proficiency with web/cloud application development Certification as a software developer, architect or Azure development Experience with design ...
... integration. Ability to design scalable and maintainable code that meets business requirements. Familiarity with data processing and analytics workflows within modern data platforms. Additional Information: The candidate should have minimum 2 years of experience in Databricks Unified Data Analytics Platform. This position is based ...
... deeply embedded with our named strategic accounts, serving as a trusted long-term technical advisor while also collaborating with internal sales, product, and engineering teams. You will help our customers achieve tangible data-driven outcomes through the Databricks Data Intelligence Platform, helping data teams complete projects ...
... and root cause analysis. Tool Proficiency: High proficiency in Power BI for dashboard development and Excel for modeling and analysis. Experience with large datasets and platforms like Azure Databricks is a plus. Active certification as a Certified Professional Scrum Master (PSM I) or equivalent, with practical experience ...
... our clients receive seamless, optimized, and secure cloud https://jobeax.com/link/f7cnnjsAzvrL3710 Leadership :- Deep technical understanding of any cloud or data platform (Azure, AWS, Google Cloud, Snowflake, Databricks).- Hands on experience with & Operational Excellence :- Establish, track, and report on client-facing ...