Data Engineer - Azure Databricks in Gurugram, India

... years of experience in data engineering, cloud data platform design, or enterprise data architecture, with at least 5+ years of strong hands-on experience on Databricks and Azure. - Bachelor's degree in computer science, Information Technology, Engineering, or a related discipline; master's degree is preferred. - Strong ...

• Hybrid

... responsibilities will include estimating, designing, coding, testing, deploying, and ensuring scalability and performance on Azure using key technologies like Databricks. As a hands-on technologist with an extensive data engineering background using Databricks , you will be joining a group of Data Engineers who are passionate ...

... Cloud/Infra: Azure, AKS, Docker, Helm- ML/Data: Databricks ML, Delta Lake, MLflow, PySpark, PostgreSQL, Redis, ADLS Gen2Required Skills:- 4+ years of ML/AI engineering or DevOps experience.- Strong production MLOps pipeline experience.- Strong Jenkins and Azure DevOps experience.- Knowledge of Azure/AWS/GCP. (ref:hirist.tech)

... https://jobeax.com/link/JpsOC0VrTgitAlOy : - Lead the development of backend microservices using Django.- Design and implement scalable and secure APIs.- Integrate Azure Cloud services for application deployment and management.- Utilize Azure Databricks for big data processing and analytics.- Implement data processing pipelines ...

... managing large-scale data pipelines - Strong proficiency in Python, PySpark, Spark, Databricks, Delta Lake, PowerBI and SQL, with hands-on experience using - Azure Data Factory, Azure Pipelines, Azure DevOps, and Git for version control. - Proven experience working with Azure Databricks and PySpark/Spark for data engineering ...

... Engineer will own the end-to-end operationalisation of machine learning, large language model (LLM), and agentic AI workloads on the Bajaj Finance Enterprise Data Platform — a 5PB+ medallion lakehouse built on Azure Databricks and Unity Catalog. This role sits at the intersection of data engineering, model lifecycle management, ...

12k

... order to reach more people, more effectively. Join our team as a Azure DevOps Engineer , where you will design, deploy, and manage secure and scalable Microsoft Azure cloud infrastructure. You will work across Azure networking, PaaS services, Azure DevOps, Terraform, CI/CD, and DevSecOps while collaborating with development, ...

20k

... of 12 years of hands-on experience in a technical support or engineering role related to Databricks Data Intelligence platform, cloud data platforms, or big data technologies. - Technical Skills: A deep understanding of Databricks architecture and Apache Spark™, along with experience in cloud platforms like AWS, Azure, ...

... generation (RAG) systems Develop and optimize prompts, evaluation frameworks, and guardrails for LLM-powered applications Engineer scalable data and ML pipelines in Databricks using PySpark, Delta Lake, and MLflow Deploy, monitor, and maintain models in production on Azure (Azure AI Foundry, Azure OpenAI, Azure Functions, AKS), ...

... details related to data engineering or a relevant https://jobeax.com/link/cwwOL3BLJkve6nkU Skills :- Azure Databricks, Python, pyspark, sql, ADF- Proficiency in data pipeline design and implementation- Strong understanding of data factory and orchestration toolsPreferred Skills:- Familiarity with advanced data processing techniques- ...

... requirements gathering, data modeling, data quality, KPI definition, and documentation, with good familiarity with the Microsoft Azure data ecosystem, including Azure Data Lake Storage (ADLS), Databricks, and https://jobeax.com/link/j3WgPR0DTvzAqnqy role requires close collaboration with business stakeholders, data engineers, architects, ...

• On-site

... on-premises to cloud Spark code optimization and Medallion Architecture. Strong knowledge of Databricks and its components, including Delta Live Table (DLT) pipeline implementations. Familiarity with AWS services (experience with additional cloud platforms like GCP or Azure is a plus). AWS/GCP/Azure Data Engineer Certification.

... experience in data engineering or data application development (ETL/ELT/BI) - 2+ years of experience in cloud-based data platform development - Expertise in building Azure-based data pipelines, including: - Azure Data Factory / Synapse - DataBricks / Synapse Spark Pool - Cosmos DB - Azure Data Lake Storage (ADLS) - Dedicated SQL ...

... DevOps methodologies. - ETL or ELT: Azure Data Factory, Databricks, Synapse, dbt (any two – Mandatory). Data Warehousing: Azure SQL Server/Redshift/Big Query/Databricks/Snowflake (Anyone - Mandatory). Data Visualization: Looker, Power BI, Tableau (Basic understanding to support stakeholder queries). Cloud: Azure (Mandatory), ...

• On-site

... automation. - Bachelor's degree or equivalent experience. - Jenkins - Git, CI/CD - Ansible, PowerShell - Python, IaC - security scanning, secrets management - Windows/Linux. Skills: python,cd,powershell,linux,ci,automation,infrastructure,azure,windows,platform engineer,jenkins,ansible,devops,devops engineer,iac,on premises

... management tools (Azure Boards/Jira). Bachelor's degree in Computer Science, Engineering, or related field; or equivalent practical experience in DevOps / Cloud Engineering. Any relevant Cloud certifications (e.g., Azure Administrator, Azure DevOps Engineer Expert, Azure Solutions Architect, or Azure Data/AI certificationsto ...

... Knowledge of data security patterns: PII masking, tokenization, column/row-level security Informatica, ODI, or SSIS exposure Education & Certifications Bachelor's/Master's in Computer Science, Engineering, or equivalent AWS Certified Data Engineer, AWS Solutions Architect, Databricks, or Snowflake certifications are a plus

• Remote

Data Engineer III/ IV - IN (Operation/ Supports) Work Location - Remote Work From Home Shift: Rotation Shifts (24/7) Experience: 7-12 years The Data engineer is responsible for managing and operating upon Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI/Tableau. The engineer will work closely with the customer ...

... enhancement, and production support of enterprise applications built using https://jobeax.com/link/6WcBICn0LM558SP0, https://jobeax.com/link/JSd7UYCSg572jJDY, Databricks, and AWS, while driving engineering best practices, automation, and team https://jobeax.com/link/AtRBdjzDZvZmLq7q Responsibilities : - Lead the design, ...

Rs 22 - 60 lakhs p.a.

... support data-driven decision-making. Develop and maintain data pipelines using Databricks and other ETL tools. Collaborate with cross-functional teams to define data requirements and ensure data quality. Create and maintain dashboards and reports to visualize key metrics and trends. Perform data modeling and data integration ...