... performant Use AI tooling within DE workflows, including code generation, pipeline automation, and data quality checks Contribute to and help shape company-wide data governance standards Collaborate with analytics, BI, and business teams to deliver trusted, well-modeled data 5–7 years of hands-on data engineering experience ...
... security, and scalability while enabling faster and more reliable software delivery. Key Responsibilities: - Hands on experience working on Databricks, creating data pipelines, transformation rules using Unity Catalog, PySpark, SparkSQL - Hands on Databricks Devs – Deployments, CICD, Performance Management - Hands on Databricks ...
... data ecosystems. Lead the design, architecture, and delivery of large-scale data engineering solutions across cloud and hybrid environments. Drive end-to-end data platform implementations encompassing data ingestion, transformation, storage, processing, governance, and consumption. Architect batch and real-time data pipelines ...
... policies, spot-instance strategies, DBU budget alerts, and compute right-sizing recommendations to optimise the platform spend within approved budgets. Partner with Data Scientists, AI Engineers, Data Engineers, and Business stakeholders to productionise models rapidly without sacrificing quality or compliance. Establish and evangelise ...
... for a data professional to join our Data Engineering team. Independently execute data engineering projects Undertake processing of structured and unstructured data Development of data processing codes for automation & building scalable solutions Develop and maintain data solutions for clients / projects Communicate and interact ...
... Data Engineer to drive our mission to unlock potential of data assets by consistently innovating, eliminating friction in how users access data from its Big Data repositories and enforce standards and principles in the Big Data space. The candidate will be part of an exciting, fast paced environment developing Data Engineering ...
... maintain scalable data pipelines and data lake solutions on GCP. Build and automate data ingestion and transformation workflows using Airflow and BigQuery. Ensure data quality, performance, and security across all cloud environments. Collaborate with cross-functional teams to translate business needs into efficient data models. ...
... Data Management/Governance Policies, Procedures, Processes, Standards and Control Providing inputs and recommendation on Data practices, Data definitions and Data Quality Escalation of any data governance related issues identified to the senior leadership Managing change management processes in the Data Governance. Understand ...
... batch jobs, database replication & Kafka- Set up and maintain monitoring/observability for data pipelines- Support ML pipelines, Airflow workflows and production data science infrastructureIDEAL PROFILE:Looking for candidates with strong hands-on experience in:- Data Operations- Production Data Engineering- Data Platform Support- ...
... batch jobs, database replication & Kafka- Set up and maintain monitoring/observability for data pipelines- Support ML pipelines, Airflow workflows and production data science infrastructureIDEAL PROFILE:Looking for candidates with strong hands-on experience in:- Data Operations- Production Data Engineering- Data Platform Support- ...
... Data Factory) to schedule and monitor complex workflows.- Apply CI/CD and Git-based workflows for version-controlled, automated deployments.- Collaborate with data analysts, data scientists, and architects to deliver clean, validated datasets.- Support consulting engagements through clear documentation, client-ready demos, ...
... Design, Performance Tuning.- Data Integration : Apache Kafka, AWS DMS, REST APIs, CDC.- Metadata & Governance : Apache Atlas (preferred), Metadata Management, Data Catalog, Business Glossary, Data Lineage, Data Stewardship, Data Quality.- Business Intelligence : Tableau, Semantic Layer, KPI Frameworks, Data Mart Design, ...
Consultant Data Engineer Databricks | Azure | PySpark | Spark SQL - Bengaluru / Hyderabad / GurugramLooking for an experienced Data Engineer with strong expertise in Azure Databricks, PySpark, Spark SQL, Azure Data Factory (ADF), ADLS, ETL, and SQL. You will design scalable data pipelines, build modern Lakehouse solutions, ...
Consultant Data Engineer Databricks | Azure | PySpark | Spark SQL - Bengaluru / Hyderabad / GurugramLooking for an experienced Data Engineer with strong expertise in Azure Databricks, PySpark, Spark SQL, Azure Data Factory (ADF), ADLS, ETL, and SQL. You will design scalable data pipelines, build modern Lakehouse solutions, ...
... Engineering, or a related field. 7+ years of data engineering experience, including expertise in data integration, pipeline optimization, and enterprise-scale data solutions. - Databases: Oracle and PostgreSQL - ETL/ELT & Data Integration: Experience in maintaining and refactoring existing data pipelines - Data Warehousing ...
... insights. - Manage data connections and publish governed data sources through Tableau Server/Cloud . - Configure appropriate security, user access, permissions, and data-source settings. - Ensure data accuracy, integrity, consistency, and governance across BI assets. - Troubleshoot dashboard, data, performance, and connectivity ...
... Snowflake, dbt Cloud, Airflow, and Kafka, with deep ownership of governance, reliability, and cost. Your customers are other engineers, analytics engineers, data scientists, and operations teams. The platform you build is what makes their work possible. If you enjoy building developer-facing platforms, operating distributed ...
... & Data Platform. You’ll design and maintain reliable, secure, and scalable data pipelines and models that power a new generation of reporting, insights, and data-driven products across the StarRez ecosystem. This role sits at the intersection of data, product, and engineering. You will work closely with Data Analysts, ...
Role Overview:Seeking a highly skilled Senior Data Engineer with deep expertise in Databricks, Real-Time Data Processing, Lakehouse Architecture, and AI-driven solutions. The role involves designing, developing, and supporting scalable data platforms and streaming pipelines, leveraging modern Databricks capabilities such ...
... scientists, statisticians, data scientists, and behavioral methodologists This job description outlines the responsibilities and qualifications for a Data Scientist role with a primary focus on Statistics, Research methodologies, Sampling, ANOVA, and the application of these principles within Machine Learning and Data ...