... security, and scalability while enabling faster and more reliable software delivery. Key Responsibilities: - Hands on experience working on Databricks, creating data pipelines, transformation rules using Unity Catalog, PySpark, SparkSQL - Hands on Databricks Devs – Deployments, CICD, Performance Management - Hands on Databricks ...
... data ecosystems. Lead the design, architecture, and delivery of large-scale data engineering solutions across cloud and hybrid environments. Drive end-to-end data platform implementations encompassing data ingestion, transformation, storage, processing, governance, and consumption. Architect batch and real-time data pipelines ...
... AI-first data strategy at scale across 120M+ customer interactions. Databricks Apps & Self-Serve AI Develop and deploy internal AI-powered applications using Databricks Apps — enabling business users to interact with ML models, RAG systems, and analytics agents through governed, self-serve interfaces. Integrate Databricks ...
... Undertake processing of structured and unstructured data Development of data processing codes for automation & building scalable solutions Develop and maintain data solutions for clients / projects Communicate and interact with clients at the executive level Collaborate with data science, reporting and product development ...
... required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency. 10+ years of experience in Data Warehouse related projects and implementing multiple end-to-end DW projects in Big Data environment Experience of building data pipelines through Spark with Scala/Python/Java ...
... and monitor ETL/ELT pipelines using Apache Airflow. Programming: Proficiency in Python or Java for data processing, automation, and pipeline development. ETL & Data Integration: Designing and implementing end-to-end ETL/ELT workflows for structured and unstructured data. Database Management: Strong command of SQL; working ...
... https://jobeax.com/link/fYGlpInxuIv5PeS1 & Skills :- 4 - 7 years in data engineering: SQL, Python, ETL/ELT orchestration.- Cloud data platform experience (Azure preferred): pipelines, storage, APIs.- Strong understanding of data lake and data architecture.- Data modelling for analytics (star schema) and data quality frameworks. (ref:hirist.tech)
... and adoption using Terraform, CloudFormation Strong knowledge of AWS Services like EC2, Lambda, S3, RDS, Aurora, API Gateway, SNS & DMS Strong Experience with Data Migration tools like Goldengate, DMS, FiveTran Apply engineering knowledge, Database Observability tools and processes to identify/prevent/reduce the frequency ...
... in driving value for our customers by building data solutions. You'll be carrying out data engineering tasks to build, maintain, test and optimise a scalable data architecture, as well as carrying out data extractions, transforming data to make it usable to data analysts and scientists, and loading data into data platforms. ...
... instill empathy in your team to effectively address queries and help learners make timely decisions. You don't rely on just talk — your training and auditing are process-driven, consistent, and data-backed. You have a proven track record in driving sales performance and meeting targets. You maintain high integrity and ensure ...
... machine learning by following industry best practices and staying up to date with and extending the state-of-the-art in Machine Learning Research. Integrate data science solutions into current business processes. Develop and recommend process standards and best practices in Machine Learning as applicable to the retail ...
... extract valuable insights and identify trends/patterns. Develop and implement predictive and prescriptive models to support business decision-making. Ensure data quality and integrity throughout the analysis process. Working with huge and varied datasets to find sources of strategic advantage in go-to-market and execution, ...
... extract valuable insights and identify trends/patterns. Develop and implement predictive and prescriptive models to support business decision-making. Ensure data quality and integrity throughout the analysis process. Working with huge and varied datasets to find sources of strategic advantage in go-to-market and execution, ...
... Banks data related policies, standards, practices, processes and ensure adherence to the same. JR Monitoring of Data Management/Governance Policies, Procedures, Processes, Standards and Control Providing inputs and recommendation on Data practices, Data definitions and Data Quality Escalation of any data governance related ...
... Manage RBAC, user onboarding & access provisioning- Perform backfills, reprocessing and schema adjustments- Support source ingestion through APIs, batch jobs, database replication & Kafka- Set up and maintain monitoring/observability for data pipelines- Support ML pipelines, Airflow workflows and production data science ...
... Manage RBAC, user onboarding & access provisioning- Perform backfills, reprocessing and schema adjustments- Support source ingestion through APIs, batch jobs, database replication & Kafka- Set up and maintain monitoring/observability for data pipelines- Support ML pipelines, Airflow workflows and production data science ...
... and results-driven Data Engineer to join our growing Data Engineering team. You will be instrumental in ingesting, transforming, and delivering high-quality data to enable data-driven decision-making for our clients. This role is ideal for someone who thrives in a consulting environment, enjoys solving complex data challenges, ...
Consultant Data Engineer Databricks | Azure | PySpark | Spark SQL - Bengaluru / Hyderabad / GurugramLooking for an experienced Data Engineer with strong expertise in Azure Databricks, PySpark, Spark SQL, Azure Data Factory (ADF), ADLS, ETL, and SQL. You will design scalable data pipelines, build modern Lakehouse solutions, ...
Consultant Data Engineer Databricks | Azure | PySpark | Spark SQL - Bengaluru / Hyderabad / GurugramLooking for an experienced Data Engineer with strong expertise in Azure Databricks, PySpark, Spark SQL, Azure Data Factory (ADF), ADLS, ETL, and SQL. You will design scalable data pipelines, build modern Lakehouse solutions, ...