... and maintain scalable batch and real-time data pipelines for fraud analytics. Develop and optimize Spark-based data processing frameworks. Implement efficient data ingestion frameworks and integrate multiple data sources. Build and support Snowflake data warehouse and data lake solutions. Develop data models for reporting, ...
... Cloud Data Migration Leadership : Lead cloud migration projects, developing scalable Spark pipelines. Implement Bronze, Silver, and gold tables for scalable data systems. Optimize Spark code to ensure efficient cloud migration. Data Modeling : Develop and maintain data models with strong governance practices. Data Cataloging ...
... processes. - Experience translating business requirements into features, user stories, data requirements, and acceptance criteria. - Hands-on experience with data validation, reconciliation, source-to-target mapping, UAT, and defect management. - Understanding of data flows, cloud platforms, data repositories, and reporting/visualization ...
... contributing to large-scale data projects on Google Cloud Platform. You will work closely with senior engineers and data analysts to build and maintain robust data pipelines, helping to turn raw data into actionable https://jobeax.com/link/d6zqLcygnqsI43u7 Responsibilities:- Develop, test, and maintain data pipelines and ...
... Skills Deep knowledge of statistics and mathematics, with experience designing rigorous analyses, testing assumptions and interpreting complex results. Strong data-wrangling and cleaning skills, including working with large or imperfect datasets, resolving quality issues and developing reproducible data pipelines. Strong ...
... application development to join our team. The role involves managing development of FastAPI based applications to run large data modeling, and leveraging the Databricks platform. The ideal candidate will have a robust background in backend development, Data science model basics, and cloud-based solutions to drive data-driven ...
... focus on Java, Microservices and Kafka Java Microservices Back end Developer Java Sprint boot Microservices with expected knowledge of Kafka, Basic knowledge of Database. Experience with TDD and BDD. Must have experience with one of cloud (GCP, AWS or Azure). Also experience with Kubernetes and containers - Hands-on experience ...
... Responsibilities: Design, develop, and maintain scalable ETL/ELT pipelines. Build and optimize data warehouses, data lakes, and data models. Develop highly available data ingestion and processing systems for large datasets. Collaborate with cross-functional teams to deliver data solutions. Ensure data quality, performance, reliability, ...
Role Overview : We are seeking a seasoned Data Engineering professional to spearhead our data architecture initiatives and drive the evolution of our analytical ecosystem. In this role, you will be responsible for designing robust data models and optimizing our Snowflake-based data warehousing environment to support complex ...
Project Role: Associate Data Team Lead/Data Team Lead Work Experience: 8+ Years. Work Mode: Hybrid/Homebased Clinical data management, Rave, SSU experience. Shift Timings: 5:00 am -2:00 pm / 2:00 pm – 11:00 pm The shift assignment is purely based on project requirements and the candidate must be open to working in either ...
... operating in environments with variable network connectivity. Data Architecture & Edge Ecosystem Design Design, build, and maintain a highly resilient, scalable data architecture capable of syncing, storing, and processing massive datasets from both centralized cloud services and distributed edge devices (battery swap stations ...
... affordable healthcare. Build and manage digital analytics datasets and reporting solutions Develop data pipelines and analytical reporting frameworks Support data validation, UAT, process improvements, and analytics initiatives. Experience & Qualification: Python Power BI & Dashboard Development Data Modeling & Data Validation ...
Join Data Eminence as a remote Data Analyst and help transform raw data into meaningful insights that support informed business decisions. You'll collect, clean, analyze, and visualize data while identifying trends, patterns, and opportunities. This role is ideal for entry-level candidates with strong analytical skills, ...
... model monitoring approaches - Strong understanding of data engineering and model integration patterns, including working with SQL, batch pipelines, streaming data, APIs, and application services - Familiarity with observability and operational tooling such as Azure Monitor, Application Insights, MLflow tracking, Datadog, ...
... Bachelor's degree (preferably in Computer Science, Mathematics, Data Science, or a related field). - 3-6 years of overall experience in software development and data analysis. - Hands-on experience in Python for application development. - Strong proficiency in SQL for data analysis and query generation. - Experience with hosted ...
... solutions for our clients. Instead, you'll be out in the open water, shaping the future with brilliant minds. We are looking for a Lead Data Scientist who can own data science engagements end to end, from shaping the problem with the client to delivering and operationalizing ML solutions. You will lead a team of data scientists, ...
... lifecycle. Design and build scalable backend services, REST APIs, integrations, and reusable software components using Python and, where relevant TypeScript. Develop data ingestion, transformation, service-to-service communication, and automation capabilities that support reliable product experiences. Contribute to AI-enabled features ...
... application development to join our team. The role involves managing development of FastAPI based applications to run large data modeling, and leveraging the Databricks platform. The ideal candidate will have a robust background in backend development, Data science model basics, and cloud-based solutions to drive data-driven ...
... (Extract, Transform, Load) scripts to move data across various systems. Database Management: Write basic SQL queries, create tables, and interact with PostgreSQL databases to support data storage and retrieval. Data Orchestration: Help schedule, monitor, and troubleshoot automated data workflows using Apache Airflow. Stream ...
... strong hands-on experience with AWS data services and distributed data processing, along with a solid understanding of data modelling, streaming architectures, data quality, and pipeline optimisation. Requirements KEY RESPONSIBILITIES Design, develop, and maintain end-to-end data pipelines for high-volume data ingestion, ...