... focus on Java, Microservices and Kafka Java Microservices Back end Developer Java Sprint boot Microservices with expected knowledge of Kafka, Basic knowledge of Database. Experience with TDD and BDD. Must have experience with one of cloud (GCP, AWS or Azure). Also experience with Kubernetes and containers - Hands-on experience ...
... Responsibilities: Design, develop, and maintain scalable ETL/ELT pipelines. Build and optimize data warehouses, data lakes, and data models. Develop highly available data ingestion and processing systems for large datasets. Collaborate with cross-functional teams to deliver data solutions. Ensure data quality, performance, reliability, ...
Role Overview : We are seeking a seasoned Data Engineering professional to spearhead our data architecture initiatives and drive the evolution of our analytical ecosystem. In this role, you will be responsible for designing robust data models and optimizing our Snowflake-based data warehousing environment to support complex ...
Project Role: Associate Data Team Lead/Data Team Lead Work Experience: 8+ Years. Work Mode: Hybrid/Homebased Clinical data management, Rave, SSU experience. Shift Timings: 5:00 am -2:00 pm / 2:00 pm – 11:00 pm The shift assignment is purely based on project requirements and the candidate must be open to working in either ...
... and convenience in a seamless digital experience. Collaboration with Data Engineering Team Partner closely with our Data Engineering team to ensure efficient data collection, storage, and processing Collaborate in designing and optimizing data pipelines for seamless data movement Work jointly on data architecture decisions ...
... testing, and maintaining architectures such as databases and large-scale processing systems, ensuring that architectures support data analytics, and preparing data for prescriptive and predictive modeling. Data engineers also develop data set processes for data modeling, mining, and production, integrate new data management ...
... operating in environments with variable network connectivity. Data Architecture & Edge Ecosystem Design Design, build, and maintain a highly resilient, scalable data architecture capable of syncing, storing, and processing massive datasets from both centralized cloud services and distributed edge devices (battery swap stations ...
... affordable healthcare. Build and manage digital analytics datasets and reporting solutions Develop data pipelines and analytical reporting frameworks Support data validation, UAT, process improvements, and analytics initiatives. Experience & Qualification: Python Power BI & Dashboard Development Data Modeling & Data Validation ...
Consultant Data Engineer Databricks | Azure | PySpark | Spark SQL - Bengaluru / Hyderabad / GurugramLooking for an experienced Data Engineer with strong expertise in Azure Databricks, PySpark, Spark SQL, Azure Data Factory (ADF), ADLS, ETL, and SQL. You will design scalable data pipelines, build modern Lakehouse solutions, ...
... model monitoring approaches - Strong understanding of data engineering and model integration patterns, including working with SQL, batch pipelines, streaming data, APIs, and application services - Familiarity with observability and operational tooling such as Azure Monitor, Application Insights, MLflow tracking, Datadog, ...
... Bachelor's degree (preferably in Computer Science, Mathematics, Data Science, or a related field). - 3-6 years of overall experience in software development and data analysis. - Hands-on experience in Python for application development. - Strong proficiency in SQL for data analysis and query generation. - Experience with hosted ...
... solutions for our clients. Instead, you'll be out in the open water, shaping the future with brilliant minds. We are looking for a Lead Data Scientist who can own data science engagements end to end, from shaping the problem with the client to delivering and operationalizing ML solutions. You will lead a team of data scientists, ...
... lifecycle. Design and build scalable backend services, REST APIs, integrations, and reusable software components using Python and, where relevant TypeScript. Develop data ingestion, transformation, service-to-service communication, and automation capabilities that support reliable product experiences. Contribute to AI-enabled features ...
... application development to join our team. The role involves managing development of FastAPI based applications to run large data modeling, and leveraging the Databricks platform. The ideal candidate will have a robust background in backend development, Data science model basics, and cloud-based solutions to drive data-driven ...
... (Extract, Transform, Load) scripts to move data across various systems. Database Management: Write basic SQL queries, create tables, and interact with PostgreSQL databases to support data storage and retrieval. Data Orchestration: Help schedule, monitor, and troubleshoot automated data workflows using Apache Airflow. Stream ...
... strong hands-on experience with AWS data services and distributed data processing, along with a solid understanding of data modelling, streaming architectures, data quality, and pipeline optimisation. Requirements KEY RESPONSIBILITIES Design, develop, and maintain end-to-end data pipelines for high-volume data ingestion, ...
... data ingestion pipelines leveraging Databricks, Airflow, Kafka, and Terraform. Ensure high performance, reliability, and efficiency by optimizing large-scale data pipelines. Develop data processing workflows using Databricks, Delta Lake, and Spark technologies. Maintain and improve the Data Lakehouse, utilizing Unity Catalog ...
... non-technical stakeholders why data is or is not ready, and that conversation matters as much as the pipeline. Useful, Not Essential - Manufacturing or industrial data experience - Kafka, Debezium or other change-data-capture tooling - Metadata catalogue and governance tooling - Experience defining acceptance criteria on a client ...
... management plans and documentation, ensuring compliance with industry standards and regulatory requirements. - Participate in the identification and resolution of data discrepancies and issues, working to streamline data flow and enhance data quality throughout the study lifecycle. - Collaborate closely with cross-functional ...