... and maintain high-throughput, low latency systems that process 100s of millions of events per day to enable detection to identify notable events. - Establish data pipelines that ensure our data is updated regularly and reliably - Enhance our frameworks to allow us to make changes to our APIs and datasets in an agile manner ...
... Specifications (DTS) for incoming and outgoing clinical data. Performs data extraction, transformation, cleansing, and formatting activities in accordance with approved data transfer specifications. Develops, executes, and documents data validation and quality control checks to ensure data accuracy, completeness, and integrity. Performs ...
... Install, configure, and update database software and tools - Monitor and optimize database performance and capacity - Perform backup and recovery operations- Ensure database security and compliance with policies and standards - Diagnose and resolve database issues and errors - Support database development and testing activities ...
... Data Engineer ! As a Data Engineer, you will play a key role in enabling L'Oréal's data-driven transformation by designing, building, and optimizing scalable data solutions on the Google Cloud Platform (GCP) . You will develop robust data pipelines, modern data platforms, and cloud-native data architectures that power analytics, ...
... knowledge of Ontology, Pipeline Builder, Code Repositories, Workshop, Quiver, and Data Connections . - Proficiency in Python, PySpark, and SQL . - Experience in data pipelines, ETL/ELT, transformations, and data quality. - Experience integrating Foundry with cloud platforms, APIs, and databases . - Knowledge of React/TypeScript ...
... metadata repositories and data lineage documentation to track data transformations and dependencies. - Work closely with business analysts, data engineers, and data consumers to gather requirements and translate business needs into data models. - Partner with data architects to ensure data models conform to the data strategy ...
... deploy key infrastructure within the Azure Cloud supporting a wide variety of technology solutions. Working specifically with services in Azure such as Azure Data Lake, Azure Databricks, Azure SQL Data Warehouse, Azure Data Factory, Azure Service Bus, Azure Virtual Machines, Blob Storage, Azure SQL Database, Azure DNS, ...
... scraping workflows for real-world use cases. Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... scraping workflows for real-world use cases. Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... scraping workflows for real-world use cases. Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... scraping workflows for real-world use cases. Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... Cords, Network cabling, Power cabling, lager, cable tries, Power & Cooling requirements, Rack layout designing etc. - Should know about the physical site layout, power requirements, Fiber laying & planning & other infra requirement to build a Telecom site like – MSC/NSE, Data centres, Pop, ILA/LDN. - Sound knowledge of Colt’s ...
... scraping workflows for real-world use cases. Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... High Availability environments. - Perform and validate database backups, restores, and recovery. - Support disaster recovery and data recoverability. - Analyze database performance and improve stability and scalability. - Troubleshoot business-critical production database incidents. - Maintain database security, configuration, ...
... Technical Skills & Experience: - 5+ Years in Data Engineering: You've lived through the 'on-call' life and know how to build systems that don't break at 3 AM. - The Power Trio: Expert-level proficiency in Python , SQL , and PySpark . - Hands-on experience with Databricks (Delta Lake) or Snowflake . You understand the nuances of ...
... expertise in designing and managing Snowflake data warehouses, including performance tuning and resource monitoring.- Proficiency in building modular and scalable data transformations using Data Build Tool (dbt).- Advanced capability in writing complex SQL and Python scripts to manipulate large datasets and automate data processing ...
... India is seeking an experienced Data Engineer to join our Data & AI practice. You will design, build, and optimize end-to-end data solutions using Microsoft's data platforms, including Microsoft Fabric, Azure Synapse Analytics, Databricks, and Power BI. Your work will involve implementing contemporary data architecture patterns ...
... experience with at least one of Salesforce or Snowflake.- Power BI experience.- Python for data validation, automation, or ETL testing.- AI/GenAI exposure applied to data, ETL, or testing.- Data Lake architecture and testing experience.- Experience designing and testing end-to-end data pipelines across heterogeneous platforms.- ...
... expertise in designing and managing Snowflake data warehouses, including performance tuning and resource monitoring.- Proficiency in building modular and scalable data transformations using Data Build Tool (dbt).- Advanced capability in writing complex SQL and Python scripts to manipulate large datasets and automate data processing ...