... : - 10+ years of experience in Software or Data Engineering with large-scale, high-traffic, fault-tolerant systems.- Deep experience with semantic modeling, data lakehouse, and data product development.- Expert-level SQL and Python skills.- Experience with modern data platform technologies : Snowflake, ClickHouse, or similar ...
... AUNZ. This role focuses on building and maintaining data pipelines using Databricks (Unity Catalog, DABs, DLT), PySpark, and SQL, delivering enterprise-scale data transformation, and supporting Power BI reporting through well-modelled silver/gold layer datasets. The Data Engineer works closely with the Head of Data & Analytics ...
... robust and scalable ETL/ELT pipelines using Apache Spark and Delta Lake to transform raw (bronze) data into trusted curated (silver) and analytics-ready (gold) data layers. Apply schema evolution and data versioning to support agile data development. Platform Integration & Data Ingestion: Connect and ingest data from enterprise ...
... hands-on experience in data science.- Strong proficiency in Python and libraries such as NumPy, pandas, scikit-learn, TensorFlow/PyTorch.- Expertise in SQL for data extraction, transformation, and analysis.- Proven experience with PySpark or distributed data processing frameworks.- Deep understanding of machine learning and ...
... Kinesis.- Modern Data Stack : Design and scale a unified Lakehouse/Warehouse (e.g., Databricks, Snowflake) to handle both streaming telemetry and complex enterprise data (ERP, CRM, MES).- Data Pipelines : Build automated, resilient ETL/ELT workflows using tools like Apache Airflow, dbt, and PySpark to ensure high data quality ...
... strategies. Develop and maintain systems using Python, SQL, PySpark, and Django for front-end development. Work directly with clients and end-users and address their data needs Utilize databases and tools including and not limited to, Postgres, Redshift, Airflow, and MongoDB to support our data ecosystem. Leverage AI frameworks ...
... in shared data. Lead data governance and compliance activities - Support the implementation of data governance policies, standards, and practices across the data platform. - Maintain metadata, data lineage, and business classifications — working with tooling such as Microsoft Purview to ensure the data catalogue is accurate ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... reasoning models autonomous agents) for HR use cases. https://jobeax.com/link/2DENLGgQM7whDhaE / https://jobeax.com/link/s1WvHFV9ITSwCkyS in Computer Science Data Science AI or related field Relevant years of experience in Data Science / AI / ML roles Experience in Gen AI Agentic AI will be preferred Relevant years of experience ...
... identifies business trends and problems through complex big data analysis. Interprets results from multiple sources using a variety of techniques, ranging from simple data aggregation via statistical analysis to complex data mining independently. Prepares big data, implements data models, and develops database to support the business ...
Role: Senior Data Scientist Responsible for designing, developing, testing and deploying ML models that can leverage multiple signal sources, to build a personalized user experience Work closely with the business stakeholders to identify the potential Data science applications Contribute by doing opportunity analysis, building ...
... Description :As part of the cybersecurity organization, the Data Engineer is responsible for designing, building, and maintaining data infrastructure to support data-driven decision-making. This role involves working with large datasets, developing reports, executing data governance initiatives, and ensuring data is accessible, ...
... requirements and technical execution, ensuring high-quality solution delivery Mentor junior scientists on coding standards, experimental design, and model ethics Audit data quality and process integrity across the entire modelling lifecycle Mentor and guide junior data scientist Stay updated with the latest trends in data science ...
... identification, documenting data sources, methodologies, and quality findings with recommendations for improvement. Designing and building data pipelines to automate data movement and processing. Apply advanced analytical techniques to large datasets to uncover trends and correlations, develop validated logical data models, and ...
... build, and optimize high-throughput data pipelines using Python, R, and PostgreSQL to handle market and execution data. - Build and manage robust, scheduled data workflows using tools like Airflow/Dagster to ensure 24/7 data availability for global markets. - Monitor pipeline health, debug data discrepancies in logs, and ...
... helping enterprises solve complex data, AI and cloud transformation challenges. Founded in 1991, Impetus has grown into a global engineering organization serving data-driven enterprises and Fortune 100/500 clients. Its capabilities span cloud engineering, data engineering, enterprise AI, application modernization, DevOps and ...
... documentation for data enablement & quality processes. - Liaise closely with Labcorp Data Insight colleagues to ensure feedback loops are in place around any data issues. - Assist in the development and implementation of Data Quality initiatives, including data quality checks, data cleaning, data enrichment, and normalization ...