... and real time data pipelines Build and maintain robust ETL ELT processes for ingesting transforming and loading data from multiple sources Develop and manage data lakes data warehouses and metadata frameworks Collaborate with cross functional teams to understand data requirements and deliver data solutions Ensure data quality ...
... analytics, machine learning, and data-driven decision-making to support and enhance business operations. The ideal candidate will have a strong background in data science, experience working with large datasets, and a proven ability to deliver actionable insights. We are seeking a seasoned Senior Data Scientist with e-commerce ...
... compelling and clear business focused insights. Can work with multiple databases and big data solutions. Work with the data engineering team to develop & maintain data pipelines. Identify, design, and implement internal process improvements and tools to automate data processing and ensure data integrity while meeting data security ...
... quality. Big Data - Big Data - Pyspark Database - Database Programming - SQL Data Science and Machine Learning - Data Science and Machine Learning - Apache Spark Data & AI - Data Engineering - Data Quality & Validation Data & AI - Data Engineering - Apache Kafka Big Data - Big Data - Azure databricks Data Science and Machine ...
... focused on Supply Chain and Commercial. We are looking for (senior) data engineers to join our high performing team. We aim to attract and further develop the best Data Science & Supply Chain talent. Collect business requirements from the various stakeholders (Data Scientists, Product Managers, IM) High interest in developing ...
... reliable, high-quality data, driving excellence in analytics and shaping outcomes that impact industries like H ealthcare and Financial Services . Design and build Data Pipelines using GCP services and BigQuery. Develop and optimize data solutions using Java or Python. Ensure data quality, governance, and compliance across projects. ...
... Design and develop batch and real-time data pipelines on GCP.- Build scalable ETL/ELT pipelines using Dataflow, BigQuery, and Cloud Composer.- Ingest data from databases, APIs, files, SaaS applications, and streaming sources.- Design and optimize BigQuery datasets, tables, partitioning, and clustering.- Develop data transformations ...
... business insights. Owning and leading projects that focus on data platform modernization, ensuring high performance, security, and scalability. Working on complex data engineering challenges that push the boundaries of cloud data infrastructure. A Bachelor's or Master's degree in Computer Science, Engineering, or a related technical ...
... and emerging technologies in data engineering into our workflows. Contribute to the strategic planning of data infrastructure to support the company's growing data needs. Bachelor's degree in Computer Science, Engineering, or a related field. - 6+ years of experience in data engineering or a related role. - Expertise in ...
... Automate data workflows and pipeline operations using orchestration and scheduling tools Monitor pipeline health, proactively identify issues, and troubleshoot data quality or performance problems Optimize data processing workloads for performance, reliability, and cost efficiency Bachelor's degree in Computer Science, Engineering, ...
... Collaboration – Work closely with the lead engineer, QA, and reporting teams to validate metrics and resolve data quality issues. Bachelor’s degree in computer science, Engineering, Information Systems, or related field - 6+ years of hands-on data engineering experience, with Azure Databricks and Azure Data Lake - Proficiency ...
... in end-to-end data transformation and pipeline development Detailed Job Description Mandatory Technical Skills: Snowflake Data Warehouse Python Scripting DBT (Data Build Tool) Apache Airflow Advanced SQL End-to-End ETL/ELT & Data Pipeline Development Key Requirements Strong hands-on experience in Snowflake data warehousing ...
... and/or cloud technologies. - Visualization/reporting tools such as Tableau, Spotfire, Grafana, etc. - Working knowledge of ML and AI model development and the data science development life cycle is an added advantage. - Experience with large datasets and understanding of stream and batch processing , Datadog, Brokers like ...
... of Medallion Architecture and Delta Lake . - Advanced SQL and experience working with large-scale datasets. Good to Have - MLflow and experience supporting ML/data science workflows. - LangChain or similar AI/Agent frameworks. - Exposure to AI Agents / AI-ready data platforms . - Experience with SQL Server . - Experience ...
... equivalent practical experience (or) degree in an analytical field (e. g. Computer Science, Engineering, Mathematics, Statistics, Operations Research, Management Science). 3+ years of experience with data analysis and metrics development. - 3+ years of experience analyzing and interpreting data, drawing conclusions, defining ...
... scalable data processing solutions using Big Data technologies and distributed system s Strong hands-on experience with Python and PySpar k for developing efficient data pipelines and applications Develop and optimize complex SQL querie s, data models, and database solutions Analyze and improve performance of Apache Spark workload ...
... production operations for the solutions you build, including monitoring, troubleshooting, incident response, and root-cause analysis. Partner with Analytics and Data Science teams to develop data quality dashboards, metrics, and reporting. Collaborate with Product and Business stakeholders to prioritize data sources and improvements ...
... consistency, and reliabilityof data YOUR PROFILE: - University degree in computer science, Engineering, or a related technical field - 8 – 10+ year experience as a data engineer or in a similar data-intensive role - Proficient knowledge in ETL, Data Lake, and data warehousing - Proficient knowledge/skills: in SQL and relational ...
... identifying opportunities with potential business impact and to support development and deployment of models into production You have a Bachelor or Masters Degree in Data Science, Computational Statistics/Mathematics, Computer Science, Operations Research or related field Further to that you have a strong understanding of and practical ...