Assist with the design, development, and maintenance of data product pipelines.
Perform data engineering activities including data modelling, ETL/ELT development, data warehousing, data lakes, and database management.
Collate, analyse, validate, and reconcile data using established tools, methods, and formats.
Support management information reporting, data visualisation, operational analysis, performance monitoring, trend analysis, and insight generation.
Perform SIT, UAT, regression testing, release support, production validation, and defect investigation.
Identify shortcomings in processes, systems, procedures, and IT security practices, and support prescribed improvements.
Support product development and project management activities according to established procedures.
Coach and mentor others and help users benefit from existing data management and knowledge management systems.
Assign short-term work schedules to subordinate team members to meet established timelines.
Requirements
3–5 years of experience.
Knowledge of SQL and Python.
Experience or knowledge of data engineering, data modelling, ETL/ELT development, data pipelines, cloud data platforms, database management, data warehousing, and data lakes.
Knowledge of data analysis, business analysis, management information reporting, operational analysis, performance monitoring, trend analysis, root cause analysis, and data quality management.
Knowledge of SIT, UAT, regression testing, release support, production validation, and defect investigation.
Strong problem-solving, critical-thinking, collaboration, communication, stakeholder-management, ownership, and continuous-improvement skills.
Ability to work with established processes and procedures while coaching or supporting others.
... Net Zero by 2040. What you'll be doing Build, maintain, and monitor automated data pipelines on the Group's cloud data platform, transforming raw transactional data into reporting schemas and developing BI dashboards to deliver reliable, analytics-ready data. • Build, maintain, and monitor automated ETL/ELT data pipelines ...
... experienced Data Engineer to manage in-progress and upcoming data infrastructure projects. The candidate will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline ...
Purpose of Job We are looking for a Senior Data Engineer who is equally strong on the data side (modelling, data quality, SQL, understanding the business) and the engineering side (Python, PySpark, CI/CD, performance, reliability). You will own the design and delivery of production data platforms from requirements to production ...
... scalable data pipelines and third-party API integrations. - Work with business teams and analysts to interpret business rules and derive insights. - Implement data-quality processes, monitoring, and alerting to maintain accurate and available production data. - Analyze and troubleshoot data issues and assist with their resolution. ...
... Data Frames using PySpark • Conduct complex data analysis and report on results. • Combine raw information from different sources. • Explore ways to enhance data quality and reliability. Required Skills: • 4-5 years of data engineering experience loading, analyzing and interpreting data. • Solid experience with AWS Glue, ...
... measurable business outcomes Overview We are seeking skilled Data Engineers to join our Data & Digital Twin Foundation team. You will design, build, and maintain data pipelines that power digital twin platforms, real-time operational systems, and AI/ML workloads. Working closely with data architects, simulation engineers, and ...
... analysis and reporting. - Implement and monitor data quality frameworks to ensure the integrity, consistency, and reliability of all data assets. - Optimize database queries and data models to enhance system performance and reduce latency. - Engineer end-to-end ETL and ELT workflows to facilitate seamless data movement ...
... effective solutions - Ensure adherence to best practices related to data governance, quality, and security across all data pipelines - Automate and optimize data processing tasks to improve reliability and reduce manual intervention - Drive adoption of emerging big data technologies, cloud engineering, and automation practices ...
Amgen seeks a Level 4 Data Engineer to design, build, and maintain data solutions that drive business decisions. The role involves developing ETL pipelines, managing large datasets, implementing data governance, and collaborating across teams to deliver scalable data infrastructure. Responsibilities - Design, develop, and ...
... and analytics. - Implement data quality checks, validation frameworks, monitoring, error handling, and pipeline performance improvements. - Collaborate with Data Analysts, Data Scientists, Product Teams, and Business Stakeholders to understand requirements and deliver scalable data solutions. - Follow data engineering ...