... on-premises to cloud Spark code optimization and Medallion Architecture. Strong knowledge of Databricks and its components, including Delta Live Table (DLT) pipeline implementations. Familiarity with AWS services (experience with additional cloud platforms like GCP or Azure is a plus). AWS/GCP/Azure Data Engineer Certification.
... Collaborate with the broader project team to understand data requirements and deliver effective solutions.- Troubleshoot and resolve issues in data pipelines and data quality to ensure accuracy and availability.- Contribute to documentation and adhere to data engineering best practices.- Support the team in various data-related ...
... of experience in backend development with a strong focus on Java, Microservices and Kafka Java Microservices Back end Developer Java Sprint boot Microservices with expected knowledge of Kafka, Basic knowledge of Database. Experience with TDD and BDD. Must have experience with one of cloud (GCP, AWS or Azure). Also experience ...
... Develop highly available data ingestion and processing systems for large datasets. Collaborate with cross-functional teams to deliver data solutions. Ensure data quality, performance, reliability, and scalability. Required Skills: - 7+ years of Data Engineering experience. - Strong experience in Data Modeling, Data Warehousing, ...
Role Overview : We are seeking a seasoned Data Engineering professional to spearhead our data architecture initiatives and drive the evolution of our analytical ecosystem. In this role, you will be responsible for designing robust data models and optimizing our Snowflake-based data warehousing environment to support complex ...
... skilled and hands-on Data Engineer to design, build, and scale our global data ecosystem. Sitting within our core Global Insights Node , this role is not a traditional corporate dashboard-building job. You will bridge the gap between heavy hardware telematics and high-fidelity operational intelligence. You will design and ...
... team and contribute to building and maintaining applications that power the Dun & Bradstreet Contact Pipeline. This role involves working closely with senior data engineers to optimize data ingestion processes, analyze performance bottlenecks, and implement improvements. You will also create metrics to monitor application ...
... Contribute to data platform architecture, engineering standards, and continuous improvement initiatives. Support data governance, cataloguing, lineage, and metadata management practices where required. Work with Linux/Unix environments and efficiently process large datasets. WHAT MAKES YOU A GREAT FIT - 3+ years of professional ...
... and development Data quality validation and monitoring Schema design for analytics and reporting Performance optimization and scalability Preferred Experience Databricks Delta Lake experience Azure Synapse Analytics Python for data engineering Spark SQL optimization Real-time data streaming Data governance and metadata management ...
... build robust data pipelines, data lakes, and marts to support business analysts and data scientists. Key Responsibilities Modern Data Platform Development: Build data lake components on cloud-based platforms Design and develop data marts for business analysts and data scientists Data Engineering & Pipelines: Design data pipelines ...
Role Overview : We are seeking a seasoned Data Engineering professional to spearhead our data architecture initiatives and drive the evolution of our analytical ecosystem. In this role, you will be responsible for designing robust data models and optimizing our Snowflake-based data warehousing environment to support complex ...
Data Science Data Engineer Work Type: Full Time At VIDA we're building the future of digital identity. As a Data Engineer you'll work across the stack—from platform and infrastructure to data pipelines and end-user tooling. You'll help us modernize our batch ETLs and lead our push into streaming and real-time fraud detection. ...
... data pipelines for performance, reliability, and scalability.- Collaborate with data architects, analysts, developers, and business stakeholders to understand data requirements.- Ensure data quality, security, governance, and best practices across data engineering https://jobeax.com/link/Gpaa4oyRTNYXQU0V Stack:- Python, ...
... the Role :We are seeking a Senior Fabric Data Engineer who can help with the design and building of data https://jobeax.com/link/jcqkTDCTdscBt8W9 :- Building Data Factory pipelines in Fabric- Scheduling notebook, Copy Activity, and Dataflow Gen2 executions- Creating dependency chains between activities- Implementing retry ...
... relevant reporting tools - Collaborate with data engineers, architects, and business stakeholders to deliver high-quality, scalable solutions. - Knowledge of data security, compliance, and governance best practices Familiarity with monitoring, alerting, and operational runbooks to support production-grade data pipelines ...
Senior Data Engineer Starts Immediately Competitive salary Competitive salary Experience We are looking for a Senior Data Engineer to join our team. In this role, you will design, build, and optimize scalable data pipelines on the Databricks Lakehouse Platform. You will partner with data science, analytics, and business ...
... ingestion to consumption Data Engineering knowledge (such as Data Lake, Data warehouse - Redshift/Hive/Snowflake, Integration, Migration) Excellent communicator (written and verbal formal and informal) Experience using software version control tools (Git/Bitbucket/code commit). Flexible and proactive/self-motivated working style ...
We are seeking a Data Engineer to join our team. The role will involve building and maintaining data pipelines and collaborating closely with stakeholders. Key responsibilities Design and develop scalable data pipelines using AWS services. Implement ETL processes with AWS Glue, Lambda, and DBT. Work with PySpark and SQL ...
... scalable data engineering and data warehouse solutions while managing data schemas, SQL query tuning, and code reviews. Who You Are: - 5+ years of experience in Data Engineering, with strong knowledge of Data Platforms and Data Warehousing - 2+ years of hands-on experience with SSAS Tabular Models - Experience designing data ...