... will be part of an exciting, fast paced environment developing Data Engineering solutions in the data and analytics domain. Develop high quality, secure and scalable data pipelines using spark, Scala/ python on Hadoop or object storage. Leverage new technologies and approaches to innovate with increasingly large data sets. ...
... Databricks Lakehouse platform. Proficient in AWS services: Glue, S3, Lambda, Step Functions, and data warehousing solutions. Strong programming skills in Python, Scala, or Java. Proficient in SQL for querying and manipulating data. Experience in data modeling for Lakehouse architecture. Knowledge of ETL best practices and data ...
... event-driven use cases. - Define logical and physical architecture patterns using cloud-native platforms and modern data technologies. - Guide the development of scalable, secure, reliable, and cost-effective data solutions using tools such as Databricks, dbt, SQL, Python or Scala, and orchestration frameworks. - Ensure solutions ...
... scalable data infrastructure and data products in complex environments Development experience in one or more object-oriented programming languages (e.g. Python, Scala, Java, C#) Experience with SQL and noSQL database fundamentals, query structures and design best practices, including scalability, readability, and reliability ...
Job Summary We are looking for an experienced Big Data Developer with strong expertise in Hadoop ecosystem, Spark, Scala, and SQL to design and build scalable data processing systems. The ideal candidate should have hands-on experience working with large datasets, distributed computing, and modern data architectures. Key ...
... significant impact on user experience and satisfaction. Collaborate with cross-functional teams to review use cases and translate business requirements into scalable data solutions. - Design and develop highly optimized, reliable, and secure enterprise-level data pipelines for real-time and batch processing. - Analyze ...
... possess a good understanding of Oracle HCM Cloud Core HR and related HCM data https://jobeax.com/link/uSD6RSIBgrRuP4Cr in Data Hub configuration, Spark, and Scala will be an added https://jobeax.com/link/kRdC5QOGt2ekpDi6 Skills : Oracle Integration Cloud (OIC) : - OIC Setup & Configuration- Integration Development- REST ...
... operational and runtime characteristics of your team's software. Leads program to improve engineering, test and operations. Assures to deliver high quality, scalable solutions based on Java technology. Advanced experience in JAVA development (Java, Hibernate, Spring Boot, Web Services, Eclipse, Apache) and Scala. Good ...
... possess a good understanding of Oracle HCM Cloud Core HR and related HCM data https://jobeax.com/link/uSD6RSIBgrRuP4Cr in Data Hub configuration, Spark, and Scala will be an added https://jobeax.com/link/kRdC5QOGt2ekpDi6 Skills : Oracle Integration Cloud (OIC) : - OIC Setup & Configuration- Integration Development- REST ...
... data extraction, transformation, and loading. Collaborate with cross-functional teams to address data engineering challenges and improve data systems. Ensure scalability and security of data infrastructure while maintaining high performance. Leverage Apache Airflow or similar tools to manage workflows and pipelines. Key ...
... experience in designing and implementing robust big data solutions that support our data-driven decision-making processes. Job description Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue, Lambda, Step Functions, and Apache Spark . Develop and optimize data lake and data warehouse architectures using AWS S3, ...
... strong expertise in Snowflake Data Warehousing, Advanced SQL, and https://jobeax.com/link/H52pJADEOnoWnW0C Responsibilities : - Design, develop, and maintain scalable data warehouse solutions using Snowflake.- Develop and optimize complex SQL queries, stored procedures, and Snowflake functions.- Build and maintain robust ...
... Architect with 5+ years of experience in Data Engineering, specializing in AWS platforms, Python, and SQL. You will be responsible for designing and implementing scalable, cost-effective data pipelines on AWS, optimizing data storage, and supporting the ingestion and transformation of large datasets for business reporting and ...
... INCLUSION We believe that diversity of people and perspective gives us a competitive advantage. Band: M3/M4 (6 to 14 years) Should have experience in PySpark and Scala + Spark for 4+ years (Min experience). Proficient in debugging and data analysis skills. Should have Spark experience of 4+ years Should have understanding of ...
... of https://jobeax.com/link/oQeJiiR2TtjToaqi least 4 years of experience in Information Technology Good experience in programming languages such as Python/Java/Scala, SQL and experience with data visualization tools like Tableau or Power BI https://jobeax.com/link/D7jAhstFP8xZgdHX least 3 years of experience in Cloud platforms ...
... the bar for excellence and serve as an inspiration across all engineering teams Architecture & Technical Excellence • Design and drive implementation of highly scalable platform architectures for multi-TB+ daily workloads • Author and sign off on all RFCs and technical specifications that touch your domain(s) • Define best ...
... Implements data governance processes and methods for managing metadata, access, retention to data for internal and external users. Develops reliable, efficient, scalable and quality data pipelines with monitoring and alert mechanisms that combine a variety of sources using ETL/ELT tools or scripting languages. Develops physical ...
... processing.- Design data lakehouse patterns integrating Delta Lake with external systems (Kafka, ADLS, S3, GCS).Data Pipeline Development (PySpark / SQL) :- Develop scalable batch and streaming data pipelines using PySpark, Spark SQL, and Delta Lake.- Build structured streaming pipelines for real-time ingestion from Kafka, Event ...
... processing.- Design data lakehouse patterns integrating Delta Lake with external systems (Kafka, ADLS, S3, GCS).Data Pipeline Development (PySpark / SQL) : - Develop scalable batch and streaming data pipelines using PySpark, Spark SQL, and Delta Lake.- Build structured streaming pipelines for real-time ingestion from Kafka, Event ...