... processes, optimising data delivery and re-designing infrastructure for greater scalability.- Collaborate with stakeholders to ensure seamless integration of data with internal data marts, enhancing advanced reporting.- Setup and maintain data ingestion, streaming, scheduling, and job monitoring automation using AWS services.- ...
... experiences. Contribute to AI-enabled features and use AI development tools responsibly to improve coding, testing, research, documentation, and delivery. Apply sound engineering practices across architecture, performance, security, testing, debugging, and maintainability. Deploy and operate services using AWS and CI/CD workflows, ...
... BigQuery, Cloud Functions, Composer, GCS Proficient hands-on programming experience in Spark/Scala (python/java) Proficient in building production level ETL/ELT data pipelines from data ingestion to consumption Data Engineering knowledge (such as Data Lake, Data warehouse - Redshift/Hive/Snowflake, Integration, Migration) ...
... on-premises to cloud Spark code optimization and Medallion Architecture. Strong knowledge of Databricks and its components, including Delta Live Table (DLT) pipeline implementations. Familiarity with AWS services (experience with additional cloud platforms like GCP or Azure is a plus). AWS/GCP/Azure Data Engineer Certification.
... accuracy across the network. Define and maintain strict access control, governance, and data privacy standard practices across the global insights platform. Engineering Hygiene & DevOps Packaged and deploy data services using Docker and Kubernetes. Maintain elegant CI/CD automation pipelines for data code deployments and ...
... Work Type: Full Time At VIDA we're building the future of digital identity. As a Data Engineer you'll work across the stack—from platform and infrastructure to data pipelines and end-user tooling. You'll help us modernize our batch ETLs and lead our push into streaming and real-time fraud detection. We run on AWS and make ...
Data Engineer: PySpark+AWS Glue 4-8 years in Data Engineering with hands-on expertise in Snowflake, AWS Glue, AWS (S3/Lambda/CloudWatch), Python, PySpark, and SQL. Strong experience in ETL/ELT, Data Warehousing, Data Pipelines, Performance Tuning, and Cloud Data Platforms. Exposure to AI/ML or GenAI solutions is a plus ...
... tracking in making AI-ready and critical data sources available for innovation Drive insight into areas of efficiency and risk through consolidation and reengineering of data flows Lead data quality issue root cause analysis using deep data profiling and advanced analytics techniques, then fix the cause and embed uplifted ...
... years of professional experience in data engineering, with a focus on data modelling and transformation. Programming: Strong proficiency in SQL and Python for data processing and pipeline development. Data Platforms: Hands-on experience with Snowflake, dbt, and modern cloud data warehouses. Data Modelling: Deep experience ...
... governance and data quality engines. The position enables trusted, governed data across systems, supporting analytics, compliance, and business operations at ELGi. Data Engineering & Architecture Design scalable, production-grade ETL/ELT pipelines across Azure, AWS, and GCP. Develop modular, reusable data engineering frameworks ...
Job Description - Data Engineer (AWS)As a Data Engineer, you will be part of a dynamic team of data engineers and being responsible for technical design, implementation, optimizing and maintenance of data engineering solution components for our customers. You will be required to have strong hands-on experience in implementing ...
... members by sharing knowledge and providing guidance to support their professional growth. Professional & Technical Skills: Must To Have Skills: Proficiency in Databricks Unified Data Analytics Platform, Aws Integration services. Experience with cloud-based development environments and agile software development practices. ...
... evolve the foundations that keep our engineering org fast, secure, and cost-efficient at scale — spanning cloud cost management, security DevOps, and CI/CD and engineering operations. Cloud cost (FinOps) Own and evolve our cloud cost optimization program across AWS, Azure, GCP, Databricks, Snowflake and Bigquery building on ...
We are looking for a highly motivated Software Engineer with strong fundamentals in data structures, algorithms, and system design. The ideal candidate should have a proven track record of building scalable, high-performance systems and experience working in a fast-paced, collaborative environment. Responsibilities Design, ...
... products, while leveraging the scale and innovation of technology from across the Amazon family, including AWS. You will use object-oriented concepts, algorithms and data structures to build systems at Amazon scale You will design, launch, and re-architect multi-tier systems with large amounts of data 3+ years of non-internship ...
... software. Environments vary from on-site Hadoop/Spark Clusters to Amazon AWS deployments (EC2, S3, EMR, VPC, Lambda) and Google Cloud deployments (CloudStorage, Dataproc, VPC). In this role you will frequently interact with clients to configure software deployments which transform how they leverage technology for data intelligence. ...
... optimize cloud costs while maintaining system performance and reliability.- Infrastructure Management : Manage our multi-environment infrastructure deployed in AWS cloud, comprising Dockerized microservices in AWS ECS & various data stores and queueing technologies.- Automation : Leverage modern solutions like Terraform ...
... CI/CD to enable true continuous delivery. You'll embrace AI-assisted engineering to improve quality, speed, and your own developer experience. As a mid-level engineer, you'll work on meaningful features, ship production code regularly, and grow your craft alongside experienced engineers. You'll contribute to technical discussions, ...