... https://jobeax.com/link/fYGlpInxuIv5PeS1 & Skills :- 4 - 7 years in data engineering: SQL, Python, ETL/ELT orchestration.- Cloud data platform experience (Azure preferred): pipelines, storage, APIs.- Strong understanding of data lake and data architecture.- Data modelling for analytics (star schema) and data quality frameworks. (ref:hirist.tech)
Job Summary :The Data Integration Engineer will design, develop, and support data integration solutions that extract financial and operational data from enterprise source systems and deliver trusted data to analytics platforms and external vendors. The role emphasizes source-to-target mapping, transformation, validation, ...
... experience in Data Engineering and project delivery.- Strong expertise in Big Data concepts and cloud implementation projects.- Proficient in Snowflake, SQL, and AWS services (Glue, EMR, S3, Aurora, RDS, AWS architecture).- Excellent hands-on experience with Python, PySpark, and AWS cloud microservices.- Capability to perform ...
We are seeking a Senior Data Engineer with 5+ years of experience in designing and building scalable data platforms, ETL pipelines, and data warehousing solutions. The ideal candidate will have strong expertise in distributed data processing, cloud technologies, and software engineering best practices. Key Responsibilities: ...
... engineering, with a proven track record in complex pipeline development and cloud-based data migration projects. Bachelor’s or higher degree in Computer Science, Data Engineering, or a related field. Skills : Proficiency in Spark, SQL, Python, and other relevant data processing technologies. Expertise in on-premises to cloud ...
... accuracy across the network. Define and maintain strict access control, governance, and data privacy standard practices across the global insights platform. Engineering Hygiene & DevOps Packaged and deploy data services using Docker and Kubernetes. Maintain elegant CI/CD automation pipelines for data code deployments and ...
... team and contribute to building and maintaining applications that power the Dun & Bradstreet Contact Pipeline. This role involves working closely with senior data engineers to optimize data ingestion processes, analyze performance bottlenecks, and implement improvements. You will also create metrics to monitor application ...
... experiences. Contribute to AI-enabled features and use AI development tools responsibly to improve coding, testing, research, documentation, and delivery. Apply sound engineering practices across architecture, performance, security, testing, debugging, and maintainability. Deploy and operate services using AWS and CI/CD workflows, ...
... and detail-oriented Associate Data Engineer to join our growing data team. If you are a recent graduate passionate about data and eager to build a career in data engineering, this is the perfect opportunity for you! In this role, you will work closely with senior engineers to build, maintain, and optimize data pipelines. ...
... managing this platform, utilizing leading technologies like Databricks, Delta Lake, Spark, PySpark, Scala, and the AWS suite. We are actively seeking skilled Data Engineers to join our team and contribute to scaling our platform across the organization. Create and manage robust data ingestion pipelines leveraging Databricks, ...
... Work Type: Full Time At VIDA we're building the future of digital identity. As a Data Engineer you'll work across the stack—from platform and infrastructure to data pipelines and end-user tooling. You'll help us modernize our batch ETLs and lead our push into streaming and real-time fraud detection. We run on AWS and make ...
... the Role:We are looking for an experienced AWS Data Engineer with 6 - 8 years of hands-on experience in designing, developing, and maintaining scalable data engineering solutions on AWS. The ideal candidate should have strong expertise in Python, PySpark, SQL, and AWS data services, with experience building robust ETL pipelines ...
... in Python and SQL - Experience with Unity Catalog, cluster administration, and at least one major cloud platform (Azure, AWS, or GCP) - Solid understanding of data warehousing and dimensional modeling Databricks Certified Data Engineer (Associate or Professional) Cloud data engineering certification have minimum 5 years ...
... Sub, BigQuery, Cloud Functions, Composer, GCS Proficient hands-on programming experience in Spark/Scala (python/java) Proficient in building production level ETL/ELT data pipelines from data ingestion to consumption Data Engineering knowledge (such as Data Lake, Data warehouse - Redshift/Hive/Snowflake, Integration, Migration) ...
We are seeking a Data Engineer to join our team. The role will involve building and maintaining data pipelines and collaborating closely with stakeholders. Key responsibilities Design and develop scalable data pipelines using AWS services. Implement ETL processes with AWS Glue, Lambda, and DBT. Work with PySpark and SQL ...
... similar). Experience in building data pipelines or ETL processes. Familiarity with REST APIs and backend frameworks (Flask/Django is a plus). Understanding of data structures and algorithms. Good To Have Experience with big data tools (Spark, Hadoop). Knowledge of cloud platforms (AWS, Azure, or GCP). Exposure to machine ...
Hello, We are hiring for 'Data Engineer with Java' for Pune Location. Exp :5+Years Loc : Pune Notice Period: Immediate joiners(notice period served or serving candidate) Mandatory Skills: Data Engineering Airflow Data Build Tool(DBT) Java ETL/ELT Pipeline CI/CD SQL NOTE: We are looking for Immediate joiners(notice period ...
... data quality, reliability, and performance across data systems Required Skills: - Scala (must-have), python - Apache Spark - Strong coding fundamentals and engineering principles - Azure or on-premises Hadoop ecosystem experience - 5+ years of experience in Data Engineering - Python * SQL * AWS / Azure / GCP Preferred (Bonus) ...
... opportunities to streamline processes with an eye towards building a repeatable model to reduce implementation duration. Job Requirements: • The CDP ETL & Database Engineer will be well versed in the following areas: Relational data modeling ETL and FTP concepts Advanced Analytics using SQL Functions Cloud technologies - AWS, Snowflake ...
Data Engineer: PySpark+AWS Glue 4-8 years in Data Engineering with hands-on expertise in Snowflake, AWS Glue, AWS (S3/Lambda/CloudWatch), Python, PySpark, and SQL. Strong experience in ETL/ELT, Data Warehousing, Data Pipelines, Performance Tuning, and Cloud Data Platforms. Exposure to AI/ML or GenAI solutions is a plus ...