AWS / GCP Data Engineer in Bengaluru, India

• Hybrid

... Python. Develop and optimize large-scale data transformations using PySpark. Ensure data quality, reliability, and performance of data pipelines. GCP BigQuery Data Ingestion & ETL/ELT Data Pipeline Orchestration Python PySpark Strong SQL and data engineering fundamentals hands-on experience in GCP-based data platforms.

• On-site

... on-premises to cloud Spark code optimization and Medallion Architecture. Strong knowledge of Databricks and its components, including Delta Live Table (DLT) pipeline implementations. Familiarity with AWS services (experience with additional cloud platforms like GCP or Azure is a plus). AWS/GCP/Azure Data Engineer Certification.

Senior Engineer, DevOps Primary Skills ~ GCP Cloud Build, GCP Deploy, Cloud Run, Kubernetes, GCP Cloud CI/CD Pipeline, GCP Spinnaker Specialization ~ GCP DevOps Engineering: Engineer Job requirements ~ Experience Range: With at least 2 years of hands-on experience in GCP DevOps engineering, including CI/CD pipeline management ...

$11 USD

... Cloud & DevOps Foundations: Solid working knowledge of cloud ecosystems (AWS and/or GCP) and experience deploying robust services via Docker and Kubernetes. Data Advocacy: Exceptional communication skills with the ability to articulate complex data schemas, structural bottlenecks, and analytical tradeoffs to both hardware ...

... team and contribute to building and maintaining applications that power the Dun & Bradstreet Contact Pipeline. This role involves working closely with senior data engineers to optimize data ingestion processes, analyze performance bottlenecks, and implement improvements. You will also create metrics to monitor application ...

• Hybrid
• On-site

700k

... experiences. Contribute to AI-enabled features and use AI development tools responsibly to improve coding, testing, research, documentation, and delivery. Apply sound engineering practices across architecture, performance, security, testing, debugging, and maintainability. Deploy and operate services using AWS and CI/CD workflows, ...

• Full-time

... understanding of how to write geo/spatial queries. Version Control: Basic understanding of tools like Git/GitHub. Cloud Basics: Familiarity with cloud platforms (AWS, GCP, or Azure). OS: Comfortable with basic Linux/Unix command-line operations. Portfolio: Any personal or academic projects showcasing data pipelines or data processing.

... managing this platform, utilizing leading technologies like Databricks, Delta Lake, Spark, PySpark, Scala, and the AWS suite. We are actively seeking skilled Data Engineers to join our team and contribute to scaling our platform across the organization. Create and manage robust data ingestion pipelines leveraging Databricks, ...

• Full-time

... Work Type: Full Time At VIDA we're building the future of digital identity. As a Data Engineer you'll work across the stack—from platform and infrastructure to data pipelines and end-user tooling. You'll help us modernize our batch ETLs and lead our push into streaming and real-time fraud detection. We run on AWS and make ...

• Hybrid

... architects, analysts, developers, and business stakeholders to understand data requirements.- Ensure data quality, security, governance, and best practices across data engineering https://jobeax.com/link/Gpaa4oyRTNYXQU0V Stack:- Python, PySpark, SQL, AWS Glue, AWS Glue Data Catalog, AWS Lambda, Amazon S3, AWS Step Functions, ...

We are seeking a Data Engineer to join our team. The role will involve building and maintaining data pipelines and collaborating closely with stakeholders. Key responsibilities Design and develop scalable data pipelines using AWS services. Implement ETL processes with AWS Glue, Lambda, and DBT. Work with PySpark and SQL ...

... similar). Experience in building data pipelines or ETL processes. Familiarity with REST APIs and backend frameworks (Flask/Django is a plus). Understanding of data structures and algorithms. Good To Have Experience with big data tools (Spark, Hadoop). Knowledge of cloud platforms (AWS, Azure, or GCP). Exposure to machine ...

... understanding of Apache Airflow and ability to design and manage complex DAGs. - Solid SQL skills and familiarity with data warehouse platforms (e.g., Snowflake, Redshift, BigQuery). - Familiarity with version control tools (Git), CI/CD pipelines, and Agile methodologies. - Exposure to cloud environments like AWS, GCP, or Azure

• On-site

... data quality, reliability, and performance across data systems Required Skills: - Scala (must-have), python - Apache Spark - Strong coding fundamentals and engineering principles - Azure or on-premises Hadoop ecosystem experience - 5+ years of experience in Data Engineering - Python * SQL * AWS / Azure / GCP Preferred (Bonus) ...

... years of professional experience in data engineering, with a focus on data modelling and transformation. Programming: Strong proficiency in SQL and Python for data processing and pipeline development. Data Platforms: Hands-on experience with Snowflake, dbt, and modern cloud data warehouses. Data Modelling: Deep experience ...

... architecture, establish engineering best practices, and mentor other engineers. The role requires strong experience designing, building, and operating large-scale data pipelines and distributed data systems. Our technology stack includes AWS services, Airflow, Snowflake, MS SQL Server, and .NET. We are looking for someone who ...

... governance and data quality engines. The position enables trusted, governed data across systems, supporting analytics, compliance, and business operations at ELGi. Data Engineering & Architecture Design scalable, production-grade ETL/ELT pipelines across Azure, AWS, and GCP. Develop modular, reusable data engineering frameworks ...

... least one certification • Databricks Certified Data Engineer Associate OR Databricks Certified Data Engineer Professional Additional Certifications (Preferred) - Databricks Certified Associate Developer for Apache Spark - Cloud platform certifications (Azure Data Engineer Associate, AWS Certified Data Analytics, or Google Cloud ...

... maintain scalable data pipelines and distributed systems. The ideal candidate should have hands-on experience with ETL/ELT pipelines, workflow orchestration, AWS cloud services, data visualization, distributed architectures, and modern data engineering https://jobeax.com/link/TtkK7BHPbancvnFq Responsibilities:- Design, ...