1,740 Full-time aws data engineer jobs in Bangalore, India.

... data engineering or a related field. - Strong programming skills in languages such as Python. - Proficiency in SQL and working knowledge of relational and NoSQL databases. - Familiarity with cloud platforms like AWS Azure or GCP. - Knowledge of data modelling concepts and experience in designing and optimising data schemas. ...

... experience in DataOps, DevOps, or Data Engineering roles, with a minimum of 4 years dedicated to the AWS ecosystem. - Core AWS Stack: Deep hands-on expertise with AWS data and infrastructure services: - Compute/Infra: EC2, EKS, ECS, Lambda, Terraform. - Data/Analytics: EMR, Glue, Athena, Redshift, S3, Kinesis. - AWS Cloud Security: ...

... shape the reliability and performance of a product used by hiring teams across https://jobeax.com/link/uobPKRF4SWvTYvyi : You will join a lean, high-ownership engineering team working closely with product, data, and AI specialists. Collaboration is at the heart of how we build - every engineer has a voice in technical https://jobeax.com/link/FHuOLZgdsgL7jykZ ...

... to work independently, as well as in cooperation with a variety of customers and other technical professionals. What you'll be doing - Development of new ETL/data transformation jobs, using PySpark and IBM DataStage in AWS. - Enhancement and support on existing ETL/data transformation jobs. - Can explain technical solutions ...

... Engineering, Big Data Engineering, Platform Engineering, or Data Platform Engineering. - Strong hands-on experience building and operating enterprise-scale cloud data platforms. - Strong expertise in cloud data platform services across AWS and Azure, including AWS EMR, EMR on EKS, Glue, Athena, S3, IAM, Lake Formation, and ...

... scalable data pipelines and third-party API integrations. - Work with business teams and analysts to interpret business rules and derive insights. - Implement data-quality processes, monitoring, and alerting to maintain accurate and available production data. - Analyze and troubleshoot data issues and assist with their resolution. ...

... HandsonexperiencewithworkfloworchestrationtoolssuchasApacheAirflowAzure DataFactory(ADF)AWSGlueDatabricksorsimilarplatforms. - Experienceintegratingstructuredsemi-structuredandunstructureddatasources. - Strongunderstandingofdatamodelingdatawarehousingconceptsandanalytics platforms. - ProficiencyinPythonSQLorotherdataengineeringprogramminglanguages. - Knowledgeofdatagovernancesecuritycomplianceanddataqualitybestpractices. ...

... experience building and operating cloud-based data pipelines, preferably in AWS. - Have hands-on experience with Snowflake, dbt, and Terraform. - Have experience with data ingestion, streaming, and event-driven architecture, such as Kafka, CDC, and Snowpipe. - Understand data security, data privacy, and data modeling best practices. ...

... preferred) or a genuine willingness to ramp up quickly - Experience building or maintaining backend services and REST APIs - Familiarity with a major cloud platform (AWS preferred) and core services like S3, EC2, and managed databases - Solid computer science fundamentals: data structures, concurrency, and the basics of distributed ...

... relevant Data Engineering experience . - Strong experience in Python/R and SQL . - Experience with NoSQL databases and database concepts. - Hands-on experience with AWS, Azure, or GCP . - Experience with Apache Spark / Databricks . - Experience with Snowflake, Amazon Redshift, or similar data warehouses . - Strong knowledge of ...

... brainstorming sessions. - Build and maintain a robust data engineering process to develop and implement self-serve data and tools for Visas product management teams and data scientists. - Find opportunities to create automate and scale repeatable analyses or build self-service tools for business users. - Execute data engineering projects ...

... 7 years professional experience as a data engineer with at least 4 utilizing cloud technologies. Proven experience working with Databricks either in Azure or AWS. Strong experience with the Microsoft Azure Data Stack (Databricks Data Lake Gen2 ADF etc. Expertise building ETL and data pipelines on Databricks using data ...

... 5 years of data engineering experience developing large data pipelines Strong algorithmic problem-solving expertise Have demonstrable expertise with relevant data technologies such as MSK Kenesis S3 Flink Spark nifi SingleStore Snowflake AWS Glue Terraform K8s EKS Lambda Airflow DataDog and Grafana for observability with ...

... and data governance requirements Required Education Experience/Skills/Training: Basic Qualifications 5 years of data engineering experience developing large data pipelines Strong algorithmic problem-solving expertise Strong fundamental Scala and Python programming skills Basic understanding of AWS or other cloud provider ...

... ETL and data pipeline frameworks (e.g. Apache Spark Apache Airflow). Understanding of big data technologies (e.g. Hadoop Hive HBase) and cloud platforms (e.g. AWS Azure GCP). Experience in building and integrating GenAI solutions using LLMs vector databases and prompt engineering techniques. Familiarity with GenAI frameworks ...

... combines deep data engineering expertise with a collaborative mindset working to ensure that marketing decisions at Zoom are grounded in trustworthy well-structured data. Responsibilities - Design and implement robust ETL pipelines to integrate data from multiple marketing platforms and data sources - Develop optimized data models ...

... processes. - Define and monitor data quality KPIs and metrics. - Support data governance initiatives metadata management and compliance requirements. - Ensure data consistency accuracy and integrity across systems. - Lead development activities and mentor junior data engineers. - Collaborate with business users data stewards ...

... Data Catalog, Collibra Data Quality, SAP MDG, or similar data management solutions. - Strong knowledge of SQL, Windows Server, APIs, cloud platforms (Azure and AWS), infrastructure, GitHub, and DataDog. - Understanding of data governance, metadata management, data quality, and master data management concepts. - Experience ...

... no-SQL databases (MySQL/MariaDB, PostgreSQL, MongoDB) - Computer Science, Computer Engineering, or similar technical degree Bonus Points - Experience with the data engineering stack within AWS is a major plus (S3, Lake Formation, Lambda, Fargate, Kinesis Data Streams/Data Firehose, DynamoDB, Neptune DB) - Experience with ...

... leading technical design and mentoring engineers. • Deep expertise in Python and machine learning frameworks (TensorFlow, PyTorch, Scikit-learn), with strong data handling (Pandas, NumPy) and experiment tracking (MLflow). • Strong SQL skills for data exploration, feature engineering, and working with cloud data warehouses ...