Data Engineer Java AWS in Pune, India is listed on Jobeax. Browse 30,000+ vacancies available.
Hello,
We are hiring for 'Data Engineer with Java' for Pune Location.
Exp :5+Years Loc : Pune Notice Period: Immediate joiners(notice period served or serving candidate) Mandatory Skills: Data Engineering Airflow Data Build Tool(DBT) Java ETL/ELT Pipeline
CI/CD
SQL
NOTE: We are looking for Immediate joiners(notice period served or serving candidate)
Apply only If you are Immediate joiners(notice period served or serving candidate)
Apply only if you are having 5+Years of relevant experience into the above mentioned mandatory skills.
Job Description: Key Responsibilities: Design, implement, and optimize ETL/ELT pipelines using DBT for data modeling and transformation. Develop backend components and data processing logic using Java. Build and maintain DAGs in Apache Airflow for orchestration and automation of data workflows. Ensure the reliability, scalability, and efficiency of data pipelines for ingestion, transformation, and storage. Work with cross-functional teams to understand data needs and deliver high-quality solutions. Troubleshoot and resolve data pipeline issues in production environments. Apply data quality and governance best practices, including validation, logging, and monitoring. Collaborate on CI/CD deployment pipelines for data infrastructure.
Required Skills & Qualifications:
4+ years of hands-on experience in data engineering roles.
Strong experience with DBT for modular, testable, and version-controlled data transformation.
Proficient in Java, especially for building custom data connectors or processing frameworks.
Deep understanding of Apache Airflow and ability to design and manage complex DAGs.
Solid SQL skills and familiarity with data warehouse platforms (e.g., Snowflake, Redshift, BigQuery).
Familiarity with version control tools (Git), CI/CD pipelines, and Agile methodologies.
Exposure to cloud environments like AWS, GCP, or Azure
... Docker Proficiency in Java, Spring Boot, and microservices architecture. Experience with REST APIs, JSON/XML, and API integrations. Knowledge of SQL, PL/SQL, and database performance tuning. Familiarity with CI/CD (Jenkins, GitLab CI etc.). Understanding of cloud platforms (AWS, Azure, or GCP) is a plus. Experience With Messaging ...
... reliable, scalable solutions for modern IT environments. The role offers exposure to Go, RESTful and gRPC APIs, Kubernetes, Docker, and cloud platforms such as AWS. Working within geographically distributed engineering teams, you'll collaborate across disciplines in a remote-first environment. The position also encourages ...
Details on Tech Stack Exp - 7+yrs to 12yrs Java Spring Framework AWS/GCP BigQuery Microservices Architecture Strong proficiency in Java with at least 7+ years of experience Extensive experience with Spring Framework Familiarity with Google Cloud Platform, particularly BigQuery Solid understanding of software engineering ...
... optimize backend services using Java and Spring Boot to deliver high-throughput, resilient applications for our enterprise clients.- Build and maintain event-driven data pipelines using Kafka to facilitate real-time data processing across distributed systems.- Deploy and manage containerized applications using Docker / Kubernetes.- ...
... of data engineering initiatives. Total Experience: 1-4 years in data engineering or related fields. Solid experience with Databricks, focusing on platform engineering, data engineering, and analytics. Technical Skills: Proficiency in Python, Scala, or Java; strong experience with Databricks APIs, Apache Spark, and Delta ...
... looking for Data Engineer - ML Training Data Pipeline who can Build and maintain the data pipeline that transforms raw production traces into high-quality training datasets for LLM fine-tuning-ingestion, deduplication, format conversion, quality filtering, and train/test splitting at scale on AWS. What We Expect: - Build end-to-end ...
... messaging systems to manage reliable real-time data streaming and asynchronous decoupling. - Optimize high-throughput caching architectures (using Redis) to minimize database overhead for intensive financial computations. Engineering Culture & Execution: - Act as a technical multiplier by mentoring senior engineers, driving proof-of-concepts ...
... SQL, followed by expertise in data storage, modeling, cloud, data warehousing, and data lakes, ETL tools. The Data Engineer Lead will work closely with customer Data Architects, Data Scientists and BI Engineers to design and maintain scalable data models and pipelines. Data engineer lead will transfer requirements to the offshore ...
... integration pipelines within the Informatica Intelligent Data Management Cloud (IDMC) platform. - Databricks Developer: Hands-on experience developing within Databricks workspaces using notebooks and Delta Lake tables. - AWS Cloud Basics: Practical familiarity with core AWS services, specifically S3 data storage, IAM access, ...
Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. AWS AI Services Minimum 3 Year(s) ...
... Experience with system integration, implementation, upgrades, migrations, or technology modernization. - Good understanding of application, infrastructure, cloud, database, networking, or platform technologies relevant to the role. - Familiarity with automation, monitoring, DevOps, CI/CD, cloud platforms, or modern engineering ...
... members of IT, including business analysts, database administrators, and managers, to design and develop Cognos reporting capability- Exhibit a commitment to data quality by validating results against sources specified in the requirements- Develop and maintain stored procedures- Write and support queries against databases ...
... in data security and privacy engineering, this individual deploys and tunes data discovery, classification, DLP, encryption, and key management controls. The Data Protection Engineer partners closely with Engineering, IT, Compliance, Legal, and Privacy stakeholders to embed privacy-by-design principles into how data is ...
About the Role:KPI Partners is seeking a skilled Azure Data Engineer with expertise in data engineering, cloud solutions, and experience with data pipeline development using Azure services. You will play a key role in designing and implementing scalable data solutions that drive insights and business decisions for our https://jobeax.com/link/OBSYxKmspgkYWOcn ...
About the Role:KPI Partners is seeking a skilled Azure Data Engineer with expertise in data engineering, cloud solutions, and experience with data pipeline development using Azure services. You will play a key role in designing and implementing scalable data solutions that drive insights and business decisions for our https://jobeax.com/link/OBSYxKmspgkYWOcn ...
... documentation carrying the quality bar between reviews. Stack: Python, PostgreSQL, Django, server-rendered frontend (htmx). What You Will Own Core Responsibilities / Engineering Focus Deep third-party data ingestion Build reliable ingestion pipelines for external data sources Account for silently dropped webhooks through reconciliation ...
... ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. https://jobeax.com/link/6WcBICn0LM558SP0 AWS AI Services Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education As a Data Engineer, a typical day involves designing, ...
... products or other observability products for reliability and security Experienced with planet scale product development Running and operating SaaS products on AWS Cloud with expert level proficiency Experience with streaming technologies like Kafka, Kafka Streams, or KSQL Expert level experience in one or more of: Java, ...
... technology experience, preferably AWS (Kubernetes, Fargate, S3, MKS, Lambda, etc) A current working understanding of microservices, event driven techniques, and data pipelines A strong proven proficiency in SQL and NoSQL based data access and management Familiarity with async messaging, logging or queues, such as Kafka, NATS, ...