Data Engineer (AI, db) in Pune, India is listed on Jobeax. Browse 30,000+ vacancies available.
Note: This job role is part of MetLife's Hack4Job India (a hiring hackathon). Only shortlisted candidates will be invited. Department: Global Technology
Role Overview MetLife is seeking an experienced Data Engineer to drive our digital and AI transformation journey. This role focuses on building modern data platforms, enhancing data storage and access, and ensuring seamless data consumption through APIs. The ideal candidate will work with Azure Cloud technologies to build robust data pipelines, data lakes, and marts to support business analysts and data scientists.
Key Responsibilities Modern Data Platform Development: Build data lake components on cloud-based platforms Design and develop data marts for business analysts and data scientists Data Engineering & Pipelines: Design data pipelines to integrate structured, semi-structured, and unstructured data from multiple sources Implement ETL/ELT processes to transform and cleanse data Ensure data quality and transformation rules align with Enterprise standards Work with Medallion architecture and implement best practices for data modeling Agile & DevOps Practices: Deliver solutions using Agile methodologies in a CI/CD-driven environment Work on containerized solutions (Azure Kubernetes) and scheduling tools like Azure Scheduler Follow secure coding practices and authentication/authorization protocols
Candidate Qualifications
Education: Bachelor's degree in computer science or equivalent
Experience: 4 - 8 years of experience in data engineering or data application development (ETL/ELT/BI)
2+ years of experience in cloud-based data platform development
Expertise in building Azure-based data pipelines, including:
Azure Data Factory / Synapse
DataBricks / Synapse Spark Pool
Cosmos DB
Azure Data Lake Storage (ADLS)
Dedicated SQL Pool / Azure SQL
Azure Logic Apps
Hands-on experience with data transformation and cleansing using Spark, Python, R, SQL
Strong understanding of CI/CD, test-driven development, and domain-driven design
Skills & Competencies Technical Expertise: Proficiency in Python, SQL, Spark, Azure Data Factory, and ETL processes Experience in secure coding, authentication, and monitoring tools like Veracode, MS Entra, PingOne Working knowledge of Azure Kubernetes, Azure DevOps, SonarQube, and Azure AppInsights Soft Skills: Strong communication and collaboration in a global, multi-cultural environments (experience in a Japanese work environment is a plus) ~ Able to work in a high-paced, diverse environment with a can-do attitude
Language : Business proficiency in English; Japanese language is a plus
This is a great opportunity to be part of MetLife's technology transformation journey.
... encouraged to apply. The Data Engineer will design, build, and maintain scalable data pipelines and solutions, ensuring high performance and reliability across COSMOS DB and related data platforms. Daily responsibilities include modeling and structuring data, implementing ETL processes, optimizing data storage and retrieval, and ...
... business stakeholders to define data requirements, ensuring that the data warehouse architecture aligns with long-term strategic business objectives.- Mentor junior data engineers and establish best practices for SQL development, code reviews, and version control to maintain high engineering standards across the https://jobeax.com/link/9XbfiWZXvAUTHpWi ...
Job Title : Data Engineer (Snowflake & dbt/Matillion Specialist)Location : Hyderabad (On-site, 5 Days/Week)Experience : 3-5 YearsEducation : B.E./B.Tech (Mandatory)About the Role :We are seeking an experienced and results-driven Data Engineer to join our growing Data Engineering team. You will be instrumental in ingesting, ...
Must-Have Skills :- 9+ years of relevant experience in Data Engineering and project delivery.- Strong expertise in Big Data concepts and cloud implementation projects.- Proficient in Snowflake, SQL, and AWS services (Glue, EMR, S3, Aurora, RDS, AWS architecture).- Excellent hands-on experience with Python, PySpark, and ...
Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. https://jobeax.com/link/6WcBICn0LM558SP0 ...
... degree in computer science, Information Technology, Engineering, or a related field. - Bachelor’s/Master’s degree in Computer Science, Information Technology, Engineering, or related field. - 8+ years of experience in Devops and 3+ years in DBX. - Strong hands-on experience in Databricks (Spark, Delta Lake, PySpark, MLflow). ...
... policies, spot-instance strategies, DBU budget alerts, and compute right-sizing recommendations to optimise the platform spend within approved budgets. Partner with Data Scientists, AI Engineers, Data Engineers, and Business stakeholders to productionise models rapidly without sacrificing quality or compliance. Establish and evangelise ...
... manage schema evolution, and maintain high data availability . Implement data governance , version control, and CI/CD best practices. Monitor and troubleshoot data pipelines for continuous reliability and efficiency improvements . Why Join KANINI? Join KANINI’s award-winning Data Engineering Team, recognized as the "Outstanding ...
... Produce high quality, sustainable solutions to meet business requirements, leveraging approved delivery frameworks and by applying industry best practice. Deliver data engineering solutions aligned to core concepts of data design, preparation, transformation, and load. Build and implement data pipelines in distributed data platforms ...
... clients span autonomous mobility, medical AI, agriculture, and more—powering next-generation AI systems with high-quality data services. We are seeking a skilled Data Engineer to help scale and enhance our internal data observability and analytics platform. This platform integrates with data annotation tools and ML pipelines ...
... business and technical requirements. Implement secure platforms with data governance in mind. Play a key role in automation and building industry leading solutions against architectural best practices. Deliver data migrations between legacy & modern platforms Design & deliver data warehousing solutions and key data engineering ...
... query optimization and data access strategies for APIs serving real-time compliance dashboards, establishing benchmarks and SLOs Lead data infrastructure work for AI/ML features, including dataset curation, feature engineering, and pipeline design supporting cloud-native AI capabilities Define and enforce data quality standards, ...
... certified data sets Works in tandem with Data Architects, Data Stewards, and Data Quality Engineers to design data pipelines and recommends ongoing optimization of data storage, data ingestion, data quality and orchestration. Designs, develops, and implements ETL/ELT/CDC processes using Data Build Tool (DBT) and other native ...
... multi-tenant, cloud-native apps. Hands-on with LLMs, RAG, agentic frameworks (e.g., LangChain, LangGraph, MCP). Strong Python/ML stack, REST/gRPC integration, vector DBs. SAP BTP & HANA experience Databricks or similar data pipelines. Nice to Have: Certifications: Data Engineering Certified Professional or similar certifications. ...
... ground up with new age technology to simplify the consumption of data for our customers in various industry verticals. We are looking for a skilled and motivated Data Engineer to design, build, and maintain scalable data pipelines and data infrastructure. You will work closely with Data Science, Engineering, and Product teams ...
... currently seeking a AWS Data & AI Platform Engineer to join our team in Hyderabad, Karnātaka (IN-KA), India (IN). We are seeking an experienced AI Platform Engineer to build and operate secure, scalable AI platforms on AWS for regulated financial services environments. This role focuses on enabling generative AI and advanced ...
... Angular Runtime / Integration: https://jobeax.com/link/JSd7UYCSg572jJDY, Kafka, Docker, REST & GraphQL Databases: Strong experience with both Relational (Oracle DB) and NoSQL (Mongo DB, Redis DB) databases Development Practices: Test Driven Development (TDD), Agile Scrum or Kanban Leverage AI agents to improve design, development ...
Role Overview:Seeking a highly skilled Senior Data Engineer with deep expertise in Databricks, Real-Time Data Processing, Lakehouse Architecture, and AI-driven solutions. The role involves designing, developing, and supporting scalable data platforms and streaming pipelines, leveraging modern Databricks capabilities such ...