Data Engineer (AI, db) in Pune, India is listed on Jobeax. Browse 30,000+ vacancies available.
Note: This job role is part of MetLife's Hack4Job India (a hiring hackathon). Only shortlisted candidates will be invited. Department: Global Technology
Role Overview MetLife is seeking an experienced Data Engineer to drive our digital and AI transformation journey. This role focuses on building modern data platforms, enhancing data storage and access, and ensuring seamless data consumption through APIs. The ideal candidate will work with Azure Cloud technologies to build robust data pipelines, data lakes, and marts to support business analysts and data scientists.
Key Responsibilities Modern Data Platform Development: Build data lake components on cloud-based platforms Design and develop data marts for business analysts and data scientists Data Engineering & Pipelines: Design data pipelines to integrate structured, semi-structured, and unstructured data from multiple sources Implement ETL/ELT processes to transform and cleanse data Ensure data quality and transformation rules align with Enterprise standards Work with Medallion architecture and implement best practices for data modeling Agile & DevOps Practices: Deliver solutions using Agile methodologies in a CI/CD-driven environment Work on containerized solutions (Azure Kubernetes) and scheduling tools like Azure Scheduler Follow secure coding practices and authentication/authorization protocols
Candidate Qualifications
Education: Bachelor's degree in computer science or equivalent
Experience: 4 - 8 years of experience in data engineering or data application development (ETL/ELT/BI)
2+ years of experience in cloud-based data platform development
Expertise in building Azure-based data pipelines, including:
Azure Data Factory / Synapse
DataBricks / Synapse Spark Pool
Cosmos DB
Azure Data Lake Storage (ADLS)
Dedicated SQL Pool / Azure SQL
Azure Logic Apps
Hands-on experience with data transformation and cleansing using Spark, Python, R, SQL
Strong understanding of CI/CD, test-driven development, and domain-driven design
Skills & Competencies Technical Expertise: Proficiency in Python, SQL, Spark, Azure Data Factory, and ETL processes Experience in secure coding, authentication, and monitoring tools like Veracode, MS Entra, PingOne Working knowledge of Azure Kubernetes, Azure DevOps, SonarQube, and Azure AppInsights Soft Skills: Strong communication and collaboration in a global, multi-cultural environments (experience in a Japanese work environment is a plus) ~ Able to work in a high-paced, diverse environment with a can-do attitude
Language : Business proficiency in English; Japanese language is a plus
This is a great opportunity to be part of MetLife's technology transformation journey.
... may be invited to take part in online projects such as rating AI-generated content, evaluating factual accuracy, or comparing responses — when projects are available. While each project involves unique tasks, contributors may: - Carefully review provided data (text, images, or videos); - Label or classify content based ...
... may be invited to take part in online projects such as rating AI-generated content, evaluating factual accuracy, or comparing responses — when projects are available. While each project involves unique tasks, contributors may: - Carefully review provided data (text, images, or videos); - Label or classify content based ...
... may be invited to take part in online projects such as rating AI-generated content, evaluating factual accuracy, or comparing responses — when projects are available. While each project involves unique tasks, contributors may: - Carefully review provided data (text, images, or videos); - Label or classify content based ...
... may be invited to take part in online projects such as rating AI-generated content, evaluating factual accuracy, or comparing responses — when projects are available. While each project involves unique tasks, contributors may: - Carefully review provided data (text, images, or videos); - Label or classify content based ...
... principles, clean coding standards, and design patterns. Machine Learning Libraries: Advanced proficiency in scikit-learn (sklearn) for data preprocessing, feature engineering, and baseline modelling. Deep Learning Frameworks: Core expertise in PyTorch (preferred) or TensorFlow for building, customizing, and training deep neural ...
... SLA responsibility in an ML/AI data operations environment - Knowledge of databases (SQL, MySQL) and Advanced Excel experience working with and analyzing large datasets to drive business improvements - Familiarity with ML data annotation workflows, labeling tools, or AI/ML program operations - Experience working in geographically ...
... may be invited to take part in online projects such as rating AI-generated content, evaluating factual accuracy, or comparing responses — when projects are available. While each project involves unique tasks, contributors may: - Carefully review provided data (text, images, or videos); - Label or classify content based ...
... Develop production-ready code and perform data analysis with Python and SQL Create workflows for model development and apply feature engineering methods Use Azure AI Search to make data and models easier to consume for business needs Coordinate with developers and project managers using GitLab and Jira Refine data pipelines ...
... statistics, ML classification, time-series modeling). - Integrate outputs with downstream systems (dashboards, APIs, ML models) to support digital agronomy and sustainability reporting. - Maintain data quality, document methodologies, and support junior geospatial analysts. - Promote best practices in model development and code ...
... may be invited to take part in online projects such as rating AI-generated content, evaluating factual accuracy, or comparing responses — when projects are available. While each project involves unique tasks, contributors may: - Carefully review provided data (text, images, or videos); - Label or classify content based ...
... applications for accuracy, latency, and cost. Implement data preprocessing, feature engineering, and ML model training workflows. Work with structured and unstructured datasets to solve business problems. Collaborate with Product Managers, Software Engineers, and Subject Matter Experts to deliver AI-driven features. Monitor model ...
... may be invited to take part in online projects such as rating AI-generated content, evaluating factual accuracy, or comparing responses — when projects are available. While each project involves unique tasks, contributors may: - Carefully review provided data (text, images, or videos); - Label or classify content based ...
... automation, machine learning or generative AI, rather than applying AI by default. Commitment to continuous learning in data, AI, cloud engineering and the maritime domain. Reliable, maintainable and well-tested data and AI workflows that improve product quality and team efficiency. Clear evidence that AI-assisted outputs are evaluated, ...
... generation (RAG) systems Develop and optimize prompts, evaluation frameworks, and guardrails for LLM-powered applications Engineer scalable data and ML pipelines in Databricks using PySpark, Delta Lake, and MLflow Deploy, monitor, and maintain models in production on Azure (Azure AI Foundry, Azure OpenAI, Azure Functions, AKS), ...
... Strategists to translate model outputs into actionable credit limits, cutoff thresholds, and loss-forecasting simulations. - Platform Architecture: Collaborate with Data Platform Engineers to build reliable pipelines and high-throughput feature extraction. - Raise the technical bar through peer reviews, reusable tooling, and pro-active ...
... may be invited to take part in online projects such as rating AI-generated content, evaluating factual accuracy, or comparing responses — when projects are available. While each project involves unique tasks, contributors may: - Carefully review provided data (text, images, or videos); - Label or classify content based ...
... scalable solutions Generate actionable insights through data analysis and modeling Deploy, monitor, and improve model performance Qualifications - Bachelor's/Master's in Computer Science, Data Science, Engineering, or related field - 3–8 years of relevant experience Skills: data scientist,genai,python,sql,pyspark,aiml,ml
Enterprise Data & AI Solution ArchitectJob SummaryAs an Enterprise Data & AI Solution Architect within Darktrace's TechOps Centre, you will lead the design and evolution of enterprise data, analytics and AI solutions across Darktrace's Microsoft technology https://jobeax.com/link/8eCu4g68SO5sOI6t with business, data, technology, ...
... candidate will leverage generative AI and large language models (LLM) to enhance our data-driven decision-making processes. Key responsibilities : Design and develop data models using generative AI and LLM technologies. Implement retrieval-augmented generation techniques to improve data accessibility. Analyze complex datasets to ...
... to help create sustainable solutions that improve quality of life and meet society's evolving needs. Work with data scientists, data analysts, computational engineers, machine learning engineers, software developers, or business representatives across our global organization to research, develop, and deliver data science ...