Papigen
AI Engineer
- AI / ML
India, भारत
Vacancy description
Crescendo Global Leadership Hiring India Pvt Ltd
500k
Gurgaon, भारत
Role : AI Engineer (Python & GEN AI - GCP - LLM - RAG)Exp : 7 - 12 yearsLocation : Gurugram/Bangalore/PuneEmployment Type : Full-timeWe are looking for AI Engineers for Claims Intelligence & Data Pipelines work and GCP https://jobeax.com/link/4Z6ZpJ6utwrpL5Ty You Will Do :AI Module Integration & Inference Pipelines :- Integrate and adjust inference pipelines for NLP modules including document classification, entity extraction, de-identification (DEID), and LLM-based early trend detection.- Connect DS-coded AI modules into end-to-end production workflows via Airflow DAGs on AWS EKS.- Build and tune hybrid search pipelines combining GTE multilingual dense embeddings with GIN lexical search on Aurora PostgreSQL.- Integrate with OpenAI-based API platform for multilingual query expansion and LLM-driven trend https://jobeax.com/link/IPztz0IOpiK1tlR8 Processing & Parsing :- Design and maintain document preprocessing pipelines that parse deeply nested JSON structures (emails with attachments, embedded PDFs) from S3/DataLake.- Handle multilingual unstructured text (English, Spanish, Portuguese, German, Dutch, French, Italian) across 300 GB of claim notes and documents.- Build chunking strategies and metadata extraction for downstream embedding and retrieval https://jobeax.com/link/0MzQQRjPtbLjqG16 Pipeline Engineering :- Author and maintain Airflow DAGs for batch processing (monthly entity refresh, trend detection, DEID pipeline).- Manage data flow across AWS services: S3, Athena, Glue, Fargate, SQS, Step Functions.- Scale pipelines to handle 500K+ claims and hundreds of millions of text https://jobeax.com/link/meJ8vd0TLnD73f4u Deployment & Quality :- Deploy and version models using MLflow and Databricks.- Manage schema evolution and migrations using Liquibase on Aurora PostgreSQL.- Instrument pipelines with logging, monitoring, and evaluation scoring for retrieval https://jobeax.com/link/s1TSLrTZCAbltCc4 Skills :Area Skills :- Languages : Python (primary), SQL- AI / NLP : LLM API integration, multilingual embeddings (e.g., GTE), hybrid search, text classification, entity extraction, NER, PII masking- Data Pipelines : Apache Airflow, batch orchestration, large-scale unstructured data processing- Cloud & Infrastructure : GCP Preferred- Databases : PostgreSQL / Aurora, pgvector, GIN indexes, full-text search- ML Platform : MLflow, Databricks / Azure Databricks- DevOps : GitHub, CI/CD pipelinesNice to Have :- Experience with RAG (Retrieval-Augmented Generation) pipeline design and evaluation- Familiarity with insurance claims or financial services data- Experience with multilingual NLP at scale- Knowledge of Liquibase for database schema management- Exposure to Runway Model Catalog or similar model deployment platforms (ref:hirist.tech)
Similar vacancies
Papigen
India, भारत
Supply chain domain Tech product company
Noida, भारत
Certa
India, भारत
Antrors
Jaipur, भारत
metro global solution center in
€31 EUR
Pune, भारत
BIG IDEAS SOCIAL MEDIA RECRUITMENT PVT LTD
Bangalore, भारत
Quantum Strides LLC
Chennai, भारत
Luxoft
Chennai, भारत
AMINA Group
Bombay, भारत
Dunnhumby
Rs 5000 per month
Gurgaon, भारत