Back to list

Vacancy description

AI Data Engineer in Hyderabad, भारत

HiringBlaze

  • HybridMix of office and remote

Hyderabad, भारत

Description : Role : AI Data Engineer- Location : Rai Durg, Hyderabad- Work mode- Hybrid model working (3 days work from office)- Experience : 5 - 8 Years (Minimum 5 years- AI Data Engineer)- Mandatory Skills : DVC (Data Version Control) and Airflow, Apache Spark, Flink, and Kafka, Advanced level Python and AI logic and Rust (or C++), Vector Database Mastery like configuration of HNSW indexes, scalar quantization, and metadata filtering strategies- Qualification : Bachelor of Engineering - Bachelor of Technology (B.E./B.Tech.)- Notice period : Immediate / early joiners (Max. 15-30 days)- Interview Process : 2 - 3 Technical roundsImportant Note : - We are currently prioritizing immediate / early joiners (maximum 15-30 days- notice period above 30 days will be automatically rejected.).- All mandatory technical skills must be clearly highlighted within the project descriptions in your resume, not just listed in the Skills or Roles & Responsibilities sections .Position Overview : We are seeking a hardcore, hands-on AI Data Engineer to build the high-performance data infrastructure required to power autonomous AI agents. You won't just be moving data from A to B; you will be architecting Dynamic Context Windows, managing Real-time Semantic Indexes, and building Self-Cleaning Data Pipelines that feed our "Super Employee" https://jobeax.com/link/qgXi820YIqv76aTa Responsibilities : - Vector & Graph ETL : Design and maintain pipelines that transform unstructured data (PDFs, emails, logs, chats) into optimized embeddings for Vector Databases (Pinecone, Weaviate, Milvus).- Semantic Data Modeling : Engineer data structures that optimize for Retrieval-Augmented Generation (RAG), ensuring agents find the "needle in the haystack" in milliseconds.- Knowledge Graph Construction : Build and scale Knowledge Graphs (Neo4j) to represent complex relationships in our trading and support data that standard vector search misses.- Automated Data Labeling & Synthetic Data : Implement pipelines using LLMs to auto-label datasets or generate synthetic edge cases for agent training and evaluation.- Stream Processing for Agents : Build real-time data "listeners" (Kafka/Flink) that feed live context to agents, allowing them to react to market or support events as they happen.- Data Reliability & "Drift" Detection : Build monitoring for "Embedding Drift", identifying when the statistical distribution of your data changes and the agent's "knowledge" becomes https://jobeax.com/link/Ihs9cu3PQNeDshwT : - Vector Database Mastery : Expert-level configuration of HNSW indexes, scalar quantization, and metadata filtering strategies within Pinecone, Milvus, or Qdrant.- Advanced Python & Rust : Proficiency in Python for AI logic and Rust (or C++) for high-performance data processing and custom embedding functions.- Big Data Ecosystem : Hands-on experience with Apache Spark, Flink, and Kafka in a high-throughput environment (Trading/FinTech preferred).- LLM Data Tooling : Deep experience with https://jobeax.com/link/1lOjIu2fd7dmCYhc, LlamaIndex, or LangChain for document parsing and chunking strategy optimization.- MLOps & DataOps : Mastery of DVC (Data Version Control) and Airflow/Prefect for managing complex, non-linear AI data workflows.- Embedding Models : Understanding of how to fine-tune embedding models (e.g., BGE, Cohere, or OpenAI) to better represent domain-specific (Trading) https://jobeax.com/link/B7JgmJnk9Gb8T8WR qualifications : - Chunking Strategy Architect : You don't just "split text." You implement Semantic Chunking and Parent-Child retrieval strategies to maximize LLM context relevance.- Cold/Warm/Hot Storage Strategy : Managing cost and latency by tiering data between Vector DBs (Hot), SQL/NoSQL (Warm), and S3/Data Lakes (Cold).- Privacy & Redaction Pipelines : Building automated PII (Personally Identifiable Information) redaction into the ingestion layer to ensure agents never "see" or "leak" sensitive user https://jobeax.com/link/jxiWW6aO1hr4DktS Join ?- Opportunity to lead transformative initiatives, modernizing legacy systems and shaping the future of trading technology.- Work with cutting-edge technologies in a dynamic, fast-paced environment.- Competitive compensation, professional growth opportunities, and the chance to work with industry-leading experts. (ref:hirist.tech)

Similar vacancies

More like this role

  • AI / ML
... such as Anthropic Claude.- AI Data Pipeline Engineering : Build and optimize pipeline architectures explicitly tailored for AI use cases, including unstructured data ingestion, real-time feature tokenization, and metadata tagging for vector databases.- Legacy Infrastructure Maintenance : Monitor, maintain, and troubleshoot ...

Noida, भारत

  • AI / ML
... such as Anthropic Claude.- AI Data Pipeline Engineering : Build and optimize pipeline architectures explicitly tailored for AI use cases, including unstructured data ingestion, real-time feature tokenization, and metadata tagging for vector databases.- Legacy Infrastructure Maintenance : Monitor, maintain, and troubleshoot ...

Gurgaon, भारत

Boston Consulting Group

Lead Delivery AI Data Engineer

  • Hybrid
  • On-site
  • Full-time
... - Bachelor’s or Master’s degree in Computer Science, Engineering, Technology, Data Science or a related technical field. - 8+ years of relevant experience in data engineering, data platforms, or enterprise AI/data solution delivery. - Proven experience leading production-grade data engineering programs, with hands-on involvement ...

Gurgaon, भारत

  • Full-time
  • Contract
  • Product Management
... and data platform matters on eCTS. - Guide engineers on data design decisions, performance tuning, and best practices, including how to work effectively with AI coding and data tools. - Review database changes and pull requests, ensuring quality, consistency, and maintainability. - Balance long-term data architecture health ...

Bangalore, भारत

AI-Augmented Data EngineerRole : AI-Augmented Data EngineerEmployment Type : ContractualJob Summary :We are looking for an AI-Augmented Data Engineer to design, develop and maintain scalable data pipelines and infrastructure while leveraging AI-powered tools to improve engineering productivity and data processing https://jobeax.com/link/oKawmWwZiU9CLACB ...

Chennai, भारत

  • Contract
  • IT
... within. WHAT YOU'LL DO Software Engineer - Data & AI on the Proprietary Research team design and build Data & AI Platform to transform structured and unstructured data into actionable insights. As a member of our Data Engineering team, you will work closely with investment professionals, researchers, and data scientists to design, ...

Bangalore, भारत

... (GIB.A) and the NYSE (GIB). Learn more at cgi.com. Job Title: Data Engineer with AI Position: Software Engineer Experience: 1–4 Years Category: Data & Analytics / Data Engineering Main Location: Bangalore Position ID: J1126-0226 Employment Type: Full Time Position Description: We are looking for a Data Engineer with AI to join ...

Bangalore, भारत

  • Full-time
  • IT

$14.68 USD

... (GIB.A) and the NYSE (GIB). Learn more at cgi.com. Job Title: Data Engineer with AI Position: Software Engineer Experience: 1–4 Years Category: Data & Analytics / Data Engineering Main Location: Bangalore Position ID: J1126-0226 Employment Type: Full Time Position Description: We are looking for a Data Engineer with AI to join ...

Bangalore, भारत

  • Full-time
  • IT

$14.68 USD

... (GIB). Learn more at cgi.com. Job Title: Data Engineer with AI Position: Software Engineer Experience: 6–12 Years Category: Data & Analytics / Data Engineering Main Location: Bangalore Position ID: J1126-0227 Employment Type: Full Time Position Description: We are looking for an experienced Data Engineer with AI to join our ...

Bangalore, भारत

Key Responsibilities : Data Lake and Data Engineering : - Design, develop and maintain scalable ETL/ELT pipelines using Snowflake, AWS Glue, SQL and Python.- Build and maintain curated, reusable and governed data products for BI, analytics, Data Science and AI use cases.- Contribute to the architecture and development of ...

Bangalore, भारत