Back to list

Vacancy description

AI Data Engineer in Hyderabad, भारत

HiringBlaze

  • HybridMix of office and remote

Hyderabad, भारत

Description : Role : AI Data Engineer- Location : Rai Durg, Hyderabad- Work mode- Hybrid model working (3 days work from office)- Experience : 5 - 8 Years (Minimum 5 years- AI Data Engineer)- Mandatory Skills : DVC (Data Version Control) and Airflow, Apache Spark, Flink, and Kafka, Advanced level Python and AI logic and Rust (or C++), Vector Database Mastery like configuration of HNSW indexes, scalar quantization, and metadata filtering strategies- Qualification : Bachelor of Engineering - Bachelor of Technology (B.E./B.Tech.)- Notice period : Immediate / early joiners (Max. 15-30 days)- Interview Process : 2 - 3 Technical roundsImportant Note : - We are currently prioritizing immediate / early joiners (maximum 15-30 days- notice period above 30 days will be automatically rejected.).- All mandatory technical skills must be clearly highlighted within the project descriptions in your resume, not just listed in the Skills or Roles & Responsibilities sections .Position Overview : We are seeking a hardcore, hands-on AI Data Engineer to build the high-performance data infrastructure required to power autonomous AI agents. You won't just be moving data from A to B; you will be architecting Dynamic Context Windows, managing Real-time Semantic Indexes, and building Self-Cleaning Data Pipelines that feed our "Super Employee" https://jobeax.com/link/qgXi820YIqv76aTa Responsibilities : - Vector & Graph ETL : Design and maintain pipelines that transform unstructured data (PDFs, emails, logs, chats) into optimized embeddings for Vector Databases (Pinecone, Weaviate, Milvus).- Semantic Data Modeling : Engineer data structures that optimize for Retrieval-Augmented Generation (RAG), ensuring agents find the "needle in the haystack" in milliseconds.- Knowledge Graph Construction : Build and scale Knowledge Graphs (Neo4j) to represent complex relationships in our trading and support data that standard vector search misses.- Automated Data Labeling & Synthetic Data : Implement pipelines using LLMs to auto-label datasets or generate synthetic edge cases for agent training and evaluation.- Stream Processing for Agents : Build real-time data "listeners" (Kafka/Flink) that feed live context to agents, allowing them to react to market or support events as they happen.- Data Reliability & "Drift" Detection : Build monitoring for "Embedding Drift", identifying when the statistical distribution of your data changes and the agent's "knowledge" becomes https://jobeax.com/link/Ihs9cu3PQNeDshwT : - Vector Database Mastery : Expert-level configuration of HNSW indexes, scalar quantization, and metadata filtering strategies within Pinecone, Milvus, or Qdrant.- Advanced Python & Rust : Proficiency in Python for AI logic and Rust (or C++) for high-performance data processing and custom embedding functions.- Big Data Ecosystem : Hands-on experience with Apache Spark, Flink, and Kafka in a high-throughput environment (Trading/FinTech preferred).- LLM Data Tooling : Deep experience with https://jobeax.com/link/1lOjIu2fd7dmCYhc, LlamaIndex, or LangChain for document parsing and chunking strategy optimization.- MLOps & DataOps : Mastery of DVC (Data Version Control) and Airflow/Prefect for managing complex, non-linear AI data workflows.- Embedding Models : Understanding of how to fine-tune embedding models (e.g., BGE, Cohere, or OpenAI) to better represent domain-specific (Trading) https://jobeax.com/link/B7JgmJnk9Gb8T8WR qualifications : - Chunking Strategy Architect : You don't just "split text." You implement Semantic Chunking and Parent-Child retrieval strategies to maximize LLM context relevance.- Cold/Warm/Hot Storage Strategy : Managing cost and latency by tiering data between Vector DBs (Hot), SQL/NoSQL (Warm), and S3/Data Lakes (Cold).- Privacy & Redaction Pipelines : Building automated PII (Personally Identifiable Information) redaction into the ingestion layer to ensure agents never "see" or "leak" sensitive user https://jobeax.com/link/jxiWW6aO1hr4DktS Join ?- Opportunity to lead transformative initiatives, modernizing legacy systems and shaping the future of trading technology.- Work with cutting-edge technologies in a dynamic, fast-paced environment.- Competitive compensation, professional growth opportunities, and the chance to work with industry-leading experts. (ref:hirist.tech)

Similar vacancies

More like this role

  • AI / ML
... such as Anthropic Claude.- AI Data Pipeline Engineering : Build and optimize pipeline architectures explicitly tailored for AI use cases, including unstructured data ingestion, real-time feature tokenization, and metadata tagging for vector databases.- Legacy Infrastructure Maintenance : Monitor, maintain, and troubleshoot ...

Noida, भारत

  • AI / ML
... such as Anthropic Claude.- AI Data Pipeline Engineering : Build and optimize pipeline architectures explicitly tailored for AI use cases, including unstructured data ingestion, real-time feature tokenization, and metadata tagging for vector databases.- Legacy Infrastructure Maintenance : Monitor, maintain, and troubleshoot ...

Gurgaon, भारत

  • Full-time
  • Contract
  • Product Management
... and data platform matters on eCTS. - Guide engineers on data design decisions, performance tuning, and best practices, including how to work effectively with AI coding and data tools. - Review database changes and pull requests, ensuring quality, consistency, and maintainability. - Balance long-term data architecture health ...

Bangalore, भारत

AI-Augmented Data EngineerRole : AI-Augmented Data EngineerEmployment Type : ContractualJob Summary :We are looking for an AI-Augmented Data Engineer to design, develop and maintain scalable data pipelines and infrastructure while leveraging AI-powered tools to improve engineering productivity and data processing https://jobeax.com/link/oKawmWwZiU9CLACB ...

Chennai, भारत

  • Contract
  • IT
... within. WHAT YOU'LL DO Software Engineer - Data & AI on the Proprietary Research team design and build Data & AI Platform to transform structured and unstructured data into actionable insights. As a member of our Data Engineering team, you will work closely with investment professionals, researchers, and data scientists to design, ...

Bangalore, भारत

  • Full-time
  • IT

$14.68 USD

... (GIB.A) and the NYSE (GIB). Learn more at cgi.com. Job Title: Data Engineer with AI Position: Software Engineer Experience: 1–4 Years Category: Data & Analytics / Data Engineering Main Location: Bangalore Position ID: J1126-0226 Employment Type: Full Time Position Description: We are looking for a Data Engineer with AI to join ...

Bangalore, भारत

  • Full-time
  • IT

$14.68 USD

... (GIB). Learn more at cgi.com. Job Title: Data Engineer with AI Position: Software Engineer Experience: 6–12 Years Category: Data & Analytics / Data Engineering Main Location: Bangalore Position ID: J1126-0227 Employment Type: Full Time Position Description: We are looking for an experienced Data Engineer with AI to join our ...

Bangalore, भारत

Key Responsibilities : Data Lake and Data Engineering : - Design, develop and maintain scalable ETL/ELT pipelines using Snowflake, AWS Glue, SQL and Python.- Build and maintain curated, reusable and governed data products for BI, analytics, Data Science and AI use cases.- Contribute to the architecture and development of ...

Bangalore, भारत

  • Remote
  • Hybrid
  • Full-time
... hand-holding.- Good engineering judgment and clear https://jobeax.com/link/oqpc9uWpkvO7RA6l sets you apart (AI-native) : - You use AI tools daily in your own engineering work.- You have used AI, LLMs, or ML to process, clean, or resolve data, or you are excited to.- Not just to write code, but on the data itself.- You think ...

Bangalore, भारत

... a market-leading AI https://jobeax.com/link/sas8PD1bUY4AoNlc We're Looking For :Experience & Education :- Master's or Ph.D in Statistics, Computer Science, Engineering, or a related quantitative field.- 10+ years of experience in Data Science, Marketing Analytics, or Predictive Modeling, with proven leadership https://jobeax.com/link/OuFv9sJGsrMHfZrN ...

Bangalore, भारत