Data Engineer - ML & AI in Hyderabad, India - Jobeax
Vacancy description
Data Engineer - ML & AI in Hyderabad, India
Costco IT
India, Hyderabad
Data Engineer - ML & AI in Hyderabad, India is listed on Jobeax. Browse 30,000+ vacancies available.
About Costco Wholesale: Costco Wholesale is a multi-billion-dollar global retailer with warehouse club operations in eleven countries. They provide a wide selection of quality merchandise, plus the convenience of specialty departments and exclusive member services, all designed to make shopping a pleasurable experience for their members.
At Costco Wholesale India, we foster a collaborative space, working to support Costco Wholesale in developing innovative solutions that improve members’ experiences and make employees’ jobs easier. Our employees play a key role in driving and delivering innovation to establish IT as a core competitive advantage for Costco Wholesale.
Data Engineer
The Data Engineer is responsible for developing data pipelines and/or data integrations of for Costco’s enterprise certified data sets that are used for business critical data consumption use cases (i.e. Reporting, Data Science/Machine Learning, Data APIs, etc.). The Data Engineer will partner with product owners, data architects, and data platform teams to design, build, test, and automate data pipelines that are relied upon across the company as the single source of truth.
Develops and operationalizes data pipelines to bring data into Costco’s GCP landscape for the delivery of certified data sets
Works in tandem with Data Architects, Data Stewards, and Data Quality Engineers to design data pipelines and recommends ongoing optimization of data storage, data ingestion, data quality and orchestration.
Designs, develops, and implements ETL/ELT/CDC processes using Data Build Tool (DBT) and other native GCP Services (BigQuery Subscriptions, Dataproc, Dataflow, etc.)
Uses GCP services such as BigQuery, AlloyDB, Spanner, Dataplex, Pub/Sub, Cloud Storage, etc. to improve and speed delivery of our data products and services.
Identifies, designs, and implements internal process improvements: automating manual processes, optimizing pipeline delivery and support.
Identifies ways to improve data reliability, efficiency, and quality of data management
Participate in off hours 24/7 on call support on a rotational basis
5-8+ years’ experience engineering and operationalizing data pipelines with large and complex datasets.
5-8+ years’ hands-on experience with Data Build Tool (DBT), Dataflow & Dataproc (Spark)
5-8+ years’ experience working with BigQuery, Google Cloud Storage, AlloyDB and Spanner
5-8+ years’ experience with Data Pipeline, ETL/ELT, and Data Warehousing.
Effective use of AI and/or LLMs to increase efficiency in deliverables.
Extensive experience working with various data sources (DB2, SQL,Oracle, flat files (csv, delimited), APIs, XML, JSON).
Experience implementing data integration techniques such as event/message based integration (Kafka, Google Pub/Sub).
Advanced SQL skills; solid understanding of relational databases and business data; ability to write complex SQL queries against a variety of data sources.
Strong understanding of database storage concepts (data lake, relational databases, NoSQL, Graph, data warehousing).
Experience with Git / Azure DevOps / Jira.
CDMP (Certified Data Management Professional) Certification.
... and Generative AI.- Strong hands-on experience with LLMs and LLM-based applications.- Experience with RAG, embeddings, vector databases, prompt engineering, and AI agents.- Experience with AI/ML frameworks and model development libraries.- Strong software engineering fundamentals including APIs, microservices, databases, ...
... Engineering Teams: Provide technical leadership and mentorship to data engineers, fostering a culture of excellence, innovation, and continuous improvement.- AI/ML Enablement: Collaborate with Data Science and ML Engineering teams to operationalize models, implement AI orchestration frameworks (e.g., MLflow, Airflow), ...
... https://jobeax.com/link/ao2QBbKt4vW7ruJ1 Technical Requirements : - 4 to 9 years as an AI/ML engineer with production systems behind you.- Depth across the modern AI stack : LLMs, speech models, vector retrieval, model serving.- Strong software engineering skills.- Fluency in Python and the production ML ecosystem. (ref:hirist.tech)
... systems- capable of executing complex enterprise workflows.- Implement prompt engineering techniques to improve accuracy, reliability, and performance.- Develop AI solutions using - Azure OpenAI, Azure AI Search, and Azure AI Services- .- Build and manage ML/AI workflows using - Databricks, MLflow, and Delta Lake- .- Develop ...
... intelligence and machine learning projects while contributing to meaningful technology initiatives. Responsibilities - Support the development and testing of AI and machine learning solutions under guidance from experienced team members. - Assist with data preparation, exploratory analysis, model experimentation, and performance ...
... fine-tuning.- Practical experience with data curation, model training infrastructure, and large-scale experimentation.- Experience designing and implementing ML evaluation and benchmarking frameworks.- Working knowledge of RL, RLHF, PPO, DPO, or preference optimization techniques.- Strong software engineering and problem-solving ...
... Engineering, Artificial Intelligence, Data Science, or a related discipline. - 6 - 10 years of relevant professional experience in AI/ML, cloud engineering, data science, or related technology domains. - Demonstrated handson experience delivering AI/ML/GenAI solutions. - Experience leading technical teams or AI implementation ...
... workflows. Collaborate with ML engineers and researchers to design challenging, real-world evaluation scenarios for MLE Bench. Minimum 3+ years of experience as a Data Analyst or Analytics-focused Engineer . Strong proficiency in Python for data analysis. Solid experience with SQL and relational datasets. Experience analyzing ...
... development of multi-modal models that integrate vision with language-based features (NLP / LLMs).- Follow best data science and machine learning practices, including data-centric development, experiment tracking, model validation, and reproducibility.- Collaborate with cross-functional teams including software engineers, ML researchers, ...
... Data, Cloud Infrastructure, Data Engineering, and Applied Artificial https://jobeax.com/link/Z4S3vFYKsGGU38on Overview :We are seeking an experienced Senior Data Scientist with end - to - end expertise in modern Generative AI, Large Language Models (LLMs), Agentic workflows, and cloud - native ML infrastructure (Databricks ...
... Data, Cloud Infrastructure, Data Engineering, and Applied Artificial https://jobeax.com/link/Z4S3vFYKsGGU38on Overview :We are seeking an experienced Senior Data Scientist with end - to - end expertise in modern Generative AI, Large Language Models (LLMs), Agentic workflows, and cloud - native ML infrastructure (Databricks ...
... chatbots, Retrieval-Augmented Generation (RAG) pipelines, and agentic AI applications. This is a hands-on technical leadership role you'll architect production-grade AI systems, guide a team of AI/ML engineers, and work closely with Product and Data Engineering to deliver reliable, scalable, and safe AI https://jobeax.com/link/BUuD4rSLiGGi37Y6 ...
... RAG, Agentic AI & End-to-End DeploymentWe are looking for a hands-on Gen AI Engineer who can design, build, deploy, and continuously improve production-grade AI solutions. The ideal candidate should have strong experience across RAG, AI Agents, LLMs, vector databases, Python, FastAPI, cloud deployment, and MLOps/LLMOps.Key ...
... RAG, Agentic AI & End-to-End DeploymentWe are looking for a hands-on Gen AI Engineer who can design, build, deploy, and continuously improve production-grade AI solutions. The ideal candidate should have strong experience across RAG, AI Agents, LLMs, vector databases, Python, FastAPI, cloud deployment, and MLOps/LLMOps.Key ...
... is led by veteran technologists with backgrounds in semiconductor design and AI systems. About the Role EnCharge AI is seeking a highly skilled and experienced AI Compiler Engineer to spearhead the efforts in developing and optimizing graph compilers tailored to cutting-edge AI and ML workloads. You will collaborate with ...
Data Engineer: PySpark+AWS Glue 4-8 years in Data Engineering with hands-on expertise in Snowflake, AWS Glue, AWS (S3/Lambda/CloudWatch), Python, PySpark, and SQL. Strong experience in ETL/ELT, Data Warehousing, Data Pipelines, Performance Tuning, and Cloud Data Platforms. Exposure to AI/ML or GenAI solutions is a plus ...
... Contribute to internal documentation and playbooks for building AI agents. Bachelor's degree in Computer Science, AI/ML, or related field. - 1–3 years of experience in AI/ML, back-end engineering, or LLM-based application development. - Proficiency in Python; Understanding of API integration, vector databases (Pinecone, Weaviate, ...
... Collaborate closely with agent, data, and domain teams to ensure platform abstractions support evolving research and product requirements. 4+ years of backend engineering experience building and operating production-grade, scaled software systems end-to-end. - Hands-on experience operating production ML/AI platforms — model ...