Data Engineer - ML & AI in Hyderabad, India - Jobeax
Vacancy description
Data Engineer - ML & AI in Hyderabad, India
Costco IT
India, Hyderabad
Data Engineer - ML & AI in Hyderabad, India is listed on Jobeax. Browse 30,000+ vacancies available.
About Costco Wholesale: Costco Wholesale is a multi-billion-dollar global retailer with warehouse club operations in eleven countries. They provide a wide selection of quality merchandise, plus the convenience of specialty departments and exclusive member services, all designed to make shopping a pleasurable experience for their members.
At Costco Wholesale India, we foster a collaborative space, working to support Costco Wholesale in developing innovative solutions that improve members’ experiences and make employees’ jobs easier. Our employees play a key role in driving and delivering innovation to establish IT as a core competitive advantage for Costco Wholesale.
Data Engineer
The Data Engineer is responsible for developing data pipelines and/or data integrations of for Costco’s enterprise certified data sets that are used for business critical data consumption use cases (i.e. Reporting, Data Science/Machine Learning, Data APIs, etc.). The Data Engineer will partner with product owners, data architects, and data platform teams to design, build, test, and automate data pipelines that are relied upon across the company as the single source of truth.
Develops and operationalizes data pipelines to bring data into Costco’s GCP landscape for the delivery of certified data sets
Works in tandem with Data Architects, Data Stewards, and Data Quality Engineers to design data pipelines and recommends ongoing optimization of data storage, data ingestion, data quality and orchestration.
Designs, develops, and implements ETL/ELT/CDC processes using Data Build Tool (DBT) and other native GCP Services (BigQuery Subscriptions, Dataproc, Dataflow, etc.)
Uses GCP services such as BigQuery, AlloyDB, Spanner, Dataplex, Pub/Sub, Cloud Storage, etc. to improve and speed delivery of our data products and services.
Identifies, designs, and implements internal process improvements: automating manual processes, optimizing pipeline delivery and support.
Identifies ways to improve data reliability, efficiency, and quality of data management
Participate in off hours 24/7 on call support on a rotational basis
5-8+ years’ experience engineering and operationalizing data pipelines with large and complex datasets.
5-8+ years’ hands-on experience with Data Build Tool (DBT), Dataflow & Dataproc (Spark)
5-8+ years’ experience working with BigQuery, Google Cloud Storage, AlloyDB and Spanner
5-8+ years’ experience with Data Pipeline, ETL/ELT, and Data Warehousing.
Effective use of AI and/or LLMs to increase efficiency in deliverables.
Extensive experience working with various data sources (DB2, SQL,Oracle, flat files (csv, delimited), APIs, XML, JSON).
Experience implementing data integration techniques such as event/message based integration (Kafka, Google Pub/Sub).
Advanced SQL skills; solid understanding of relational databases and business data; ability to write complex SQL queries against a variety of data sources.
Strong understanding of database storage concepts (data lake, relational databases, NoSQL, Graph, data warehousing).
Experience with Git / Azure DevOps / Jira.
CDMP (Certified Data Management Professional) Certification.
Role –Gen AI Engineer Location: PAN India Exp: 5+ years Mode Of Interview - F2F Job Description Collect and prepare data for training and evaluating multimodal foundation models. This may involve cleaning and processing text data or creating synthetic data. Develop and optimize large-scale language models like GANs (Generative ...
... Glue, SageMaker), Azure, or GCP. - Strong background in data engineering: ETL/ELT pipelines, data modeling, SQL, and data warehouse technologies (Snowflake, Databricks preferred). - Experience with REST APIs, GraphQL, and enterprise system integrations (CRM, ERP, data marketplaces). - Familiarity with containerization ...
... probability, data mining and data cleaning . - Strong experience with SQL and Python ML packages such as Scikit-learn, XGBoost and Keras. - Experience in building data pipelines and working with at least one cloud platform . - Good knowledge of Git, GitLab and CI/CD . - Familiarity with AI ethics and Responsible AI practices ...
... and implement effective solutions.- Participate in design discussions, code reviews, technical documentation, and architecture decisions.- Work closely with Data Scientists, AI/ML Engineers, Architects, QA, DevOps, and Product teams.- Follow Agile/Scrum practices and contribute across the complete software development ...
... practical Java experience - 2 years of experience with prompt engineering and prompt/agent scripting - 2 years of hands-on experience integrating third-party AI/ML services and platform APIs (e.g., OpenAI, Anthropic, Salesforce and other SaaS) - Proven ability to design and manage domain-specific languages, prompt templates, ...
... Prompt Engineering, and AI solution design.- Experience designing enterprise-scale AI, data, cloud, and integration architectures.- Hands-on experience with Azure AI Services, Azure OpenAI, AWS AI/ML, GCP AI, or equivalent cloud AI ecosystems.- Strong understanding of MLOps, data pipelines, API integrations, and modern AI application ...
... performance.- Develop and optimize AI-driven extraction workflows using document parsing, chunking, embeddings, RAG, and LLM-based extraction methods.- Deploy and scale AI models on AWS and Azure (SageMaker, Bedrock, Azure AI Foundry) with seamless integration into data pipelines.- Build and maintain CI/CD pipelines for AI model ...
... performance.- Develop and optimize AI-driven extraction workflows using document parsing, chunking, embeddings, RAG, and LLM-based extraction methods.- Deploy and scale AI models on AWS and Azure (SageMaker, Bedrock, Azure AI Foundry) with seamless integration into data pipelines.- Build and maintain CI/CD pipelines for AI model ...
... building intelligent systems, working with large datasets, and developing scalable AI/ML https://jobeax.com/link/XnflZD2dGSZYgXFG Responsibilities :- Build, train, and optimize Machine Learning and AI models- Work on data analysis, feature engineering, and model evaluation- Develop scalable AI/ML pipelines and workflows- ...
... & Key Skills :- Bachelor's/Master's degree in Computer Science, Engineering, Data Science, or related field.- 5+ years of experience in ML Engineering, AI Engineering, MLOps, or related roles.- Strong Python and software engineering skills with experience building production ML/AI systems.- Hands-on experience with ML ...
... MetLife is seeking an experienced Data Engineer to drive our digital and AI transformation journey. This role focuses on building modern data platforms, enhancing data storage and access, and ensuring seamless data consumption through APIs. The ideal candidate will work with Azure Cloud technologies to build robust data pipelines, ...
... business and technical requirements. Implement secure platforms with data governance in mind. Play a key role in automation and building industry leading solutions against architectural best practices. Deliver data migrations between legacy & modern platforms Design & deliver data warehousing solutions and key data engineering ...
... Data Engineer will design, build, and maintain scalable data pipelines and solutions, ensuring high performance and reliability across COSMOS DB and related data platforms. Daily responsibilities include modeling and structuring data, implementing ETL processes, optimizing data storage and retrieval, and collaborating ...
... Experience working with large, complex datasets in cloud-based or big data environments. - Practical understanding of Nixtla library is a plus. - Experience with MLOps , model monitoring, and CI/CD pipelines. Domain Knowledge Strong Supply Chain domain knowledge , especially demand forecasting, inventory planning, and sales ...
I. Detailed Role Description:We are looking for a highly skilled and visionary Data Science Team Manager (AI/ML) to lead a team of data scientists and machine learning engineers. This role is responsible for driving AI/ML initiatives that solve complex business problems, building scalable models and ensuring successful ...
... production-ready GenAI systems, integrating LLMs into enterprise applications, and optimizing performance in cloud-native environments. You will collaborate with data scientists, product managers, and engineering teams to operationalize cutting-edge AI/ML innovations. Key Responsibilities Design and deploy GenAI solutions leveraging ...
... experience, with at least 2 years in an Engineering Manager / Technical Manager role.- Strong hands-on background in software engineering, with exposure to Python, AI/ML, or data engineering.- Experience working in a global onshore - offshore delivery model.- Solid understanding of Python, AI/ML concepts, cloud platforms (AWS/Azure), ...
... stakeholders, product teams, and engineering squads to translate complex business requirements into robust technical solutions that enable advanced analytics, AI/ML, and data-driven decision-making across insurance focused business domains. Key Responsibilities: Lead the end-to-end architecture and solution design for enterprise ...
... degree in computer science, computer engineering, IT, Data Science Location: Pune or Remote India only Key Responsibilities: Design, develop, and implement Agentic AI systems capable of autonomous decision-making and task execution. Build and optimize AI/ML models leveraging LLMs, NLP, and advanced AI techniques. Develop AI-driven ...