Data Engineer - ML & AI in Hyderabad, India - Jobeax
Vacancy description
Data Engineer - ML & AI in Hyderabad, India
Costco IT
India, Hyderabad
Data Engineer - ML & AI in Hyderabad, India is listed on Jobeax. Browse 30,000+ vacancies available.
About Costco Wholesale: Costco Wholesale is a multi-billion-dollar global retailer with warehouse club operations in eleven countries. They provide a wide selection of quality merchandise, plus the convenience of specialty departments and exclusive member services, all designed to make shopping a pleasurable experience for their members.
At Costco Wholesale India, we foster a collaborative space, working to support Costco Wholesale in developing innovative solutions that improve members’ experiences and make employees’ jobs easier. Our employees play a key role in driving and delivering innovation to establish IT as a core competitive advantage for Costco Wholesale.
Data Engineer
The Data Engineer is responsible for developing data pipelines and/or data integrations of for Costco’s enterprise certified data sets that are used for business critical data consumption use cases (i.e. Reporting, Data Science/Machine Learning, Data APIs, etc.). The Data Engineer will partner with product owners, data architects, and data platform teams to design, build, test, and automate data pipelines that are relied upon across the company as the single source of truth.
Develops and operationalizes data pipelines to bring data into Costco’s GCP landscape for the delivery of certified data sets
Works in tandem with Data Architects, Data Stewards, and Data Quality Engineers to design data pipelines and recommends ongoing optimization of data storage, data ingestion, data quality and orchestration.
Designs, develops, and implements ETL/ELT/CDC processes using Data Build Tool (DBT) and other native GCP Services (BigQuery Subscriptions, Dataproc, Dataflow, etc.)
Uses GCP services such as BigQuery, AlloyDB, Spanner, Dataplex, Pub/Sub, Cloud Storage, etc. to improve and speed delivery of our data products and services.
Identifies, designs, and implements internal process improvements: automating manual processes, optimizing pipeline delivery and support.
Identifies ways to improve data reliability, efficiency, and quality of data management
Participate in off hours 24/7 on call support on a rotational basis
5-8+ years’ experience engineering and operationalizing data pipelines with large and complex datasets.
5-8+ years’ hands-on experience with Data Build Tool (DBT), Dataflow & Dataproc (Spark)
5-8+ years’ experience working with BigQuery, Google Cloud Storage, AlloyDB and Spanner
5-8+ years’ experience with Data Pipeline, ETL/ELT, and Data Warehousing.
Effective use of AI and/or LLMs to increase efficiency in deliverables.
Extensive experience working with various data sources (DB2, SQL,Oracle, flat files (csv, delimited), APIs, XML, JSON).
Experience implementing data integration techniques such as event/message based integration (Kafka, Google Pub/Sub).
Advanced SQL skills; solid understanding of relational databases and business data; ability to write complex SQL queries against a variety of data sources.
Strong understanding of database storage concepts (data lake, relational databases, NoSQL, Graph, data warehousing).
Experience with Git / Azure DevOps / Jira.
CDMP (Certified Data Management Professional) Certification.
... clients span autonomous mobility, medical AI, agriculture, and more—powering next-generation AI systems with high-quality data services. We are seeking a skilled Data Engineer to help scale and enhance our internal data observability and analytics platform. This platform integrates with data annotation tools and ML pipelines ...
... query optimization and data access strategies for APIs serving real-time compliance dashboards, establishing benchmarks and SLOs Lead data infrastructure work for AI/ML features, including dataset curation, feature engineering, and pipeline design supporting cloud-native AI capabilities Define and enforce data quality standards, ...
... ground up with new age technology to simplify the consumption of data for our customers in various industry verticals. We are looking for a skilled and motivated Data Engineer to design, build, and maintain scalable data pipelines and data infrastructure. You will work closely with Data Science, Engineering, and Product teams ...
... address their data needs Utilize databases and tools including and not limited to, Postgres, Redshift, Airflow, and MongoDB to support our data ecosystem. Leverage AI frameworks and libraries to integrate advanced analytics into our solutions. Qualifications Experience : Minimum of 3 years of experience in data engineering, ...
... comfortable using LLMs/AI copilots as part of daily workflow (analysis, documentation, communication, process design), not just as a novelty. - Experience working with AI/ML teams and understanding of how annotated data feeds into model training. - Strong understanding of quality frameworks (QA/QC) for spatial data and annotation ...
... and backend engineering, test-driven development, microservices and architecture design principles - Must have experience on AI/ML implementation such as: Langchain, Langgraph and ML models such as Gradient Boost, Random Forest etc. - AI & LLM Frameworks: Experience with foundational models and APIs (e.g. OpenAI, Claude, ...
... scalable solutions Generate actionable insights through data analysis and modeling Deploy, monitor, and improve model performance Qualifications - Bachelor's/Master's in Computer Science, Data Science, Engineering, or related field - 3–8 years of relevant experience Skills: data scientist,genai,python,sql,pyspark,aiml,ml
... candidate will leverage generative AI and large language models (LLM) to enhance our data-driven decision-making processes. Key responsibilities : Design and develop data models using generative AI and LLM technologies. Implement retrieval-augmented generation techniques to improve data accessibility. Analyze complex datasets to ...
... End‑to‑End ML Project Lifecycle Python/R Programming Skills Software Engineering & Agile Framework Preferred Experience Prior experience with oil & gas, commercial domain, supply chain, production systems, wells or subsurface domain is highly desirable. Experience working with Azure Databricks or other data science frameworks. ...
... equivalent drawing standards is highly desirable. Education Bachelor's or Master's degree in Computer Science, AI/ML, Data Science, Electronics, Mechanical Engineering, Mathematics, Statistics or a related discipline. Master's degree is preferred. Candidate Profile - Hands-on senior engineer who can code, train/evaluate ...
... opportunity with the role currently based in Bengaluru, India. We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to ...
Technology, Digital and Data Your Work Shapes the World at Caterpillar Inc. When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We ...
... scalable AI/ML solutions and take models from experimentation through production. Requirements KEY RESPONSIBILITIES - Design, develop, test, and deploy scalable AI/ML models and solutions . - Work with large and complex datasets to perform data preparation, transformation, feature engineering, and analysis. - Develop and ...
... expertise in backend development, API integration, and scalable application design. The ideal candidate should have hands-on experience in Python frameworks, database management, cloud technologies, and software development best practices. Develop, test, and maintain scalable Python applications. Design and build RESTful ...
As an AIML Engineer, you will be responsible for designing, developing, and deploying AI-powered applications and agentic AI solutions leveraging Python, LangChain, LangGraph, LLMs, RAG, Oracle Database 23c/26ai, and Oracle APEX. You will work closely with cross-functional teams to build scalable AI solutions that integrate ...
As an AIML Engineer, you will be responsible for designing, developing, and deploying AI-powered applications and agentic AI solutions leveraging Python, LangChain, LangGraph, LLMs, RAG, Oracle Database 23c/26ai, and Oracle APEX. You will work closely with cross-functional teams to build scalable AI solutions that integrate ...
As an AIML Engineer, you will be responsible for designing, developing, and deploying AI-powered applications and agentic AI solutions leveraging Python, LangChain, LangGraph, LLMs, RAG, Oracle Database 23c/26ai, and Oracle APEX. You will work closely with cross-functional teams to build scalable AI solutions that integrate ...
Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. https://jobeax.com/link/6WcBICn0LM558SP0 ...
Role Summary : The Senior Data Scientist will lead advanced analytics initiatives, leveraging AI/ML, Generative AI (GenAI), and Agentic AI to deliver decision intelligence solutions. This role involves designing solutions, collaborating with cross-functional teams, and mentoring junior data https://jobeax.com/link/jOXlfQ8JM0UfgeL3 ...