... performant Use AI tooling within DE workflows, including code generation, pipeline automation, and data quality checks Contribute to and help shape company-wide data governance standards Collaborate with analytics, BI, and business teams to deliver trusted, well-modeled data 5–7 years of hands-on data engineering experience ...
... security, and scalability while enabling faster and more reliable software delivery. Key Responsibilities: - Hands on experience working on Databricks, creating data pipelines, transformation rules using Unity Catalog, PySpark, SparkSQL - Hands on Databricks Devs – Deployments, CICD, Performance Management - Hands on Databricks ...
... data ecosystems. Lead the design, architecture, and delivery of large-scale data engineering solutions across cloud and hybrid environments. Drive end-to-end data platform implementations encompassing data ingestion, transformation, storage, processing, governance, and consumption. Architect batch and real-time data pipelines ...
... AI-first data strategy at scale across 120M+ customer interactions. Databricks Apps & Self-Serve AI Develop and deploy internal AI-powered applications using Databricks Apps — enabling business users to interact with ML models, RAG systems, and analytics agents through governed, self-serve interfaces. Integrate Databricks ...
Job Title: Data Engineer - ML Training Data Pipeline Notice period: 0-30 Days Experience : 5+ Years Location: Hyderabad OR Pune We are looking for Data Engineer - ML Training Data Pipeline who can Build and maintain the data pipeline that transforms raw production traces into high-quality training datasets for LLM fine-tuning-ingestion, ...
... looking for engineers and data scientists who will being not only an abundance of experiences in technologies but an abundant curiosity to innovate. Also, the data science community at Walmart Labs is active in most of the Hack events, utilizing the petabytes of data at our disposal, to build some of the coolest ideas. All ...
... agenda Optimizing and integrating different data sets to enable the undertaking of advanced analytics to identify growth opportunities. Responsibilities As the data scientist, this individual will be responsible for development and deployment of data science modeling frameworks using Statistical modeling (Machine Learning ...
... agenda Optimizing and integrating different data sets to enable the undertaking of advanced analytics to identify growth opportunities. Responsibilities As the data scientist, this individual will be responsible for development and deployment of data science modeling frameworks using Statistical modeling (Machine Learning ...
... Data Management/Governance Policies, Procedures, Processes, Standards and Control Providing inputs and recommendation on Data practices, Data definitions and Data Quality Escalation of any data governance related issues identified to the senior leadership Managing change management processes in the Data Governance. Understand ...
... MS-Excel to accurately input and update data 2. Maintain and organize large databases to ensure data integrity 3. Collaborate with team members to streamline data entry processes 4. Perform regular quality checks to identify and correct errors 5. Generate reports and analyze data trends for decision-making purposes 6. Support ...
... call support days: 12:30pm-9:30pm Requirements • Minimum 3 yrs exp. in Data and production support hands on skill, handling incidents • Python - Must have • Databricks - Must have • Unity Catalog - Must have • ADLS - Must have • Spark - Must have • Job Orchestration (Airflow) - Must have • Data pipeline Architecture and ...
... batch jobs, database replication & Kafka- Set up and maintain monitoring/observability for data pipelines- Support ML pipelines, Airflow workflows and production data science infrastructureIDEAL PROFILE:Looking for candidates with strong hands-on experience in:- Data Operations- Production Data Engineering- Data Platform Support- ...
... batch jobs, database replication & Kafka- Set up and maintain monitoring/observability for data pipelines- Support ML pipelines, Airflow workflows and production data science infrastructureIDEAL PROFILE:Looking for candidates with strong hands-on experience in:- Data Operations- Production Data Engineering- Data Platform Support- ...
... and results-driven Data Engineer to join our growing Data Engineering team. You will be instrumental in ingesting, transforming, and delivering high-quality data to enable data-driven decision-making for our clients. This role is ideal for someone who thrives in a consulting environment, enjoys solving complex data challenges, ...
... Design, Performance Tuning.- Data Integration : Apache Kafka, AWS DMS, REST APIs, CDC.- Metadata & Governance : Apache Atlas (preferred), Metadata Management, Data Catalog, Business Glossary, Data Lineage, Data Stewardship, Data Quality.- Business Intelligence : Tableau, Semantic Layer, KPI Frameworks, Data Mart Design, ...
... development and expert-level SQL for complex data manipulation and analysis. - Data Engineering & Modeling: Strong hands-on experience with dbt (Data Build Tool) for data transformation and a solid understanding of Big Data frameworks. - Architecture Mastery: Fluency in general data architecture principles, including data modeling, ...
... learning, statistical modeling, and process-mining algorithms to large, multi-source enterprise datasets. - Strong programming proficiency in Python, SQL, and data-modeling techniques for event data. - Experience in process data model design, development, and deployment, including creation of reusable data schemas and pipelines ...
... scalable data processing workflows using Apache Spark and Python. - Ensure data quality, consistency, validation, and availability for ML pipelines. - Optimize data storage, processing, and retrieval to improve ML inference performance. - Work with structured and unstructured datasets and support large-scale data processing. ...
... Alation, Data Governance, Metadata Management, Data Cataloging, Data Lineage, Data Quality, and Data Stewardship , along with experience working with modern cloud data platforms. Key Responsibilities: - Lead the design, configuration, development, and administration of Alation Data Catalog . - Configure data sources, metadata ...
... operations. Using data reporting tools and techniques, you will apply your knowledge and understanding to ensure daily reporting of wellsite activity. This includes data capture from various service providers, client organization, real-time data sources and other data formats to ensure streamlined data capture via reporting tools. ...