Exp: 6+ years Work Mode: Hybrid (3 days work from office) or Remote can also be provided. Key Responsibilities Design, develop, and maintain robust data pipelines in Hadoop and related ecosystems, ensuring data reliability, scalability, and performance. Implement data ETL processes for batch and streaming analytics requirements. ...
Data Engineer III/ IV - IN (Operation/ Supports) Work Location - Remote Work From Home Shift: Rotation Shifts (24/7) Experience: 7-12 years The Data engineer is responsible for managing and operating upon Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI/Tableau. The engineer will work closely with the customer ...
... efficient SQL queries and data models in Snowflake for analytics and visualization. Ensure data accuracy, performance optimization, and visualization best practices. Work closely with data engineering to ensure smooth data integration and pipeline readiness. Troubleshoot issues related to data, performance, or visualization logic. ...
... manage databases and data warehouses and optimise database performance and storage across multipul platforms, e.g. Snowflake, PostgreSQL RDS & Aurora. Ensure data quality, integrity, and reliability, whilst adhering to data security best practices. Work closely with data analysts, and other stakeholders to understand data ...
... as Azure Data Factory, Azure Databricks, Synapse or similar Solid SQL and data transformation experience Experience building ETL/ELT pipelines for analytics workloads Understanding of data modelling and working with BI teams Experience working with ERP data (Oracle ERP a plus) Comfortable in a collaborative, remote team ...
... Minimum IT Experience: 8+ Years The MDM Data Engineer will build and operate the data pipelines, models, and profiling capabilities that power enterprise Master Data Management program. The engineer will work across the RAW / STAGED / PROFILE three-layer architecture, ingest data from authoritative source systems (SAP, Salesforce/Engage, ...
... Implement 'Data SLAs.' You will build the monitoring and alerting systems that notify the team of data drift or pipeline failures before the business notices. Data Productization: Work closely with the BI team and Data Scientists to prepare 'feature-ready' datasets. Performance Tuning: Deep-dive into SQL and Spark query ...
Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project () and drive specialized data scraping workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world ...
Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project () and drive specialized data scraping workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world ...
Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project () and drive specialized data scraping workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world ...
Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project () and drive specialized data scraping workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world ...
Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project () and drive specialized data scraping workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world ...
Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project () and drive specialized data scraping workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world ...
Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project () and drive specialized data scraping workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world ...
Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project () and drive specialized data scraping workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world ...
Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project () and drive specialized data scraping workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world ...
... libraries and frameworks like numpy, pandas, pyspark, matplotlib, Flask, FastAPI, TensorFlow, PyTorch, scikit-learn. - Strong skills in software engineering, data processing, analytics and data visualization libraries - Proficiency in data structures, algorithms, building and maintaining data pipelines. - Experience with ...
... democratizing Generative AI for everyone. Example Projects Create a python library on top of AWS services to enable GenAI for large enterprises. Implement neural network architecture from newly published papers. Work on tools which work with fine-tuned models, vector databases, embeddings etc. Develop more realistic simulations ...
... and generate location attributes from heterogeneous raw sources, and to reason about a feature store - versioning, reuse, freshness - as the backbone of the work.- Data fusion, hygiene, and geocoding: Integrating messy, heterogeneous datasets; imputation, anomaly/bias detection, deduplication and entity resolution; robust ...
... support business needs and demonstrate ownership of live data pipelines. Proficiency understanding and implementing data life cycles, data lineage, custom metadata, and data governance. Proficiency implementing BigQuery SQL procedures, functions, and similar, with actionable logging Optimize ETL processes and data workflows ...