... Responsibilities Design, develop, and maintain robust data pipelines in Hadoop and related ecosystems, ensuring data reliability, scalability, and performance. Implement data ETL processes for batch and streaming analytics requirements. Optimize and troubleshoot distributed systems for ingestion, storage, and processing. Collaborate ...
... databricks/AWS/tableau documentation that may be required to identify and resolve issues We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. If you would like more information about how your data is processed, please contact ...
... data models in Snowflake for analytics and visualization. Ensure data accuracy, performance optimization, and visualization best practices. Work closely with data engineering to ensure smooth data integration and pipeline readiness. Troubleshoot issues related to data, performance, or visualization logic. Overall 5+ years ...
... Talend, or Azure Data Factory. Strong Python development skills, including experience with AWS SDKs such as Boto3. Experience working with cloud platforms and data services, preferably AWS. A solid understanding of data warehousing, distributed data processing, and modern data architecture principles. Experience within the ...
... you’ll do Build and maintain scalable data pipelines in Azure Ingest and transform data from multiple enterprise systems (including ERP sources) Implement data processing across Medallion architecture layers (Bronze/Silver/Gold) Optimize performance, reliability, and data quality across the platform Work closely with data ...
... Experience with data cataloging, lineage, and governance tooling (Atlan, Collibra, Alation, Snowflake Horizon, OpenMetadata). Experience supporting business-facing data stewardship workflows, exception queues, and human-in-the-loop review processes. The assigned offshore team shall consist of two (2) MDM Data Engineers with complementary ...
... CloudFormation to manage your own data infrastructure. - In-Process Analytics (DuckDB): Proven experience using DuckDB for high-speed local development, unit testing data transformations, or as a query engine for 'small-to-medium' datasets (up to 100GB) without the overhead of a distributed cluster. - Hybrid Execution Patterns: ...
... members. We are seeking experienced Data Engineering professionals with 4–6 years of hands-on expertise in Big Data technologies, with a focus on building scalable data solutions using Google Cloud Platform (GCP). Key Skills & Experience: Strong programming skills in Python and Bash Solid understanding of SQL and data warehousing ...
... efficient in production.- AI Application Development : Analyze data and develop bespoke AI applications, including retrieval-augmented generation (RAG) pipelines and data enrichment services, that enhance decision-making and automate complex business processes.- Hands-on Software Development : Make significant code contributions, ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... Big Data Engineer to join our high-performing data platform team. In this role, you will be responsible for architecting, developing, and maintaining robust data pipelines that process massive datasets to fuel our analytical engines. You will work closely with cross-functional teams, including data scientists, product ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... implementing data pipelines using PySpark or Spark Scala- Hands-on experience with Databricks, including development, optimization, and management of large-scale data processing and analytics workload- Must have an understanding of streaming data pipelines for near real-time analytics- Hands-on experience and good understanding ...
... Reporting:- Maintain council trackers, action logs, and status updates.- Create summary reports and presentation materials for reviews.- Document governance processes, templates, and market https://jobeax.com/link/BBBtOIX0t52XsDr5 Skills:- 3 - 6 years of experience in Data Governance, Business Analysis, Data Management, ...