... problems to deliver to clients' requirements. If you do not meet the experience, please do not apply. Build highly efficient and scalable ETL processes using big data technology Leverage large scale cloud infrastructure to build high throughput services Designing and implementing code in SQL/Python Good understanding and ...
... experience in the Big Data Ecosystem. Design, implement, and optimize highly performant data pipelines using Spark, Scala/Java, and Hive on platforms like Cloudera Data Platform (CDP) or other Hadoop echo systems. Take complete ownership of complex data engineering projects within the big data ecosystem, covering the entire lifecycle ...
... data from a data source . Data processing: to process, transform and distribute the data to the target location . Data exposition : to distribute and expose the data hosted in the data platform . Data cleaning: to purge the data on the Lake in a secure way . Data tools: data formatter, data anonymizer As a big data engineer, ...
... Architecture of and administration of Big Data platforms - Data Warehouse Appliances , Open Data Lakes (AWS EMR, HortonWorks), Data Lake Technologies (AWS S3/Databricks/Other) and experience with ML and Data Science platforms (Spark ML , H2O , KNIME) - Develop and manage SPARK ETL Frameworks, Data orchestration with Airflow ...
... Implement data quality checks, validations, and alerting mechanisms to ensure accuracy and completeness of data. Develop and maintain technical documentation for data pipelines, data models, and system architecture. Support the automation of manual data processes to improve operational efficiency. Work with big data technologies ...
... This helps us have a big impact at the enterprise level while still feeling small and nimble. As a Full Stack Senior Software Engineer with a deep interest in data engineering, you will bridge the gap between application development and intelligent data systems. You will play a foundational role in building highly performant ...
... https://jobeax.com/link/Z30sZYC3jcRenVso, v0, and AI SDK, we create products that help builders move from idea to production with speed, security, and exceptional developer experience. Now, software is entering a new era, and the next generation of products will not just be used by people. We are building the platform for that ...
... provide constructive feedback, and work closely with researchers and stakeholders to ensure alignment with project objectives. Develop and optimize Python-based data science solutions using public datasets. Create well-documented Python code using Jupyter notebooks. Bachelor's/Master's degree in Engineering, Computer Science, ...
... validate data from multiple sources Perform exploratory data analysis (EDA) Develop dashboards and reports using BI tools Interpret trends and patterns in complex datasets Present insights to stakeholders in a clear and actionable manner Write SQL queries to extract and manipulate data Automate data processes where possible ...
... activities and site communications. Collaborate with the project team to address issues, resolve discrepancies, and ensure trial milestones are met. Support data management activities by ensuring timely and accurate data collection and entry. Participate in audits and inspections as required, providing necessary documentation ...
... transformations, and performance tuning. - Good experience with Python for data processing, automation, and Lambda development. - Strong understanding of data warehousing, data modeling, ETL/ELT, and data lake concepts. - Experience building and supporting production data pipelines. - Experience troubleshooting data and pipeline performance ...
... fintech and lending company that provides funding solutions to businesses across multiple industries in the United States and UK. Cashera combines technology, data-driven decision-making, and industry expertise to deliver fast, flexible financing options that traditional lenders often cannot provide. As a Senior Data Scientist ...
Senior Data Engineer – Graph Database & Data Intelligence Position: Senior Data Engineer Experience Required: 6+ Years Location: Remote Employment Type: Contract We are seeking a highly skilled Senior Data Engineer with expertise in Graph Databases, Data Modeling, and modern backend frameworks. The ideal candidate should ...
... you like to innovate and simplify If yes, then you may be a great fit to join the Machine Learning team for International Consumer Businesses. Machine Learning, Big Data and related quantitative sciences have been strategic to Amazon from the early years. Amazon has been a pioneer in areas such as recommendation engines, ...
... data models in Snowflake for analytics and visualization. Ensure data accuracy, performance optimization, and visualization best practices. Work closely with data engineering to ensure smooth data integration and pipeline readiness. Troubleshoot issues related to data, performance, or visualization logic. Overall 5+ years ...
... or related field.- Experience : 8+ years in data engineering, data management, AI data foundations, or adjacent technology leadership with proven ownership of data products or critical pipelines delivering measurable business impact.- Technical : Hands-on with AWS, Databricks, Delta Lake, Unity Catalog, data lineage, observability, ...
... patterns Build responsive Angular components, including data tables/grids and interactive charts, integrating APIs and handling rich UX behaviors Implement caching/data processing using solutions like Spring Cache to improve performance and scalability Design and optimize databases and queries for Oracle and PostgreSQL (CTEs/window ...
... SLOs/SLIs, error budgets, incident response, and on-call practices that don't burn people out Scaling the ingest path — making it robust to bursts while maintaining data freshness SaaS auto-scalability and capacity planning across a petabyte-scale system Operating and tuning ClickHouse and the data layer for performance and cost ...
... Asia and Latin America. Within BNP Paribas Cardif, the 'Data & AI' department significantly contributes to the strategic ambition of making BNP Paribas Cardif a data and analytics-driven company. The development of Data and Analytics is identified as one of the pillars of Cardif's strategy. To achieve its goals in Data Management, ...
... Information Retrieval, Semantic Search, Recommendation services (on top of Elasticsearch also leveraging LLMs/Embeddings and GenerativeAI) Large scale distributed data processing (based on Apache Spark / Scala) Streaming data processing (based on Google DataFlow/ApacheBeam) Senior-level ML engineers are preferred, but all levels ...