... product's data. We've built a strong data engineering team to date, but have a lot of work ahead of us, Migrating from relational databases to a streaming and big data architecture, including a complete overhaul of our data feeds - Defining streaming event data feeds required for real-time analytics and reporting - Leveling ...
... as Python, Scala or Java (Preferably Python) - Hands-on experience leveraging PaaS offerings in a public cloud environment (Azure preferred) - Experience with Big Data design patterns and distributed computing tools/frameworks - Proven expertise building big data pipelines (batch processing, real-time streaming) - Working ...
... qualifications Technical Skills You have experience in leading the system design and implementation of technical solutions. Working with data excites you; You have created Big Data architecture, can build and operate data pipelines, and maintain data storage, all within distributed systems. You have a deep understanding of data modeling ...
The ideal candidate will use their passion for big data and analytics to provide insights to the business covering a range of topics. They will be responsible for conducting both recurring and ad hoc analysis for business users. Responsibilities Understand the day-to-day issues that our business faces, which can be better ...
... MergeTree engine family, partitioning, materialized views, and performance tuning.- Production experience with a cloud-based columnar/OLAP warehouse, such as BigQuery.- Hands-on experience with NoSQL and key-value databases, such as Bigtable, DynamoDB, and Redis.- Strong understanding of ETL/ELT and dimensional/layered ...
... implementation of modern data platforms that power analytics, AI, and digital transformation initiatives. As a Manager, you will combine deep technical expertise in big data and cloud technologies with strong consulting, stakeholder management, and people leadership capabilities to enable clients to unlock value from enterprise-scale ...
... execution capabilities. With our team, you can experience a collaborative environment with highly skilled multidisciplinary experts, where everyone has room to build bigger and bolder ideas. Being part of Metyis means you can speak your mind and be creative with your knowledge. Enjoy a high level of responsibility and immediate ...
... a Big Data Engineer to drive our mission to unlock potential of data assets by consistently innovating, eliminating friction in how users access data from its Big Data repositories and enforce standards and principles in the Big Data space. The candidate will be part of an exciting, fast paced environment developing Data ...
Big Data Engineer Contract · Remote Annual Compensation Equivalent: $62,400–$166,400/year Hourly Rate: $30–$80/hour About the Role This contract role is for a Big Data Engineer experienced in designing and maintaining large-scale data infrastructure, pipelines, and processing systems. You’ll apply your engineering expertise ...
Big Data Engineer Contract · Remote Annual Compensation Equivalent: $62,400–$166,400/year Hourly Rate: $30–$80/hour About the Role This contract role is for a Big Data Engineer experienced in designing and maintaining large-scale data infrastructure, pipelines, and processing systems. You’ll apply your engineering expertise ...
Role Overview : We are seeking a seasoned Big Data Engineer to join our high-performing data platform team. In this role, you will be responsible for architecting, developing, and maintaining robust data pipelines that process massive datasets to fuel our analytical engines. You will work closely with cross-functional teams, ...
... learn, reason, and perform through high-quality, real-world https://jobeax.com/link/JC3CtKQ32o6HlxfT Responsibilities :- Design, build, and maintain scalable big data pipelines and architectures to support robust data solutions.- Collaborate with cross-functional teams to understand and deliver on data requirements and ...
BigLaw Lawyer – Litigation, Corporate & M&A Location: Remote Job Type: Contractor Openings: 100 Compensation: $140–$400/hour About the Opportunity We’re looking for experienced U.S. lawyers with BigLaw backgrounds to apply their legal expertise to an AI-focused project. You’ll contribute to the development and evaluation ...
... proficiency in Python, Python-spark, shell scripting and SQL, with hands-on experience in building large-scale ETL/ELT pipelines Good to have exposure in the Big Data Ecosystem like Hive, Spark and HDFS Good to have exposure with modern data stack components (Airflow, Iceberg). Strong understanding of APIs, microservices, ...
... in Jupyter Notebook and VS Code. Hands-on experience with ML libraries (scikit-learn, TensorFlow, PyTorch) and data libraries (pandas, NumPy). Familiarity with big data tools (Spark, Dask, etc.) and version control (Git). - Cloud & Deployment: Demonstrated expertise with Azure cloud services for end-toend data solutions. ...
... u2022 Develop, maintain and optimize ETLs to increase data accuracy, data stability, data availability and pipeline performance u2022 Strong knowledge in the Big data tools such as AWS Redshift, Hadoop, map reduce etc. u2022 Having knowledge in tools like Airflow, AWS Glue, S3, AWS EMR, Streaming data pipelines, Kafka/Kinesis ...