... using Python and cloud technologies. You’ll contribute to solutions from design through production, helping improve reliability, performance, security, and developer productivity. This is an opportunity to solve meaningful engineering challenges, grow your technical ownership, and collaborate with experienced engineers ...
... (Extract, Transform, Load) scripts to move data across various systems. Database Management: Write basic SQL queries, create tables, and interact with PostgreSQL databases to support data storage and retrieval. Data Orchestration: Help schedule, monitor, and troubleshoot automated data workflows using Apache Airflow. Stream ...
... Support data governance, cataloguing, lineage, and metadata management practices where required. Work with Linux/Unix environments and efficiently process large datasets. WHAT MAKES YOU A GREAT FIT - 3+ years of professional experience in Data Engineering, Big Data, Analytics Engineering, or a related field. - Strong hands-on ...
... data ingestion pipelines leveraging Databricks, Airflow, Kafka, and Terraform. Ensure high performance, reliability, and efficiency by optimizing large-scale data pipelines. Develop data processing workflows using Databricks, Delta Lake, and Spark technologies. Maintain and improve the Data Lakehouse, utilizing Unity Catalog ...
... someone who has built and owned pipelines. - Your work has been drag-and-drop ETL tooling without engineering underneath it. - You are an application or backend developer whose data work has been incidental. - You have never worked with enterprise systems such as ERP, PLM or MES . Working at Algo8 - You will build capability ...
... management plans and documentation, ensuring compliance with industry standards and regulatory requirements. - Participate in the identification and resolution of data discrepancies and issues, working to streamline data flow and enhance data quality throughout the study lifecycle. - Collaborate closely with cross-functional ...
Senior Data Engineer – Data Pipelines & Cloud Databases Location: Pune | Experience: 4+ years | Type: Full-Time Role Overview Design, build, manage enterprise data pipelines on Azure and Databricks. Own schema design, API development, and data infrastructure for analytics and intelligence products. Key Responsibilities ...
... understanding of deep neural networks and other machine learning techniques in high frequency domain is a plus. Comfortably making pragmatic modeling tradeoffs under ambiguity while clearly articulating the reasoning behind them with data. By submitting this application, you acknowledge and consent to terms of the WorldQuant Privacy ...
Role Overview : We are seeking a seasoned Data Engineering professional to spearhead our data architecture initiatives and drive the evolution of our analytical ecosystem. In this role, you will be responsible for designing robust data models and optimizing our Snowflake-based data warehousing environment to support complex ...
... build robust data pipelines, data lakes, and marts to support business analysts and data scientists. Key Responsibilities Modern Data Platform Development: Build data lake components on cloud-based platforms Design and develop data marts for business analysts and data scientists Data Engineering & Pipelines: Design data pipelines ...
Job Description – Senior Data Engineer / Platform Re-Engineering Lead (Azure Synapse & Databricks Migration) Role Overview We are looking for a highly experienced Senior Data Engineer to lead the re-engineering of an existing enterprise data platform built on Azure Synapse Analytics. The role requires deep technical seniority ...
Data Science Data Engineer Work Type: Full Time At VIDA we're building the future of digital identity. As a Data Engineer you'll work across the stack—from platform and infrastructure to data pipelines and end-user tooling. You'll help us modernize our batch ETLs and lead our push into streaming and real-time fraud detection. ...
... and analyzing data stored in Amazon S3.- Monitor, troubleshoot, and optimize data pipelines for performance, reliability, and scalability.- Collaborate with data architects, analysts, developers, and business stakeholders to understand data requirements.- Ensure data quality, security, governance, and best practices across ...
... techniques. Hands-on experience integrating and optimizing Starburst/Trino, including connecting Starburst from Lambda and Glue ETL jobs. Experience with NoSQL databases such as DynamoDB, MongoDB. Experience working with data formats including Avro, Parquet, JSON, XML, and CSV. Comfortable challenging your peers and leadership ...
... details related to data engineering or a relevant https://jobeax.com/link/cwwOL3BLJkve6nkU Skills :- Azure Databricks, Python, pyspark, sql, ADF- Proficiency in data pipeline design and implementation- Strong understanding of data factory and orchestration toolsPreferred Skills:- Familiarity with advanced data processing techniques- ...
... & Data Engineering (AWS) Strong handson experience with AWS data services, including: Amazon S3, AWS Glue, Athena, Redshift Experience designing cloudnative data lakes and data warehouse architectures on AWS Deep understanding of batch and streaming data pipelines Experience building scalable, faulttolerant data ingestion ...
... work independently and collaboratively to solve complex data challenges and drive continuous improvements across our data engineering practices. 4+ years of data engineering experience, building and managing large-scale data pipelines - Strong proficiency in Python, PySpark, Spark, Databricks, Delta Lake, PowerBI and SQL, ...
Senior Data Engineer Starts Immediately Competitive salary Competitive salary Experience We are looking for a Senior Data Engineer to join our team. In this role, you will design, build, and optimize scalable data pipelines on the Databricks Lakehouse Platform. You will partner with data science, analytics, and business ...
... magic! Model Development: Design, develop, and implement predictive models and algorithms using advanced statistical techniques and machine learning frameworks. Data Analysis: Conduct thorough data exploration, cleaning, and transformation to prepare datasets for modeling efforts, ensuring high data quality and accuracy. Collaboration: ...