... working with large datasets, building data pipelines, and writing efficient, scalable Python code. Key Responsibilities Develop, test, and maintain scalable Python applications. Work with large datasets to extract, transform, and analyze data. Build and optimize data pipelines and workflows. Perform data cleaning, validation, ...
... across the data space. 3+ years of experience designing and building scalable distributed data pipelines and dimensional data models - 3+ years of experience in Python and SQL - Experience using Databricks platform and PySpark is a must. - Extensive experience of Microsoft Azure data services – Data Factory, ADLS gen2, Event ...
... drives / memory / transceivers and other hardware related tasks, as required by our server and network teams. Assisting with planning equipment moves or new data center build-outs. Coordinating the packing, shipping, and logistics of equipment to and from remote colocation sites. Maintaining data center documentation. ...
... Ensure the reliability, scalability, and efficiency of data pipelines for ingestion, transformation, and storage. Work with cross-functional teams to understand data needs and deliver high-quality solutions. Troubleshoot and resolve data pipeline issues in production environments. Apply data quality and governance best practices, ...
... of our transformation, we know that data is at the center of everything that we do. We seek a dedicated professional to help take us to the next level of our Data & Analytics journey. We depend on our Data Analysts to investigate data seeking opportunities to reduce duplicates, improve the quality and discover anomalies ...
... Responsibilities Administer and support Cloudera CDP/CDH platforms, including HDFS, Hive, Spark, YARN, Hue, and CDE. Develop, deploy, and optimize PySpark and Python-based data processing solutions. Build and maintain CI/CD pipelines using Jenkins and GitHub/Bitbucket. Integrate security and code quality tools such as Checkmarx ...
... Hadoop ecosystem for data processing - Solve real-world engineering problems related to data infrastructure - Collaborate with cross-functional teams to deliver data-driven solutions - Ensure data quality, reliability, and performance across data systems Required Skills: - Scala (must-have), python - Apache Spark - Strong ...
... Python. Develop and optimize large-scale data transformations using PySpark. Ensure data quality, reliability, and performance of data pipelines. GCP BigQuery Data Ingestion & ETL/ELT Data Pipeline Orchestration Python PySpark Strong SQL and data engineering fundamentals hands-on experience in GCP-based data platforms.
... rely on you to drive. Who You Are Must-Have - 25 years building production data pipelines: real systems with real consumers, not just one-off scripts - Strong data engineering fundamentals : data modeling, batch vs. streaming, idempotency, incremental processing, partitioning. - Expert SQL and strong Python : query optimization, ...
... deploying complex data architectures within Microsoft Fabric and the broader Azure ecosystem.- Advanced proficiency in Python and SQL for building sophisticated data processing pipelines and complex analytical models.- Strong background in data engineering principles, including ETL/ELT design, data modeling, and performance ...
... architectures - Deep SQL expertise; hands-on experience designing schemas and tuning queries at production scale - Extensive, hands-on experience with AWS cloud data services for storage, compute, messaging, and eventing - Advanced Python proficiency for pipeline development; experience structuring code for maintainability ...
... recurring insight packs and basic statistical summaries under supervision.- Run data quality checks and validate metrics.- Support test cases, documentation and data validation for dashboard https://jobeax.com/link/uZNeF9ElGyYiAC23 We Expect From You :- Build strong SQL and data-hygiene habits early; accuracy matters more ...
... Costco Wholesale. Data Engineer The Data Engineer is responsible for developing data pipelines and/or data integrations of for Costco’s enterprise certified data sets that are used for business critical data consumption use cases (i.e. Reporting, Data Science/Machine Learning, Data APIs, etc.). The Data Engineer will partner ...
... candidate will play a vital role in overseeing the progress of clinical trials, ensuring compliance with regulatory standards, and maintaining the integrity of data collected during studies. This position offers an excellent opportunity for individuals passionate about advancing medical science and making a tangible impact ...
... Data Engineer will design, build, and maintain scalable data pipelines and solutions, ensuring high performance and reliability across COSMOS DB and related data platforms. Daily responsibilities include modeling and structuring data, implementing ETL processes, optimizing data storage and retrieval, and collaborating ...
Key responsibilities :Data Architecture & Platform Build :- Design and implement modern data architecture (Data Lake, Data Warehouse, Lakehouse)- Enable self-service analytics and reporting platforms- Lead implementation of BI tools and dashboards- Partner with business teams to define KPIs, metrics, and insights frameworks- ...
... delivery experience. Exhibit high data literacy with the ability to process and analyze large datasets. Leverage data analysis/visualization tools (e.g., Alteryx, Python, Tableau) as applicable. Uphold strong data governance orientation (e.g., MDM) when working with critical client data. Communicate clearly in writing and verbally ...
... to accurately manage, update, and maintain business-critical data. The ideal candidate should be comfortable working in US business hours and possess strong data management, communication, and MS Office skills. Key Responsibilities Enter, update, verify, and maintain data in internal systems and databases. Review data ...
... coaching, performance management, career development, and team engagement. Data Architecture: Deep understanding of modern data architecture patterns including Data Lakes, Data Warehouses, Lakehouses, and Data Mesh, combined with experience designing and delivering cloud-based data platforms. Cloud and Data Engineering: Strong ...