This contract role is for a Big Data Engineer experienced in designing and maintaining large-scale data infrastructure, pipelines, and processing systems.
You’ll apply your engineering expertise to build reliable data solutions and contribute high-quality technical input to the training and improvement of next-generation AI systems. The work involves large-scale data processing, Python development, distributed systems, databases, data quality, and governance.
What You’ll Do
Design, build, and maintain scalable data pipelines and architectures for large-scale data environments.
Translate business and technical requirements into reliable data engineering solutions.
Develop data integration, transformation, and processing workflows using Python and appropriate big data technologies.
Build, manage, and optimize distributed databases and storage systems for performance, reliability, and scalability.
Monitor data infrastructure, troubleshoot failures, and improve system availability and performance.
Implement data quality, security, and governance practices across data pipelines and platforms.
Apply sound data modeling, ETL, and data warehousing principles to support reliable data systems.
Collaborate with technical and non-technical stakeholders to understand requirements and communicate implementation decisions.
Document architectures, processes, technical solutions, and operational procedures clearly.
Requirements
Proven hands-on experience in big data engineering, including building and maintaining large-scale data pipelines.
Advanced proficiency in Python for data processing, automation, and system integration.
Strong understanding of relational and NoSQL databases, including database design, optimization, and administration.
Experience with distributed data processing frameworks such as Hadoop, Spark, or Flink.
Solid understanding of data modeling, ETL processes, and data warehousing principles.
Strong troubleshooting and analytical skills for diagnosing performance, reliability, and data-quality issues.
Ability to communicate complex technical concepts clearly to both technical and non-technical stakeholders.
Detail-oriented, proactive, and comfortable working independently in a remote environment.
Preferred Qualifications
Experience working in fast-paced or startup-like environments.
Experience collaborating with globally distributed teams.
Hands-on experience with cloud-based data platforms and services, including AWS, Google Cloud, or Microsoft Azure.
Familiarity with MLOps, machine learning infrastructure, or data science workflows.
Experience building data systems that support analytics, machine learning, or other high-volume data applications.
Who Should Apply
This role is suited to data engineers who have practical experience working with large-scale datasets and distributed data systems. You should be comfortable moving between pipeline development, database optimization, data processing, infrastructure reliability, and data governance.
Strong independent problem-solving and communication skills are important, particularly for engineers working remotely and across multidisciplinary teams.
Compensation
Annual compensation equivalent: $62,400–$166,400
Hourly rate: $30–$80/hour
Annual equivalent is calculated at 40 hours per week × 52 weeks per year.
Actual earnings will depend on hours worked and the duration of the contract.
Work Arrangement
Contract position
Fully remote
Work focused on large-scale data engineering, distributed processing, databases, pipelines, and data infrastructure
Collaboration with cross-functional technical and business stakeholders
About the Role:KPI Partners is seeking a skilled Azure Data Engineer with expertise in data engineering, cloud solutions, and experience with data pipeline development using Azure services. You will play a key role in designing and implementing scalable data solutions that drive insights and business decisions for our https://jobeax.com/link/OBSYxKmspgkYWOcn ...
... documentation carrying the quality bar between reviews. Stack: Python, PostgreSQL, Django, server-rendered frontend (htmx). What You Will Own Core Responsibilities / Engineering Focus Deep third-party data ingestion Build reliable ingestion pipelines for external data sources Account for silently dropped webhooks through reconciliation ...
Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. https://jobeax.com/link/6WcBICn0LM558SP0 ...
BigLaw Lawyer – Litigation, Corporate & M&A Location: Remote Job Type: Contractor Openings: 100 Compensation: $140–$400/hour About the Opportunity We’re looking for experienced U.S. lawyers with BigLaw backgrounds to apply their legal expertise to an AI-focused project. You’ll contribute to the development and evaluation ...
BigLaw Lawyer – Litigation, Corporate & M&A Location: Remote Job Type: Contractor Openings: 100 Compensation: $140–$400/hour About the Opportunity We’re looking for experienced U.S. lawyers with BigLaw backgrounds to apply their legal expertise to an AI-focused project. You’ll contribute to the development and evaluation ...
... and convenience in a seamless digital experience. Collaboration with Data Engineering Team Partner closely with our Data Engineering team to ensure efficient data collection, storage, and processing Collaborate in designing and optimizing data pipelines for seamless data movement Work jointly on data architecture decisions ...
... preparing data for prescriptive and predictive modeling. Data engineers also develop data set processes for data modeling, mining, and production, integrate new data management technologies and software engineering tools into existing structures, and collaborate with data scientists and analysts to ensure data accuracy and ...
Role Overview : We are seeking a seasoned Data Engineering professional to spearhead our data architecture initiatives and drive the evolution of our analytical ecosystem. In this role, you will be responsible for designing robust data models and optimizing our Snowflake-based data warehousing environment to support complex ...
... Shell Scripting. Strong analytical skills for data engineering tasks. Familiarity with tools likeApache Airflowfor data migration workflows. Experience with database systems such asOracle,MySQL, orDB2. Knowledge of legacy data migration from diverse sources. Previous experience with data migration to platforms like ServiceNow. ...
... Python for data engineering workloads.- Demonstrated experience building ETL/ELT pipelines that transform and process large volumes of structured and unstructured data.- Solid understanding of data warehousing concepts and data modelling techniques (e.g. dimensional modelling, slowly changing dimensions).- Hands-on experience ...
... bringing passion and customer focus to the business. Data Engineer (data integration and streaming platforms) Data Engineer with strong experience in event-driven data integration and streaming platforms, ideally with hands-on expertise in Confluent Kafka and CDC technologies. Experience Strong Data Engineering background, including ...
... https://jobeax.com/link/mYvMZkpRFRzMWb6X company culture revolves around maximizing decision velocity and minimizing decision risk for enterprises ambitious enough to make data their voice. Data Engineering Excellence : Design and implement data pipelines using formats like JSON, Parquet, CSV, and ORC, utilizing batch and streaming ingestion. Cloud Data Migration ...
... contributing to large-scale data projects on Google Cloud Platform. You will work closely with senior engineers and data analysts to build and maintain robust data pipelines, helping to turn raw data into actionable https://jobeax.com/link/d6zqLcygnqsI43u7 Responsibilities:- Develop, test, and maintain data pipelines and ...
... focus on Java, Microservices and Kafka Java Microservices Back end Developer Java Sprint boot Microservices with expected knowledge of Kafka, Basic knowledge of Database. Experience with TDD and BDD. Must have experience with one of cloud (GCP, AWS or Azure). Also experience with Kubernetes and containers - Hands-on experience ...
... Develop highly available data ingestion and processing systems for large datasets. Collaborate with cross-functional teams to deliver data solutions. Ensure data quality, performance, reliability, and scalability. Required Skills: - 7+ years of Data Engineering experience. - Strong experience in Data Modeling, Data Warehousing, ...
Role Overview : We are seeking a seasoned Data Engineering professional to spearhead our data architecture initiatives and drive the evolution of our analytical ecosystem. In this role, you will be responsible for designing robust data models and optimizing our Snowflake-based data warehousing environment to support complex ...
... accuracy across the network. Define and maintain strict access control, governance, and data privacy standard practices across the global insights platform. Engineering Hygiene & DevOps Packaged and deploy data services using Docker and Kubernetes. Maintain elegant CI/CD automation pipelines for data code deployments and ...
... while designing and executing strategies that align workforce capabilities with the agility required to stay ahead of what's next. We are currently hiring for Data Engineer | Digital Analytics expert for global healthcare and health insurance domain. based healthcare provider and health insurance organization delivering ...
... team and contribute to building and maintaining applications that power the Dun & Bradstreet Contact Pipeline. This role involves working closely with senior data engineers to optimize data ingestion processes, analyze performance bottlenecks, and implement improvements. You will also create metrics to monitor application ...
... from design through production, helping improve reliability, performance, security, and developer productivity. This is an opportunity to solve meaningful engineering challenges, grow your technical ownership, and collaborate with experienced engineers across the development lifecycle. Design and build scalable backend ...