... Product Engineering Role Overview We are looking for an experienced Data Engineer with 5–7 years of hands-on experience in ETL/ELT, database engineering, Big Data processing, and complex bi-directional data integrations . The candidate should have strong SQL and database expertise, experience working with large datasets, ...
... data pipelines and ETL workflows on AWS.- Develop efficient data processing solutions using python and pySpark.- Write complex and optimized SQL queries for data extraction, transformation, and analysis.- Build and manage ETL pipelines using AWS Glue.- Work with AWS Glue Data Catalog for metadata management and data discovery.- ...
... Databricks platform. The ideal candidate will have a robust background in backend development, Data science model basics, and cloud-based solutions to drive data-driven decision-making and innovation within our portfolio. Key skills - Python, FastAPI Framework, REST API design, Pydantic models, Async programming, Modular ...
... Databricks platform. The ideal candidate will have a robust background in backend development, Data science model basics, and cloud-based solutions to drive data-driven decision-making and innovation within our portfolio. Key skills - Python, FastAPI Framework, REST API design, Pydantic models, Async programming, Modular ...
... a Data Engineer to join our team and contribute to building and maintaining applications that power the Dun & Bradstreet Contact Pipeline. This role involves working closely with senior data engineers to optimize data ingestion processes, analyze performance bottlenecks, and implement improvements. You will also create ...
... platforms Design & deliver data warehousing solutions and key data engineering workstreams for any required solution. Support cross-functional teams across the data space. 3+ years of experience designing and building scalable distributed data pipelines and dimensional data models - 3+ years of experience in Python and SQL ...
... the preliminary investigation for project solutions requests, requirements gathering, collecting data from a variety of sources, evaluating and interpreting data, and drawing conclusions on solution options Provide input into system fit/gap analysis and design decisions Work with Solution Architects to identify system ...
... will lead a team of data scientists, guide technical decisions, and help grow ProcDNA's data science practice through client relationships and new capabilities. Work with clients to translate business questions into well-scoped data science problems, and define the approach, data requirements and success measures. Design and ...
... identify opportunities for improvement. Strong analytic skills related to working with unstructured data sets. Build processes supporting data transformation, data structures, metadata, dependency and workload management. Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores. ...
... Own end-to-end delivery of data products—from raw source data ingestion through transformation to governed, consumption-ready datasets. Collaborate with the Data Platform team on pipeline integration, CI/CD workflows, and adherence to shared coding and deployment standards. - Data Quality & Analysis: Implement data quality ...
... and acceptance criteria. - Hands-on experience with data validation, reconciliation, source-to-target mapping, UAT, and defect management. - Understanding of data flows, cloud platforms, data repositories, and reporting/visualization layers; experience working with Engineering, Data, Analytics, and Technology teams in Agile ...
... with stakeholders. Key responsibilities Design and develop scalable data pipelines using AWS services. Implement ETL processes with AWS Glue, Lambda, and DBT. Work with PySpark and SQL to transform and cleanse data. Configure and manage Airflow workflows and Amazon EMR clusters. Integrate data services with API Gateway and ...
... help implement improvements to data workflows, templates, and automation to make delivery faster, more consistent, and more scalable. Hands-on experience in a data-focused role (for example, data specialist, data analyst, data migration, or similar) in a professional environment. Strong skills in Microsoft Excel, including ...
... Posted 2 weeks ago Job Be an early applicant About the job Job Purpose: Design and implement scalable data engineering and data warehouse solutions while managing data schemas, SQL query tuning, and code reviews. Who You Are: - 5+ years of experience in Data Engineering, with strong knowledge of Data Platforms and Data Warehousing ...
... data engineering, and DevOps automation. The ideal candidate will manage and optimize Cloudera environments, build CI/CD pipelines, and support enterprise-scale data processing workloads. Key Responsibilities Administer and support Cloudera CDP/CDH platforms, including HDFS, Hive, Spark, YARN, Hue, and CDE. Develop, deploy, ...
... years of experience evaluating and implementing data-engineering and software technologies - In addition, you have experience in programming languages and frameworks: SQL, Python, Spark, Databricks (Delta Lake) - Experience in data storages - SQL and NoSQL databases, Azure Data Lake Storage- and in developing data solutions, ...
... including model governance and explainability- Establish data governance framework (catalog, lineage, ownership)- Ensure data quality, consistency, and compliance- Work closely with business leaders to translate requirements into data solutions- Lead cross-functional teams (data engineers, analysts, data scientists)- Manage vendors, ...
... managing technical aspects of API framework design and development - Understanding of overall production Incidents / RCA for any feature that is delivered. \ - Working knowledge on --Java , Spring boot , microservices , AWS design , KAFKA ,Kubernetes ECS3 , Workflows such as Camunda BPM Preferred Skills: Experience with microservices ...
... activities and site communications. Collaborate with the project team to address issues, resolve discrepancies, and ensure trial milestones are met. Support data management activities by ensuring timely and accurate data collection and entry. Participate in audits and inspections as required, providing necessary documentation ...
... integrations, or service-oriented applications. - Experience working with cloud platforms, preferably AWS, and familiarity with deployment or CI/CD practices. - Working knowledge of software design principles, testing, debugging, performance optimization, and secure development. - Experience with SQL databases and Git-based ...