... environments (preferably AWS). Document architecture, data flow, and support runbooks; continuously improve platform performance and resilience. Integrate with customer data platforms and pipelines, including bespoke data frameworks. 4–8 years of experience in data engineering or backend development in data-intensive environments. ...
... components, frameworks, and orchestration patterns. Build distributed data-processing solutions using Dataflow / Apache Beam and/or Dataproc / Spark . Design data models for analytical and downstream data products. Implement data-quality checks, validation, reconciliation, and data lineage. Optimize pipelines and BigQuery ...
... validate data from multiple sources Perform exploratory data analysis (EDA) Develop dashboards and reports using BI tools Interpret trends and patterns in complex datasets Present insights to stakeholders in a clear and actionable manner Write SQL queries to extract and manipulate data Automate data processes where possible ...
... statements, and offering solutions in the domains of Retail, Pharma, Banking, Insurance, etc. - Contribute to internal product development initiatives related to data science. - Develop data science roadmap, and guide data scientist to meet their deliverables. - Handling end-to-end client AI & analytics programs. Your role ...
... platforms Design & deliver data warehousing solutions and key data engineering workstreams for any required solution. Support cross-functional teams across the data space. 3+ years of experience designing and building scalable distributed data pipelines and dimensional data models - 3+ years of experience in Python and SQL ...
... dashboards. - Expert-level proficiency in SQL , including complex queries, joins, aggregations, subqueries, and data manipulation. - Strong understanding of data preparation, data modelling, reporting, and visualisation principles. - Experience working with financial, operational, risk, or business performance data. - ...
... https://jobeax.com/link/MJvWAZuK638tHuBb RESPONSIBILITIES : Tech Stack & Skills : - Experience in model development using Python/PySpark libraries. Development on Databricks or Dataiku DSS is a plus.- Strong experience on Spark with Scala/Python/Java.- Proficiency in building, training, and evaluating state-of-the-art machine ...
... drives / memory / transceivers and other hardware related tasks, as required by our server and network teams. Assisting with planning equipment moves or new data center build-outs. Coordinating the packing, shipping, and logistics of equipment to and from remote colocation sites. Maintaining data center documentation. ...
... connectors or processing frameworks. - Deep understanding of Apache Airflow and ability to design and manage complex DAGs. - Solid SQL skills and familiarity with data warehouse platforms (e.g., Snowflake, Redshift, BigQuery). - Familiarity with version control tools (Git), CI/CD pipelines, and Agile methodologies. - Exposure ...
... Own end-to-end delivery of data products—from raw source data ingestion through transformation to governed, consumption-ready datasets. Collaborate with the Data Platform team on pipeline integration, CI/CD workflows, and adherence to shared coding and deployment standards. - Data Quality & Analysis: Implement data quality ...
... of our transformation, we know that data is at the center of everything that we do. We seek a dedicated professional to help take us to the next level of our Data & Analytics journey. We depend on our Data Analysts to investigate data seeking opportunities to reduce duplicates, improve the quality and discover anomalies ...
... MAKE AN IMPACT Job Title: Data Engineer _DEPS Experience: 3–5 Years Location: Bangalore and Pune (Hybrid – Client Office) Job Summary: Seeking a skilled Senior Data DevOps Engineer having experience in Cloudera platforms, data engineering, and DevOps automation. The ideal candidate will manage and optimize Cloudera environments, ...
... and BigQuery. Build data ingestion pipelines from various source systems. Write efficient and maintainable code using Python. Develop and optimize large-scale data transformations using PySpark. Ensure data quality, reliability, and performance of data pipelines. GCP BigQuery Data Ingestion & ETL/ELT Data Pipeline Orchestration ...
... powering self-serve analytics. Write performant Spark/PySpark and SQL; optimize partitioning, storage formats, and query cost. Data Quality & Reliability (10%) Own data quality: validation, freshness/SLA monitoring, and observability so bad data is caught before it reaches consumers. Make the data layer debuggable: lineage, tests, ...
... Docker, Cloud-Native Infrastructure, CI/CD pipelines. Industry Context: Data engineering experience in Banking Risk, Retail Products, Cards, Mortgage, Deposits, or Wealth Management. Assumed Requirements / Certifications: Databricks Certified Data Engineer, AWS Certified Data Analytics, or Azure Data Engineer Associate.
... workflows, dose analysis, and program management for radiation safety professionals. We are looking for a seasoned Data Engineer to take a lead role in shaping the data foundation across Landauer's growing portfolio of products. You will set the standards for how data is modeled, moved, and governed — owning the full data lifecycle ...
... software architecture and infrastructure for managing data applications. They are involved in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are accountable for timely delivery. They work on the latest big data tools, frameworks and ...
... through a rapid scaling phase (the '1 to 10' journey). - Senior-level proficiency in backend architecture (https://jobeax.com/link/JSd7UYCSg572jJDY) and relational databases (PostgreSQL/MySQL). Frontend experience, while not mandatory, will be a BIG plus.* - Deep, practical, hands-on experience designing and managing message ...
... SDLC, developer workflows, and tool adoption - You communicate comfortably with both developers and senior executives - You’re analytical and operational, using data to prioritize and drive action - You’re already a Cursor user (or power user of modern AI coding tools) with strong opinions about what great looks like (big ...
... factual accuracy, or comparing responses — when projects are available. While each project involves unique tasks, contributors may: - Carefully review provided data (text, images, or videos); - Label or classify content based on project guidelines; - Identify and flag factually incorrect, sensitive, inappropriate, or unclear ...