... and convenience in a seamless digital experience. Collaboration with Data Engineering Team Partner closely with our Data Engineering team to ensure efficient data collection, storage, and processing Collaborate in designing and optimizing data pipelines for seamless data movement Work jointly on data architecture decisions ...
... include developing, constructing, testing, and maintaining architectures such as databases and large-scale processing systems, ensuring that architectures support data analytics, and preparing data for prescriptive and predictive modeling. Data engineers also develop data set processes for data modeling, mining, and production, ...
... business-focused data solutions.- Mentor junior engineers and promote data engineering best https://jobeax.com/link/E00qLmZDpXHJjFEm Qualifications : - 5+ years of Azure Data Engineering experience.- Experience with large-scale distributed data processing systems.- Databricks and/or Azure Data Engineering certifications preferred.- ...
... installing, testing and maintaining the complete data management & processing systems Experience working with big data and ETL development 3-5 years of experience in big data analytics technologies like Spark/Spark streaming, , Kafka streaming, Elasticsearch, Bigquery etc. Extensive years of experience in RDMBS/ NoSQL databases, ...
As a key member of the QTC, you will play a pivotal role in migrating data from diverse sources and applications, developing solutions, validating systems, and addressing various challenges in enterprise applications. You will be involved in the complete development lifecycle—from analysis and design to testing and release—focusing ...
... success. Migrate and transform client corporate governance data and documents into Diligent platforms, ensuring accuracy, consistency, and completeness. Run regular data quality checks, validate data against source records, and quickly correct errors to maintain high data integrity. Use advanced Excel functions, databases, and ...
... well-documented code that others can understand and maintain All About You passionate about using data visualisations to tell stories 1–3 years experience in creating data visualisations proficient in R or Python proficient in using code to clean data, transform, and aggregate data familiar with version control concepts and tools ...
Experience : 7+ years of experience in Data Engineering, Data Quality, or Data Governance. 3+ years of experience working on AWS Data Platforms. Strong hands-on expertise in: - Python - SQL - Data Quality Engineering - Data Profiling - Data Validation Frameworks - Experience building AI-powered data quality and governance ...
... building ETL/ELT pipelines that transform and process large volumes of structured and unstructured data.- Solid understanding of data warehousing concepts and data modelling techniques (e.g. dimensional modelling, slowly changing dimensions).- Hands-on experience with BigQuery, Airflow or Argo Workflows, Dataflow, and Pub/Sub ...
... production-ready Tableau dashboards. ~ Data Querying (Mandatory): Expert-level command of SQL for data extraction and manipulation. - Proven experience working with data in the Fintech, Banking, or Financial Services sectors. - Soft Skills: Proven ability to engage with non-technical business leaders to understand their data needs ...
... bringing passion and customer focus to the business. Data Engineer (data integration and streaming platforms) Data Engineer with strong experience in event-driven data integration and streaming platforms, ideally with hands-on expertise in Confluent Kafka and CDC technologies. Experience Strong Data Engineering background, including ...
Data Scientist with GenAI (5 - 8 Years) - BangaloreWe are looking for a highly skilled Data Scientist with Generative AI expertise to design, develop, and deploy AI-driven solutions that solve complex business challenges. The role involves working on Machine Learning models, Large Language Models (LLMs), Retrieval-Augmented ...
... Azure . Ensure data quality, governance, reliability, monitoring, and compliance. Partner with Data Scientists, Fraud Analysts, and Engineering teams to deliver data-driven solutions. 4+ years of experience in Data Engineering or Big Data Engineering. - 2+ years of experience building large-scale distributed data processing ...
... Cloud Data Migration Leadership : Lead cloud migration projects, developing scalable Spark pipelines. Implement Bronze, Silver, and gold tables for scalable data systems. Optimize Spark code to ensure efficient cloud migration. Data Modeling : Develop and maintain data models with strong governance practices. Data Cataloging ...
... processes. - Experience translating business requirements into features, user stories, data requirements, and acceptance criteria. - Hands-on experience with data validation, reconciliation, source-to-target mapping, UAT, and defect management. - Understanding of data flows, cloud platforms, data repositories, and reporting/visualization ...
... maintain robust data pipelines, helping to turn raw data into actionable https://jobeax.com/link/d6zqLcygnqsI43u7 Responsibilities:- Develop, test, and maintain data pipelines and ETL/ELT processes using Python, SQL, and GCP services.- Write and optimize complex SQL queries in BigQuery for data transformation, extraction, ...
... Skills Deep knowledge of statistics and mathematics, with experience designing rigorous analyses, testing assumptions and interpreting complex results. Strong data-wrangling and cleaning skills, including working with large or imperfect datasets, resolving quality issues and developing reproducible data pipelines. Strong ...
... maintainable code following software engineering best practices and coding standard. Optimize application performance, scalability, and reliability for high-volume data processing workloads. Implement automated testing, including unit test cases using pytest. Collaborate with front end developers to support seamless integration ...
... focus on Java, Microservices and Kafka Java Microservices Back end Developer Java Sprint boot Microservices with expected knowledge of Kafka, Basic knowledge of Database. Experience with TDD and BDD. Must have experience with one of cloud (GCP, AWS or Azure). Also experience with Kubernetes and containers - Hands-on experience ...
... Workflow orchestration tools such as Airflow and AWS Step Functions. Experience with NoSQL databases and data stores. Understanding of SDLC, CI/CD, code reviews, testing, and software architecture best practices. Preferred Candidate Profile: A hands-on Data Engineer with strong AWS data platform experience, capable of delivering ...