... Shell Scripting. Strong analytical skills for data engineering tasks. Familiarity with tools likeApache Airflowfor data migration workflows. Experience with database systems such asOracle,MySQL, orDB2. Knowledge of legacy data migration from diverse sources. Previous experience with data migration to platforms like ServiceNow. ...
... to deliver tailored and actionable insights on economic issues for customers, partners and policymakers The Institute is composed of a team of economists and data scientists that utilize & synthesize the anonymized and aggregated data from the Mastercard network together with public data to bring powerful insights to life, ...
Experience : 7+ years of experience in Data Engineering, Data Quality, or Data Governance. 3+ years of experience working on AWS Data Platforms. Strong hands-on expertise in: - Python - SQL - Data Quality Engineering - Data Profiling - Data Validation Frameworks - Experience building AI-powered data quality and governance ...
... across both frontend and backend systems.- Drive end-to-end delivery of enterprise-grade software solutions for major clients, taking accountability for quality, timeliness and alignment with client expectations.- Act as a technical consulting partner to client stakeholders, representing Quantium's engineering capability in ...
Consultant Data Engineer Databricks | Azure | PySpark | Spark SQL - Bengaluru / Hyderabad / GurugramLooking for an experienced Data Engineer with strong expertise in Azure Databricks, PySpark, Spark SQL, Azure Data Factory (ADF), ADLS, ETL, and SQL. You will design scalable data pipelines, build modern Lakehouse solutions, ...
... production-ready Tableau dashboards. ~ Data Querying (Mandatory): Expert-level command of SQL for data extraction and manipulation. - Proven experience working with data in the Fintech, Banking, or Financial Services sectors. - Soft Skills: Proven ability to engage with non-technical business leaders to understand their data needs ...
... understanding of event-driven architecture and real-time data streaming patterns Familiarity with Avro/JSON schema management and Schema Registry Experience integrating data between legacy and modern platforms Strong SQL/Python skills and experience working with relational databases Understanding of data mapping, data quality, and ...
Data Scientist with GenAI (5 - 8 Years) - BangaloreWe are looking for a highly skilled Data Scientist with Generative AI expertise to design, develop, and deploy AI-driven solutions that solve complex business challenges. The role involves working on Machine Learning models, Large Language Models (LLMs), Retrieval-Augmented ...
... and maintain scalable batch and real-time data pipelines for fraud analytics. Develop and optimize Spark-based data processing frameworks. Implement efficient data ingestion frameworks and integrate multiple data sources. Build and support Snowflake data warehouse and data lake solutions. Develop data models for reporting, ...
... Cloud Data Migration Leadership : Lead cloud migration projects, developing scalable Spark pipelines. Implement Bronze, Silver, and gold tables for scalable data systems. Optimize Spark code to ensure efficient cloud migration. Data Modeling : Develop and maintain data models with strong governance practices. Data Cataloging ...
... features, user stories, business/data requirements, acceptance criteria, prioritization, and future-state roadmap. Assess MIS reports, dashboards, KPIs, metrics, data sources, and processes, identifying items to retain, redesign, consolidate, enhance, or eliminate. Partner with Servicing, Operations, Product, Technology, Engineering, ...
... field.- 5 - 8 years of hands-on experience with strong programming skills in Python for data manipulation and processing.- Proficiency in SQL for querying and data transformation.- Hands-on experience or significant project work with Google Cloud Platform (GCP).- Familiarity with core GCP data services, particularly BigQuery ...
... programming. The role leads complex analyses, develops scalable solutions and ensures work is rigorous, reproducible and aligned with business needs. Working across departments, the Lead Data Scientist communicates findings to technical and non-technical stakeholders, influences technical decisions and helps colleagues develop their ...
... application development to join our team. The role involves managing development of FastAPI based applications to run large data modeling, and leveraging the Databricks platform. The ideal candidate will have a robust background in backend development, Data science model basics, and cloud-based solutions to drive data-driven ...
... AN IMPACT Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services. #BEYOURSELFATWORK Capco has a tolerant, open culture that values diversity, inclusivity, ...
... Responsibilities: Design, develop, and maintain scalable ETL/ELT pipelines. Build and optimize data warehouses, data lakes, and data models. Develop highly available data ingestion and processing systems for large datasets. Collaborate with cross-functional teams to deliver data solutions. Ensure data quality, performance, reliability, ...
... disparate sources.- Optimize Snowflake database performance by managing compute resources, clustering keys, and materialized views to reduce latency for end-users.- Partner with business stakeholders to define data requirements, ensuring that the data warehouse architecture aligns with long-term strategic business objectives.- ...
... maintain internal tracking databases and systems. Financial Management/Business Development Support:. With guidance, ensure service and quality meet agreed upon timelines and deliverables in contract/Scope of Work (SOW). Review financial reports on a monthly basis and participate in project reviews as requested. - With guidance, ...
... and convenience in a seamless digital experience. Collaboration with Data Engineering Team Partner closely with our Data Engineering team to ensure efficient data collection, storage, and processing Collaborate in designing and optimizing data pipelines for seamless data movement Work jointly on data architecture decisions ...
... ensuring that data pipelines are robust, efficient, and scalable Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners. Implements and maintains reliable and scalable data infrastructure to move, process and serve data. Writes, deploys ...