... Design and develop batch and real-time data pipelines on GCP.- Build scalable ETL/ELT pipelines using Dataflow, BigQuery, and Cloud Composer.- Ingest data from databases, APIs, files, SaaS applications, and streaming sources.- Design and optimize BigQuery datasets, tables, partitioning, and clustering.- Develop data transformations ...
... & querying of the data 2) Providing business specific data solutions for various business streams like Payments, Finance, Consumer & Delivery Experience. The Data Engineer will play a key role in performing data extraction, data transformation, building and managing data pipelines to ensure data availability for ML & LLM ...
... influencers that drive it. We are seeking a highly skilled Senior Data Engineer with extensive experience in designing, building, and optimizing high-volume data pipelines. The ideal candidate will have strong expertise in Python, Databricks on Azure Cloud services, DevOps, and CI/CD tools, along with a solid understanding ...
... exchange data - Define and employ data modeling and design standards, tools, best practices, and related development methodologies - Design, review and maintain data models - Perform data analysis activities to capture data requirements and represent them in data model visualizations - Manage the life cycle of the data model ...
... knowledge and troubleshooting capabilities. Database backup and recovery. Database performance tuning and optimization. High availability and disaster recovery. Database security and access management. Database monitoring and capacity management. Database patching and upgrades. Data migration and database maintenance. Infrastructure ...
The EDO Sustainable1 DATA OPERATIONS team at S&P Global is a project-focused, international group dedicated to excellence in sustainability data management. We are responsible for one of the world's most complete datasets on corporate sustainability, supporting global investors, corporates, and stakeholders with in-depth ...
Required - 3–7 years of Data/Cloud Engineering experience with hands-on GCP . - Strong SQL and Python skills. - Experience with Spanner, BigQuery and batch/streaming pipelines . - Good understanding of GCP IAM, monitoring, logging and production support. - Strong troubleshooting mindset and ability to ramp up quickly in ...
Location : [Remote / Hybrid — Kolkata, Hyderabad, Bangalore] Type : Full-time We're looking for a Senior Data Engineer to design, build, and operate the data platform that powers our analytics and reporting. You'll own data pipelines and models end to end — from source ingestion through a Lakehouse medallion architecture ...
... science, Information Security, or related field. - Relevant certifications such as CISSP, CEH, or OSCP are a plus. Responsibilities - 10–12 years of experience in data loss prevention, data discovery/classification, and database/data security. - Experience with DSPM tools and integration in hybrid environments. - Familiarity ...
... build high throughput services Designing and implementing code in SQL/Python Good understanding and implementation experience in Data Governance, Data Quality, Data Modelling etc. Ensure projects are delivered on time and to the satisfaction of the stakeholder Experience required - 7+ years of experience as a data engineer/similar ...
... experience preferred. - Implement data transformations and data structures for data warehouse and lake/repository. - Manage cloud and/or on-premises solutions for data transfer and storage. - Process data using spark (PySpark) - Manage cloud and/or on-premises solutions for data transfer and storage. - Collaborate and work with ...
Position: Senior Data Analyst (Tariff Data)Overall/Total Experience: 4-7 years onlyLocation: Pune (Only for Candidates living in Pune, Mumbai, Nagpur)Working Days: 5 Days Working from OfficeNotice Period Requirement: 30 Days (Maximum)Client's Company Size: Mid-SizedRoles and responsibilities:- Understands complex utility ...
... Consent Vendor Risk Execute end to end DSR DSAR workflows and privacy operations Perform data discovery classification and scanning using BigID Build and maintain data inventory catalog and lineage Identify sensitive data and risks PII overexposure dark data Support RoPA DPIA and regulatory compliance initiatives Configure workflows ...
... Skill Area - Cortex AI, Semantic Data, Snowpark & Modern Data Platforms The opportunity Build and operate enterprise-grade Data & AI platforms using Snowflake AI Data Cloud. The role focuses on Snowflake data engineering, reusable platform patterns, semantic data products, governed AI-ready datasets, APIs, enterprise service ...
... SCOPE, Scala, SQL, Python, or C# Data extraction across a wide variety of data sources Data cleaning, preprocessing, and transformation for further analysis by data analysts Data Validation framework from source to endpoints ensuring data quality and integrity Enable the Data Scientists and Analysts to do more with data across ...
... driven to deliver high quality data solutions that enable better decision making across the organization. This Data Engineer role will design, build, and maintain data pipelines and integrations across multiple source systems in a global environment. They develop ETL processes and APIs, manage data warehouse schemas, and ensure ...
... work closely with both Blend’s internal teams and client stakeholders to build and optimize data pipelines, support data modeling efforts, and ensure reliable data flows for analytics, reporting, and business decision-making. This position is ideal for engineers with a strong data foundation who are looking to apply their ...
... and maintain scalable data pipelines for data processing and transformation Build and manage workflow orchestration using Apache Airflow Develop and maintain data models and transformations using dbt Work with BigQuery or similar cloud data warehouses for data storage and querying Manage and interact with cloud object storage ...
... quality, and observability. Build data pipelines: Develop robust batch and streaming pipelines (Kafka/Kinesis) to ingest, transform, and enrich large-scale event data (impressions, clicks, conversions, costs, identity signals). - Create data aggregates & marts: Data modeling & contracts: Define schemas, data contracts, and ...
DATA ENGINEER EXPERIENCE - 5-8 yrs WORK MODE - HYBRID Data Pipeline Development : Design, build, and optimize scalable ETL/ELT pipelines to process and transform data from various sources into Snowflake. Data Modeling : Build and maintain data models within Snowflake for optimized querying and reporting. Cloud Infrastructure ...