... Quantiphi! Role: Senior Data Engineer (Snowflake) Experience Level: 4 to 12 Years Work location: Bangalore Role & Responsibilities: In-depth knowledge of Snowflake's data warehousing capabilities. Understanding of Snowflake's virtual warehouse architecture and how to optimize performance and cost. Proficiency in using Snowflake's ...
... for automation, data transformation, and API-based data ingestion.- Work with Airflow DAGs to schedule and orchestrate data workflows efficiently.- Optimize data lake and data warehouse performance for scalability and reliability.- Integrate data pipelines with cloud platforms (AWS, Azure, or GCP) and various data storage ...
... for automation, data transformation, and API-based data ingestion.- Work with Airflow DAGs to schedule and orchestrate data workflows efficiently.- Optimize data lake and data warehouse performance for scalability and reliability.- Integrate data pipelines with cloud platforms (AWS, Azure, or GCP) and various data storage ...
... integration platforms.- Proficiency in SQL and experience with cloud data warehouses (e.g., Snowflake, Redshift, BigQuery, Azure Synapse).- Hands-on experience with data modeling techniques (3NF, star schema, data vault, dimensional modeling).- Solid understanding of data governance, data lineage, and data quality frameworks.- ...
... servers, OPENQUERY, and PolyBase Hunt down data quality gaps - stale feeds, broken joins, silently-changing source systems - and drive them to resolution with the data owner Extend the platform as the business grows: model new source domains into the warehouse and build data models analysts can use without needing a translator ...
... and query optimization. Big Data: Apache Spark / PySpark for large-scale distributed data processing. Data Pipelines: Building ETL/ELT pipelines using Azure Data Factory, Fabric Data Flows, and Fabric Notebooks. Cloud + Warehouse: Hands-on experience with Microsoft Azure services and Microsoft Fabric for cloud data warehousing ...
... you unblock touch nearly every workflow in the product. What you'll do - Own the data platform roadmap end to end — ingestion, enrichment, matching, vertical data models, and the sync between our warehouse, CRM, and products - Turn ambiguous data problems into fully-specced, buildable projects - Prioritize ruthlessly across ...
... forecasting, and presenting key metrics to business leaders while collaborating with stakeholders to support strategic decision-making. Key Responsibilities Query large datasets using SQL to extract and manipulate data. Maintain and optimize databases on the data warehouse. Prepare and present weekly business reviews (WBRs), forecasts, ...
... We appreciate your https://jobeax.com/link/UiejEVhRXgrYxewO Keywords : Crescendo Global, Jobs in Bengaluru, Data Engineer Jobs, Consultant Data Engineer, AWS Data Engineer, ETL Developer, ELT Pipelines, SQL, Python, Apache Spark, Kafka, Data Warehouse, Data Lake, Cloud Data Engineering, CI/CD, Git, Big Data Jobs. (ref:hirist.tech)
... ingest data from IoT/smart-cart telemetry, video events, operational systems, and external partners into our cloud data lake/warehouse. Build and maintain robust data infrastructure, including databases (SQL and NoSQL), data warehouses, and data integration solutions. Data Modeling: Establish canonical data models and definitions ...
... modelling experience - Experience with data modeling tools such as Erwin Data Modeler, ER Studio, Toad - Strong knowledge of SQL - Basic ETL knowledge including data mapping and transformation - Good data warehouse knowledge - Optional data visualization skills - Knowledge of data quality and data profiling techniques To qualify ...
... performance discussions Daily Operations & BAU Control Review daily MIS and operational dashboards across locations Monitor day-to-day execution across IT logistics, warehouse operations, asset movement, and support services Proactively identify risks and prevent SLA breaches or service disruptions Handle escalations with data-backed ...
... (staging, intermediate, mart layers / medallion architecture) aligned with dbt and Matillion best practices.- Lead ingestion of structured and semi-structured data from APIs, flat files, cloud storage (Azure Data Lake, AWS S3), and databases into Snowflake.- Optimize Snowflake for performance and cost : warehouse sizing, ...
... (staging, intermediate, mart layers / medallion architecture) aligned with dbt and Matillion best practices.- Lead ingestion of structured and semi-structured data from APIs, flat files, cloud storage (Azure Data Lake, AWS S3), and databases into Snowflake.- Optimize Snowflake for performance and cost : warehouse sizing, ...
... in driving value for our customers by building data solutions. You'll be carrying out data engineering tasks to build, maintain, test and optimise a scalable data architecture, as well as carrying out data extractions, transforming data to make it usable to data analysts and scientists, and loading data into data platforms. ...
... expertise in designing and managing Snowflake data warehouses, including performance tuning and resource monitoring.- Proficiency in building modular and scalable data transformations using Data Build Tool (dbt).- Advanced capability in writing complex SQL and Python scripts to manipulate large datasets and automate data processing ...
INTERNAL SDPM team Project Supply Chain Team Site Supply Chain functions (Procurement, Warehouse, Serial Production co-ord, Method Logistics etc..) EXTERNAL Material supplier's Logistics Provider's OVERALL PURPOSE OF THE ROLE : Establish robust and agile Supply Chain through Process adherence, establishing routines & People ...
Job Description : We are seeking a Senior Data Engineer to design, build, and maintain enterprise-grade Data Warehouses and Lakehouses on AWS. You will be responsible for architecting scalable batch and real-time streaming data pipelines, optimizing big data processing workloads, and ensuring high data reliability across ...
... insights. - Manage data connections and publish governed data sources through Tableau Server/Cloud . - Configure appropriate security, user access, permissions, and data-source settings. - Ensure data accuracy, integrity, consistency, and governance across BI assets. - Troubleshoot dashboard, data, performance, and connectivity ...