... data Shift time: 5.00 PM - 2.00 AM Own,build, and maintain scalable data pipelines that connect various cloud data sources. Design, build, and manage reliable data ingestion and transformation pipelines using Airflow, dbt, Python, Matillion, and Snowflake. Ensure our data pipelines and data warehouse are optimized for accuracy, ...
... scalable data warehouse solutions using Snowflake.- Develop and optimize complex SQL queries, stored procedures, and Snowflake functions.- Build and maintain robust data pipelines for large-scale data processing and integration.- Develop automation and data processing scripts using Python or Scala.- Work with structured and semi-structured ...
... scalable data warehouse solutions using Snowflake.- Develop and optimize complex SQL queries, stored procedures, and Snowflake functions.- Build and maintain robust data pipelines for large-scale data processing and integration.- Develop automation and data processing scripts using Python or Scala.- Work with structured and semi-structured ...
... in end-to-end data transformation and pipeline development Detailed Job Description Mandatory Technical Skills: Snowflake Data Warehouse Python Scripting DBT (Data Build Tool) Apache Airflow Advanced SQL End-to-End ETL/ELT & Data Pipeline Development Key Requirements Strong hands-on experience in Snowflake data warehousing ...
... use the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics - Manipulate data at scale: getting data in a ready-to-use state in close alignment with various business and Spoke stakeholders. •ETL - Data Lake, Data Warehouse, RDS architectures ...
... governance frameworks for the team Architect and optimize data lake/warehouse solutions (e.g., Snowflake, BigQuery, Redshift) for performance and cost Mentor junior data engineers and review designs/code for quality and scalability Partner with Data Science/AI teams to ensure data readiness for ML pipelines Drive adoption of data ...
Senior Business Analyst Data Warehouse / EDW | SQL | ETLJob Summary : We are seeking a skilled Techno-Functional Business Analyst with strong experience in Enterprise Data Warehouse (EDW) projects. The ideal candidate will bridge the gap between business stakeholders and technical teams, ensuring accurate translation of ...
... experience preferred. - Implement data transformations and data structures for data warehouse and lake/repository. - Manage cloud and/or on-premises solutions for data transfer and storage. - Process data using spark (PySpark) - Manage cloud and/or on-premises solutions for data transfer and storage. - Collaborate and work with ...
... driven to deliver high quality data solutions that enable better decision making across the organization. This Data Engineer role will design, build, and maintain data pipelines and integrations across multiple source systems in a global environment. They develop ETL processes and APIs, manage data warehouse schemas, and ensure ...
... backend services, APIs, and microservices. - Strong fundamentals in data structures, algorithms, and software design principles. - Experience working with SQL and database technologies. - AI / GenAI - Preferred Qualifications - Experience building production-ready GenAI applications. - Experience with vector databases such as ...
... parameterizations and translate them into equivalent Python EL scripts and dbt transformation models. • Develop and maintain Python EL pipelines to land high-volume data, including billion-row tables, into the target warehouse using SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools such as Oracle Data Pump and SQL Server BCP. ...
... workflows for data ingestion, transformation, validation, and loading from multiple structured and unstructured data sources.- Develop and maintain cloud-based data lakes using Amazon S3 and related AWS services.- Design and optimize data warehouse solutions using Amazon Redshift.- Develop data integration and orchestration ...
... workflows for data ingestion, transformation, validation, and loading from multiple structured and unstructured data sources.- Develop and maintain cloud-based data lakes using Amazon S3 and related AWS services.- Design and optimize data warehouse solutions using Amazon Redshift.- Develop data integration and orchestration ...
... IQVIA, SAP, or clinical data source integration SnowPro Advanced or Databricks Data Engineer Professional certification Cost optimization on both compute (warehouse/cluster) and LLM (tokens/caching/routing) dimensions Data Scientists — this role is not model training, fine-tuning, LoRA/RLHF, or ML research Pure Data Engineers ...
... various reports and analyses to support business needs. Manage and design the reporting environment, including defining data sources, security protocols, and metadata. Support the data warehouse team in identifying and revising reporting requirements. Support initiatives focused on data integrity and normalization . Assess ...
... the Executive – Warehouse operations role based in Gurugram/ Kharkhoda location. please share the profile of the candidates with experience in supervision of warehouse operations, warehouse management, Manpower handling, Inventory Management & Shop floor management. Benefits Please share your updated CV along with the below ...
... for best practices and will be a mentor to other data engineers. Define and lead enterprise data architecture strategy with strong focus on Azure-based modern data platforms and Lakehouse architecture. Architect, design, and optimize scalable Data Warehouse and analytics solutions using Azure Synapse, Azure Data Lake Storage ...
... Pipeline team , sitting closer to the Platform team and data producers and in charge of the efficient data ingestion and provision of quick access to unmodeled data - Warehouse team sitting closer to the business teams and data consumers and in charge of modeling the data in the data warehouse to abstract away the complexity ...
... - Experience with Git or other version control tools in a collaborative development environment. - Strong communication skills and ability to collaborate with cross-functional teams for requirements gathering and solution design. - Experience working with large-scale, distributed data systems and cloud data warehouse.
... Glue, Lambda, Step Functions, and Apache Spark . Develop and optimize data lake and data warehouse architectures using AWS S3, Redshift, and Athena . Implement data ingestion, transformation, and storage solutions using AWS Glue, Kinesis, and Kafka . Work with structured and unstructured data to develop efficient data pipelines ...