... and real time data pipelines Build and maintain robust ETL ELT processes for ingesting transforming and loading data from multiple sources Develop and manage data lakes data warehouses and metadata frameworks Collaborate with cross functional teams to understand data requirements and deliver data solutions Ensure data quality ...
... compelling and clear business focused insights. Can work with multiple databases and big data solutions. Work with the data engineering team to develop & maintain data pipelines. Identify, design, and implement internal process improvements and tools to automate data processing and ensure data integrity while meeting data security ...
We are seeking a detail-oriented Data Associate to join our growing team. As a Data Associate, you will work closely with our product managers, financial analysts, and engineers to ensure high-quality data integration, analysis, and maintenance. The ideal candidate will have a passion for working with large datasets, a ...
... tenant data warehouse layer that underpins multi-tenant AI Agent workloads. - Build and govern the Data Agent layer that supplies on-prem/customer-controlled data to cloud LLM reasoning in the Hybrid AI zone, with staged, explainable data outputs and human review checkpoints. - Define data classification and routing rules ...
... and provide data- driven solutions. Manage multiple disparate data sources and integrate them into a cohesive data platform and dashboards. Develop and implement validation processes to ensure data accuracy and consistency. Utilize pyspark, spark, sql, and Databricks to optimize data processing and querying performance.
... understanding of GCP data services: Expertise in using GCP services such as Cloud Dataflow, Cloud Dataproc, BigQuery, Cloud Storage, Data Catalog, and Data Fusion. ● Data modeling and architecture: Proven experience designing and implementing data models, including dimensional modeling and data warehousing principles. ● Data warehousing ...
... across Manufacturing, Industrial, Consumer, Life Sciences and High-Tech industries. GyanSys provides Digital Transformation services leveraging SAP, Salesforce, Databricks, Snowflake, Application Modernisation and various AI projects. We are looking to add experienced Data Scientist to expand our Microsoft Practice with the ...
... quality. Big Data - Big Data - Pyspark Database - Database Programming - SQL Data Science and Machine Learning - Data Science and Machine Learning - Apache Spark Data & AI - Data Engineering - Data Quality & Validation Data & AI - Data Engineering - Apache Kafka Big Data - Big Data - Azure databricks Data Science and Machine ...
... Science & Supply Chain talent. Collect business requirements from the various stakeholders (Data Scientists, Product Managers, IM) High interest in developing E2E data solutions DevOps/ Agile WoW Experience in designing and building advanced reports Programming languages: Python, PySpark, SQL Data enthusiast Big data frameworks: ...
... reliable, high-quality data, driving excellence in analytics and shaping outcomes that impact industries like H ealthcare and Financial Services . Design and build Data Pipelines using GCP services and BigQuery. Develop and optimize data solutions using Java or Python. Ensure data quality, governance, and compliance across projects. ...
... (Pandas, Polars) and modern big data tools such as Databricks (Spark), Flink, or Kafka. - Strong understanding of data pipeline development, ETL frameworks, and data lakes/warehouses. - Extensive experience with cloud data platforms such as AWS (S3, Redshift, Lambda, Glue), GCP (BigQuery, Dataflow, Dataproc), or Snowflake. ...
... processes to seamlessly integrate data from multiple sources into our data warehouse. Implement advanced data modeling techniques and design efficient, optimized databases to support complex business needs. Ensure the highest levels of data quality and integrity through rigorous data validation and cleansing processes. Collaborate ...
... Fintech & Product Advisory - Advise Product, Engineering, and Growth teams on compliant data usage (e.g. KYC, AML, transaction monitoring), Support cross-border data transfer mechanisms Data Subject Rights & Governance - Oversee handling of Data Subject Access Requests (DSARs), consent management, and data lifecycle policies, ...
... scalable data processing solutions using Big Data technologies and distributed system s Strong hands-on experience with Python and PySpar k for developing efficient data pipelines and applications Develop and optimize complex SQL querie s, data models, and database solutions Analyze and improve performance of Apache Spark workload ...
... understanding of data modeling, schema design, validation strategies, data transformation, and data quality management . - Experience designing solutions for data deduplication, entity resolution, data enrichment, classification, or record linkage . - Experience with both relational and document-oriented databases; practical ...
Maxgen Technologies Pvt ltd is an it company based in Ahmedabad Gujarat .Engineering and IT freshers will get data analyst internship and power bi program. What Services we are offering Online or offline program. live project in internship. hybrid mode internship. college project for interns.
Job Role: Senior Data Engineer- Implementation & Modernization Location: Experience: 8+ Years The Data Engineer is responsible for building and optimizing high-performance, large-scaled data solutions on modern cloud platforms. This role focuses on developing Senior Data Engineer- Implementation & Modernization The Data ...
... integration, primarily using Azure Databricks , Azure Data Lake , and Microsoft Purview . Pipeline Development – Design, build, and deploy robust ETL/ELT pipelines in Databricks (PySpark, SQL, Delta Lake) to ingest, transform, and curate governance and operational metadata from multiple sources landed in Databricks. Granular Data ...
... in end-to-end data transformation and pipeline development Detailed Job Description Mandatory Technical Skills: Snowflake Data Warehouse Python Scripting DBT (Data Build Tool) Apache Airflow Advanced SQL End-to-End ETL/ELT & Data Pipeline Development Key Requirements Strong hands-on experience in Snowflake data warehousing ...