... similar programming languages.- Expert-level experience with big data technologies such as Hadoop, Spark, Hive, Delta Lake, Iceberg, HBase.- Advanced knowledge of data governance, data quality management, metadata management, data lineage, master data management.- Advanced understanding of data security principles, encryption, ...
... proper documentation and approvals. Collaborate with business teams on data governance and compliance initiatives. Identify and implement best practices for data ingestion, data design, and data quality improvement. Develop queries for profiling data, validating analyses, testing assumptions, and driving data quality assessment. ...
... Overview :We are looking for a proactive Data Support Engineer to join our data engineering team. The role involves supporting, monitoring, and troubleshooting data pipelines and ETL processes, ensuring data reliability and smooth operations across Snowflake-based data https://jobeax.com/link/tlplQAnK5B36KMXq Responsibilities ...
Welcome to Gallagher in India — where expertise, technology, and purpose come together. Since 2006, Gallagher in India has supported global teams by delivering quality, service, and speed through deep expertise, smart technology, and specialized knowledge services.
... pipelines to ingest, transform, and validate data from marketplace, inventory, and sales sources Build and maintain SQL data lake storage so historical and change data stays available for analysis Automate recurring data jobs (e.g., via Rundeck) and monitor them for failures and data anomalies Use AI tools to accelerate pipeline ...
Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Apache Spark, ...
... business needs into technical solutions by designing data models and reports Perform exploratory data analysis and implement automated data quality checks Optimize data feeds and ensure timely data availability using Change Data Capture and other approaches Maintain data governance by enforcing best practices in data quality, ...
Required Skills :- Solid hands-on experience in various databases, data mining and data analysis methods, utilizing advanced data tools, writing complex SQL queries.- Data preparation, data analysis, identify insights from raw data.- Analyses metrics, key indicators and other available data sources to discover root causes ...
... Spark/PySpark.- Build and manage data workflows using Azure Data Factory, Azure Databricks, and Synapse Analytics.- Design and implement ETL/ELT processes for data ingestion and transformation.- Integrate data from multiple sources and ensure reliable data movement across platforms.- Optimize data processing jobs, queries, ...
Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Engineering ...
... for batch and real-time data processing. Build and optimize ETL/ELT workflows to collect, transform, and load data from multiple sources. Develop and maintain data models, data warehouses, and data lakes. Ensure data quality, consistency, accuracy, and reliability across data pipelines. Optimize data processing workflows ...
... debugging, and code quality best practices. Good understanding of data engineering fundamentals and advanced concepts. Experience building scalable and fault-tolerant data pipelines. Strong knowledge of CI/CD, automated testing, and production deployments. Understanding of Medallion Architecture, data modeling, data quality, and ...
... Software Engineering / Data Engineering Fundamentals Basic software design principals Unit testing Version control High performance code to work at sc Skillset: Data Analyst Exp: 5+ Yrs Location : PAN India SQL DDL and DML skills on structured and non-structured data base Python- Coding for data parsing, manipulation, aggregation ...
... cross-organizational and cross-divisional projects automating our data value chain processes Promoting technical best practices throughout the data organization Design data architecture that is simple and maintainable while enabling Data Analysts, Data Scientists, and stakeholders to efficiently work with data. Mentor data team members ...
Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Python (Programming ...
... legal entity. You will be part of a world-class Data Engineering team, where you will: inform Data Science and Analytics Platform teams partner closely with data consumers and producers to ensure quality and usefulness of data assets You will be involved in strategizing measurement, collecting data, and generating insights. ...
... including HDFS, Hive, Spark, and Impala. Experience building and supporting Data Lakes, Data Warehouses, and Enterprise Data Platforms. Strong experience in data modelling, source-to-target mappings, data transformation, and data integration. Knowledge of data quality, data governance, metadata management, and data security ...
... Overview :We are looking for a proactive Data Support Engineer to join our data engineering team. The role involves supporting, monitoring, and troubleshooting data pipelines and ETL processes, ensuring data reliability and smooth operations across Snowflake-based data https://jobeax.com/link/tlplQAnK5B36KMXq Responsibilities ...
... continuous improvement of operational processes. Skills and Experience: 3-4 years of progressive experience in data engineering, with expert-level mastery of Azure Data Factory, SQL, and cloud data platforms (Azure and/or GCP). - Proven expertise in designing, optimizing, and managing large-scale, production-grade data pipelines, ...
... ensuring their needs are supported through effective data solutions.- Contribute to and adhere to established data governance and security practices, including metadata management, data quality frameworks, and data cataloging, to promote trust and reliability.- Enable business functions with clean, structured data that supports ...