Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Apache Spark, ...
... business needs into technical solutions by designing data models and reports Perform exploratory data analysis and implement automated data quality checks Optimize data feeds and ensure timely data availability using Change Data Capture and other approaches Maintain data governance by enforcing best practices in data quality, ...
Required Skills :- Solid hands-on experience in various databases, data mining and data analysis methods, utilizing advanced data tools, writing complex SQL queries.- Data preparation, data analysis, identify insights from raw data.- Analyses metrics, key indicators and other available data sources to discover root causes ...
... Spark/PySpark.- Build and manage data workflows using Azure Data Factory, Azure Databricks, and Synapse Analytics.- Design and implement ETL/ELT processes for data ingestion and transformation.- Integrate data from multiple sources and ensure reliable data movement across platforms.- Optimize data processing jobs, queries, ...
Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Engineering ...
... for batch and real-time data processing. Build and optimize ETL/ELT workflows to collect, transform, and load data from multiple sources. Develop and maintain data models, data warehouses, and data lakes. Ensure data quality, consistency, accuracy, and reliability across data pipelines. Optimize data processing workflows ...
... debugging, and code quality best practices. Good understanding of data engineering fundamentals and advanced concepts. Experience building scalable and fault-tolerant data pipelines. Strong knowledge of CI/CD, automated testing, and production deployments. Understanding of Medallion Architecture, data modeling, data quality, and ...
... Software Engineering / Data Engineering Fundamentals Basic software design principals Unit testing Version control High performance code to work at sc Skillset: Data Analyst Exp: 5+ Yrs Location : PAN India SQL DDL and DML skills on structured and non-structured data base Python- Coding for data parsing, manipulation, aggregation ...
... containers as well as GCP suite, terraform kubernetes, cloud functions You understand standard ETL patterns, modern data warehousing ideas such as data mesh or data vaulting, and data quality practices regarding test driven design and data observability. You are passionate about all things data: Big data, small data, moving ...
... improved efficiency, and stronger operational performance. Role: Senior Data Scientist Location: Bangalore- Karnataka (Hybrid) Experience: 5+ years Department: Data Science Role Overview We are looking for individuals who sit at the intersection of Data Science and Physical Sciences . You understand that industrial data isn't ...
Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Python (Programming ...
... legal entity. You will be part of a world-class Data Engineering team, where you will: inform Data Science and Analytics Platform teams partner closely with data consumers and producers to ensure quality and usefulness of data assets You will be involved in strategizing measurement, collecting data, and generating insights. ...
... including HDFS, Hive, Spark, and Impala. Experience building and supporting Data Lakes, Data Warehouses, and Enterprise Data Platforms. Strong experience in data modelling, source-to-target mappings, data transformation, and data integration. Knowledge of data quality, data governance, metadata management, and data security ...
... SAP MDG, or similar data management solutions. - Strong knowledge of SQL, Windows Server, APIs, cloud platforms (Azure and AWS), infrastructure, GitHub, and DataDog. - Understanding of data governance, metadata management, data quality, and master data management concepts. - Experience with automation and scripting tools ...
... Development Team. The ideal candidate should have strong skills in data handling, statistical analysis, and visualization tools, along with the ability to translate data into meaningful insights. Key Responsibilities : Data Analysis : - Collect, clean, and validate large datasets from multiple sources - Analyze data to identify ...
As the Machine Learning Manager at Traceable by Harness, you will play a pivotal role in leading and scaling our ML initiatives from prototype to production. You will guide a team of machine learning engineers, and data scientists to design, develop, and deploy high-performing ML solutions that power our core products. ...
... Overview :We are looking for a proactive Data Support Engineer to join our data engineering team. The role involves supporting, monitoring, and troubleshooting data pipelines and ETL processes, ensuring data reliability and smooth operations across Snowflake-based data https://jobeax.com/link/tlplQAnK5B36KMXq Responsibilities ...
... proper documentation and approvals. Collaborate with business teams on data governance and compliance initiatives. Identify and implement best practices for data ingestion, data design, and data quality improvement. Develop queries for profiling data, validating analyses, testing assumptions, and driving data quality assessment. ...
... continuous improvement of operational processes. Skills and Experience: 3-4 years of progressive experience in data engineering, with expert-level mastery of Azure Data Factory, SQL, and cloud data platforms (Azure and/or GCP). - Proven expertise in designing, optimizing, and managing large-scale, production-grade data pipelines, ...
... building strong relationships with FMCG/CPG clients, understanding the commercial challenges facing consumer brands, and successfully demonstrating the value Mintel data can provide. Data-driven: You understand how to leverage the power of data and forward-looking metrics to drive better performance results for your clients. You ...