Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks ...
Sr. Data Engineer (6-9 yrs) Responsibilities : Data masking: implement PII masking pipeline Builds & maintain synthetic data generator CI/CD pipeline integration with auto-seed data Validates generated data against the ground truth – referential integrity, volume accuracy, etc. data validation characteristics. Technical ...
... and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data ...
... competitive advantage. Band: M3/M4 (6 to 14 years) Should have experience in PySpark and Scala + Spark for 4+ years (Min experience). Proficient in debugging and data analysis skills. Should have Spark experience of 4+ years Should have understanding of SDLC and Big Data Application Life Cycle Should have experience in GIT ...
... will partner closely with divisional and functional Data Management Offices (DMOs), business leaders, and IT teams to drive execution of a broad portfolio of data initiatives spanning data strategy, data governance, data quality, data stewardship, data architecture, and data integration . The Data Program Manager will be ...
... inquiries related to Addepar’s portfolio data feeds and on general data product functionalities within established SLAs. Manage and complete requests from internal Data teams that require client outreach and/or action to resolve data verification issues. Investigate client reported bugs and data processing issues, and triage ...
... existing business processes, identify gaps, and recommend data-driven improvements. - Build modern real-time data solutions using Scala , Apache Spark , and Azure Databricks . - Partner with data scientists and business stakeholders to operationalize machine learning models. - Champion data governance, metadata management, and ...
... experience in data engineering, building and maintaining large-scale data pipelines and platforms.- 2+ years of hands-on experience with Palantir Foundry, including data ingestion, pipeline builder, transformations and working with Foundry datasets and applications.- Experience building interactive applications using Foundry Workshop, ...
... change, applying first-principles problem solving, and using data to learn and adapt along the way. Enterprise Data & AI Mission Enterprise Data & AI provides the data and systems to enable our enterprise transformation from human-powered operations to data-driven, AI-powered, and human-led agentic operations. This data and ...
... airports, infrastructure and border checkpoints. It brings all security operation information together onto a single, integrated and secure platform to achieve 100% data inspection of all cases. Using insights produced through machine learning, artificial intelligence (AI) and data science, our platform enables people to make ...
... manage Amazon DynamoDB data models to ensure high performance, scalability, and reliability.- Ensure data quality, integrity, security, and consistency across data pipelines and storage solutions.- Collaborate with application developers, cloud engineers, data architects, and business stakeholders to deliver robust data ...
... Data Platform & Orchestration is seeking a Lead Data Engineer to design and build next-generation, cloud-native data platforms supporting Mastercard's global data ecosystem. In this role, you will lead the development of scalable batch and real-time data pipelines, enabling efficient data processing across Data Lakes and ...
... Python LLM / NLP EDA (Exploratory Data Analysis) Cloud Platforms (AWS, Azure, GCP) Explainable AI At least 4+ years of relevant experience and track record in Data Science: Machine Learning, Deep Learning and Statistical Data Analysis. MSc or PhD degree in CS or Mathematics, Bioinformatics, Statistics, Engineering, Physics ...
... skills; Experience as a Data Engineer or in a similar role, with a strong understanding of data engineering concepts and methodologies, including data modeling and database design to support scalable data solutions. Strong knowledge of writing and optimizing SQL queries to retrieve, manipulate, and analyze data efficiently. Experience ...
... Work as an Individual Contributor on new and existing projects with a positive, problem-solving https://jobeax.com/link/rCyzW0NBvdP0uFXm Candidate :- Strong Data Scientist / AI Engineer / Generative AI Engineer profile.- 3+ years of hands-on experience in Data Science, Artificial Intelligence, Machine Learning, Deep Learning, ...
... scalability Perform end to end data science workflows data collection cleaning feature engineering model training validation and monitoring Primary skills Technology Data Science Machine Learning Technology Machine learning data science Experience building and optimizing NLP systems using modern approaches e AI-Data science- Data ...
... and implementing scalable and secure data processing pipelines using Azure Data Factory, Azure Databricks, and other Azure services.- Managing and optimizing data storage using Azure Data Lake Storage, Azure SQL Data Warehouse, and Azure Cosmos DB.- Automating data pipelines and workflows to streamline data ingestion, processing, ...
... standards.- Develop and review Python-based data engineering solutions, frameworks, and reusable components.- Design and optimize ETL/ELT pipelines for large-scale data processing.- Work with structured and unstructured data across data lakes, data warehouses, and modern data platforms.- Define strategies for data ingestion, ...
... expertise in designing and managing Snowflake data warehouses, including performance tuning and resource monitoring.- Proficiency in building modular and scalable data transformations using Data Build Tool (dbt).- Advanced capability in writing complex SQL and Python scripts to manipulate large datasets and automate data processing ...
Key Responsibilities : Data Engineering & BI Modernization : - Design and build ETL/ELT pipelines to migrate legacy BI systems (SSRS, Cognos, legacy SSAS/OLAP cubes) to modern cloud data platforms (Snowflake, Databricks, Azure Synapse, BigQuery, or similar).- Re-architect and optimize data models (star/snowflake schemas, ...