... behavior. - Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery. - Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against ...
... behavior. - Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery. - Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against ...
... leading the system design and implementation of technical solutions. Working with data excites you; You have created Big Data architecture, can build and operate data pipelines, and maintain data storage, all within distributed systems. You have a deep understanding of data modeling and experience with modern data engineering ...
Sigmoid Analytics is a leading Data solutions company backed by Sequoia Capital. We offer best in- end-to-end data value chain spanning across Data Science, Data Engineering and Data Ops. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. The below role is for our ...
... LLMs, AutoGen, OCR, Databricks, PySpark, Python, Azure DevOps, and enterprise AI platforms. The role requires strong hands-on experience across SQL Server, Azure Data Factory, Azure Data Lake, Microsoft Fabric, Logic Apps,Power BI, GitHub, and Data Modeling. Required Skills: - 10+ years of Software Engineering / Data Engineering ...
... performant Use AI tooling within DE workflows, including code generation, pipeline automation, and data quality checks Contribute to and help shape company-wide data governance standards Collaborate with analytics, BI, and business teams to deliver trusted, well-modeled data 5–7 years of hands-on data engineering experience ...
... data ecosystems. Lead the design, architecture, and delivery of large-scale data engineering solutions across cloud and hybrid environments. Drive end-to-end data platform implementations encompassing data ingestion, transformation, storage, processing, governance, and consumption. Architect batch and real-time data pipelines ...
... for a data professional to join our Data Engineering team. Independently execute data engineering projects Undertake processing of structured and unstructured data Development of data processing codes for automation & building scalable solutions Develop and maintain data solutions for clients / projects Communicate and interact ...
... looking for engineers and data scientists who will being not only an abundance of experiences in technologies but an abundant curiosity to innovate. Also, the data science community at Walmart Labs is active in most of the Hack events, utilizing the petabytes of data at our disposal, to build some of the coolest ideas. All ...
Consultant Data Engineer Databricks | Azure | PySpark | Spark SQL - Bengaluru / Hyderabad / GurugramLooking for an experienced Data Engineer with strong expertise in Azure Databricks, PySpark, Spark SQL, Azure Data Factory (ADF), ADLS, ETL, and SQL. You will design scalable data pipelines, build modern Lakehouse solutions, ...
... Engineering, or a related field. 7+ years of data engineering experience, including expertise in data integration, pipeline optimization, and enterprise-scale data solutions. - Databases: Oracle and PostgreSQL - ETL/ELT & Data Integration: Experience in maintaining and refactoring existing data pipelines - Data Warehousing ...
... data tools for analytics and data scientist team members that assist them in building and optimising our product into an innovative industry leader.- Ensure data privacy and compliance with relevant regulations (e.g., GDPR) when handling customer data.- Maintain data quality and consistency within the application, addressing ...
... prediction and forecasting tasks on tabular/text datasets. - Collaborate with cross-functional teams to understand business requirements and translate them into data-driven solutions. - Perform data preprocessing, feature engineering, and exploratory data analysis (EDA) to support model development. - Build and deploy end-to-end ...
... role Ethos is seeking a Data Engineer to join our Data Platform team and build the internal infrastructure, services, and tooling that the rest of the company's data stack runs on. This is a software engineering role with a deep data background. You will design and operate distributed workflow systems on Temporal and Airflow, ...
Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. AWS AI Services Minimum 3 Year(s) ...
... Experience with system integration, implementation, upgrades, migrations, or technology modernization. - Good understanding of application, infrastructure, cloud, database, networking, or platform technologies relevant to the role. - Familiarity with automation, monitoring, DevOps, CI/CD, cloud platforms, or modern engineering ...
... bring We are looking for an experienced Data Governance Lead who can improve business processes through the practical use of data and AI, and deliver trusted data for enterprise solutions. You will bring: - At least 10 years of experience in data governance, data management or a related field. - Deep knowledge of data governance ...
... Time Series Forecasting techniques and real-world demand planning use cases. - Hands-on experience with Databricks , including Spark, notebooks, and distributed data processing. - Practical exposure to Machine Learning and Deep Learning model development and deployment. - Experience working with large, complex datasets in ...
... https://jobeax.com/link/OBSYxKmspgkYWOcn Responsibilities:- Design, develop, and maintain data pipelines.- Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver high-quality data solutions.- Optimize data workflows for performance and scalability within the Azure environment.- Ensure data quality, ...
Data Engineer: PySpark+AWS Glue 4-8 years in Data Engineering with hands-on expertise in Snowflake, AWS Glue, AWS (S3/Lambda/CloudWatch), Python, PySpark, and SQL. Strong experience in ETL/ELT, Data Warehousing, Data Pipelines, Performance Tuning, and Cloud Data Platforms. Exposure to AI/ML or GenAI solutions is a plus ...