... implementing automated testing and monitoring frameworks, ensuring reliability for all internal and external data consumers.- Partner with stakeholders to identify data bottlenecks and implement innovative engineering solutions that support the long-term scalability of our Big Data https://jobeax.com/link/1dkmzToQOwmnlB8O Skillset ...
... leading the system design and implementation of technical solutions. Working with data excites you; You have created Big Data architecture, can build and operate data pipelines, and maintain data storage, all within distributed systems. You have a deep understanding of data modeling and experience with modern data engineering ...
... architecture, and delivery of large-scale data engineering solutions across cloud and hybrid environments. Drive end-to-end data platform implementations encompassing data ingestion, transformation, storage, processing, governance, and consumption. Architect batch and real-time data pipelines leveraging modern big data frameworks ...
... reporting and product development teams 3 to 6 years of experience in the field of data engineering - Graduate degree or higher with courses in programming, data analytics - Good programming skill in Python/scala or any scripting language - Good knowledge of SQL is a required - Basic knowledge and understanding of big ...
... analysis. Develop a strong understanding of maritime shipping, commodity flows and their relationship with economic, market and policy developments. Translate ambiguous business questions into clear analytical approaches, data requirements and measurable outcomes. Communicate methods, findings, trade-offs and limitations ...
... consulting and technology https://jobeax.com/link/TpxqtJEXT9DMtOII a laggard in analytical maturity, the Pharma industry had been facing challenges to adapt to a Big Data https://jobeax.com/link/tMHdCUO15sfZQRWH saw that the products offered by technology companies were too rigid and generic to handle novel https://jobeax.com/link/liejRWNsfOC9BlfN ...
... LLMs, AutoGen, OCR, Databricks, PySpark, Python, Azure DevOps, and enterprise AI platforms. The role requires strong hands-on experience across SQL Server, Azure Data Factory, Azure Data Lake, Microsoft Fabric, Logic Apps,Power BI, GitHub, and Data Modeling. Required Skills: - 10+ years of Software Engineering / Data Engineering ...
... in a modern Snowflake-centred stack, with data quality, testing, and ELT best practices built in from day one. You will also help shape how we use AI within data engineering workflows, from pipeline automation to intelligent data produc Design, build, and scale robust ELT pipelines across ingestion, transformation, modeling, ...
... working with large datasets. Experience building dashboards and reporting using tools such as Hex, Looker, Tableau, Power BI, or similar. Familiarity with modern data warehouses and transformation tools such as Snowflake, BigQuery, Databricks, or similar. Strong understanding of data modeling, data quality, reconciliation, ...
... a multi-layer multi-objective problem space which has a unique impact on Global consumer base and powers assisted AI for our associates. The team consists of data scientists, application engineers, big data geeks and product visionaries all working together to design, prototype and build technology-driven products and experiences ...
... right to request access to your personal data, to request that your personal data be rectified or erased, and to request that the processing of your personal data be restricted. If you have any concerns or questions about the way Headout handle your data, you can contact our Data Protection Officer for more information.
Consultant Data Engineer Databricks | Azure | PySpark | Spark SQL - Bengaluru / Hyderabad / GurugramLooking for an experienced Data Engineer with strong expertise in Azure Databricks, PySpark, Spark SQL, Azure Data Factory (ADF), ADLS, ETL, and SQL. You will design scalable data pipelines, build modern Lakehouse solutions, ...
... or Azure environments Python & scripting for automation and data processing Data streaming technologies (Kafka, Spark, Flink) Big Data platforms (Snowflake, Databricks, Hadoop, Teradata) Exposure to AI/ML and advanced analytics Experience with NoSQL databases Ability to design scalable and maintainable data architectures. ...
... Modelling, OLAP cube modelling.- Data compression into PARQUET to improve processing and finetuning SQL programming skills.- Experience building and optimizing "big data" data pipelines, architectures and data sets.- Experience performing root cause analysis on internal and external data and processes to answer specific business ...
... prediction and forecasting tasks on tabular/text datasets. - Collaborate with cross-functional teams to understand business requirements and translate them into data-driven solutions. - Perform data preprocessing, feature engineering, and exploratory data analysis (EDA) to support model development. - Build and deploy end-to-end ...
... including data structures, algorithms, concurrency, and system design. - Strong understanding of software development best practices, including CI/CD, automated testing, code review, and observability. - Proficiency in SQL and data modeling. - Strong understanding of ETL processes, data warehousing, and data governance principles. ...
... analytical reports. - Work with SAP BW to understand data structures, data flows, queries, InfoProviders and reporting layers. - Extract, validate and reconcile data from SAP BW and other data sources . - Perform data quality checks, validation and root-cause analysis for reporting/data issues. - Write complex SQL queries ...
Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. AWS AI Services Minimum 3 Year(s) ...
... production support activities as required. - Work with cross-functional and global teams to coordinate technical deliverables and project dependencies. - Support testing, deployment, release, and post-implementation activities. - Ensure solutions follow appropriate security, compliance, governance, and operational standards ...