... Bengaluru office. You will work on a broad range of cutting-edge data science and machine learning problems across a variety of industries. If you are passionate to work on complex unstructured business problems that can be solved using data science and machine learning we would like to talk to you. Function : Data Science and ...
... security, and scalability while enabling faster and more reliable software delivery. Key Responsibilities: - Hands on experience working on Databricks, creating data pipelines, transformation rules using Unity Catalog, PySpark, SparkSQL - Hands on Databricks Devs – Deployments, CICD, Performance Management - Hands on Databricks ...
... leading the system design and implementation of technical solutions. Working with data excites you; You have created Big Data architecture, can build and operate data pipelines, and maintain data storage, all within distributed systems. You have a deep understanding of data modeling and experience with modern data engineering ...
... Implement efficient, distributed and scalable pipelines and integrate data from multiple sources to create data products Implement design patterns that support data ingestion, data movement, transformation, aggregation, and much more. Collaborate with Product managers, Software engineers, and Data Scientists, and work towards ...
... https://jobeax.com/link/fYGlpInxuIv5PeS1 & Skills :- 4 - 7 years in data engineering: SQL, Python, ETL/ELT orchestration.- Cloud data platform experience (Azure preferred): pipelines, storage, APIs.- Strong understanding of data lake and data architecture.- Data modelling for analytics (star schema) and data quality frameworks. (ref:hirist.tech)
... end-to-end data platform implementations encompassing data ingestion, transformation, storage, processing, governance, and consumption. Architect batch and real-time data pipelines leveraging modern big data frameworks and cloud-native services. Provide technical leadership and hands-on guidance to engineering teams, ensuring solution ...
... Proficiency in Python or Java for data processing, automation, and pipeline development. ETL & Data Integration: Designing and implementing end-to-end ETL/ELT workflows for structured and unstructured data. Database Management: Strong command of SQL; working knowledge of NoSQL databases like MongoDB or Firestore. Version ...
... performant Use AI tooling within DE workflows, including code generation, pipeline automation, and data quality checks Contribute to and help shape company-wide data governance standards Collaborate with analytics, BI, and business teams to deliver trusted, well-modeled data 5–7 years of hands-on data engineering experience ...
... Engineer will own the end-to-end operationalisation of machine learning, large language model (LLM), and agentic AI workloads on the Bajaj Finance Enterprise Data Platform — a 5PB+ medallion lakehouse built on Azure Databricks and Unity Catalog. This role sits at the intersection of data engineering, model lifecycle management, ...
... a multi-layer multi-objective problem space which has a unique impact on Global consumer base and powers assisted AI for our associates. The team consists of data scientists, application engineers, big data geeks and product visionaries all working together to design, prototype and build technology-driven products and experiences ...
... to ensure reliable and reusable data assets.- Leverage orchestration tools (e.g., Airflow, dbt Cloud, or Azure Data Factory) to schedule and monitor complex workflows.- Apply CI/CD and Git-based workflows for version-controlled, automated deployments.- Collaborate with data analysts, data scientists, and architects to ...
... https://jobeax.com/link/uw09q4zp7W2jeNTj :- Design and develop scalable data pipelines using PySpark and Spark SQL on Azure Databricks.- Build and orchestrate ETL workflows using Azure Data Factory (ADF) and ADLS.- Develop and maintain modern Lakehouse architecture while ensuring data quality and reliability.- Monitor production data pipelines, troubleshoot ...
... https://jobeax.com/link/uw09q4zp7W2jeNTj :- Design and develop scalable data pipelines using PySpark and Spark SQL on Azure Databricks.- Build and orchestrate ETL workflows using Azure Data Factory (ADF) and ADLS.- Develop and maintain modern Lakehouse architecture while ensuring data quality and reliability.- Monitor production data pipelines, troubleshoot ...
... root cause analysis to improve data quality. Data Governance Define and implement data governance frameworks, policies, and standards. Ensure compliance with data quality, data privacy, and regulatory requirements. Establish data lineage, metadata management, and data stewardship practices. Monitor and improve data quality ...
... & Data Platform. You’ll design and maintain reliable, secure, and scalable data pipelines and models that power a new generation of reporting, insights, and data-driven products across the StarRez ecosystem. This role sits at the intersection of data, product, and engineering. You will work closely with Data Analysts, ...
Role :Lead Engineer - Conversion/Migration Skills - Mandatory-SQL Server, ETL/Data Migration Skills - Good to have -SSIS, Azure Data Factory Work location: Kochi/Trivandrum Total Experience: 6-9 years Strong hands-on expertise in SQL Server (T-SQL) and relational database design, with solid experience in data migration ...
... Hands-on experience with model deployment tools such as Docker, Flask, FastAPI, or cloud-based ML services (AWS SageMaker, GCP Vertex AI, etc.). - Proficiency in working with structured/unstructured data, SQL. Added Advantage: - Experience in Computer Vision (e.g., OpenCV, YOLO, or related frameworks). - Exposure to NLP/LLMs ...
... role Ethos is seeking a Data Engineer to join our Data Platform team and build the internal infrastructure, services, and tooling that the rest of the company's data stack runs on. This is a software engineering role with a deep data background. You will design and operate distributed workflow systems on Temporal and Airflow, ...
... workbooks, dashboards, and data sources to improve performance and rendering speed. - Manage the complete Tableau development lifecycle from requirements and data preparation through deployment and maintenance. - Write complex and performance-optimised SQL queries to extract, transform, and structure data for BI reporting. ...
... and convenience in a seamless digital experience. Collaboration with Data Engineering Team Partner closely with our Data Engineering team to ensure efficient data collection, storage, and processing Collaborate in designing and optimizing data pipelines for seamless data movement Work jointly on data architecture decisions ...