Data Engineer — ML Training Data Pipeline in Hyderabad, India

... follow-up of orders to ensure compliance with project procedures and requirements Management and resolution of technical issues Knowledge and skills: Technical training will be valued (Graduate in Engineering, Technical Engineering or higher, mentions mechanics, electronics, and / or control). Technical knowledge of pumps. ...

Sigmoid Analytics is a leading Data solutions company backed by Sequoia Capital. We offer best in- end-to-end data value chain spanning across Data Science, Data Engineering and Data Ops. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. The below role is for our ...

... business faces, which can be better understood with data Compile and analyze data related to business' issues Develop clear visualizations to convey complicated data in a straightforward fashion Qualifications - Bachelor's or Master's degree in Statistics or Applied Mathematics or equivalent experience - 1 - 2 years' Data ...

... architecture, and delivery of large-scale data engineering solutions across cloud and hybrid environments. Drive end-to-end data platform implementations encompassing data ingestion, transformation, storage, processing, governance, and consumption. Architect batch and real-time data pipelines leveraging modern big data frameworks ...

... for a data professional to join our Data Engineering team. Independently execute data engineering projects Undertake processing of structured and unstructured data Development of data processing codes for automation & building scalable solutions Develop and maintain data solutions for clients / projects Communicate and interact ...

... Responsibilities : - Architect and maintain complex data models that serve as the foundation for enterprise-wide reporting and advanced analytics, ensuring high data integrity and performance.- Lead the end-to-end design and implementation of scalable ETL/ELT pipelines within the Snowflake environment to streamline data ingestion ...

... Shell Scripting. Strong analytical skills for data engineering tasks. Familiarity with tools likeApache Airflowfor data migration workflows. Experience with database systems such asOracle,MySQL, orDB2. Knowledge of legacy data migration from diverse sources. Previous experience with data migration to platforms like ServiceNow. ...

... Cloud Platform or a comparable cloud platform.- Strong proficiency in SQL and Python for data engineering workloads.- Demonstrated experience building ETL/ELT pipelines that transform and process large volumes of structured and unstructured data.- Solid understanding of data warehousing concepts and data modelling techniques ...

Consultant Data Engineer Databricks | Azure | PySpark | Spark SQL - Bengaluru / Hyderabad / GurugramLooking for an experienced Data Engineer with strong expertise in Azure Databricks, PySpark, Spark SQL, Azure Data Factory (ADF), ADLS, ETL, and SQL. You will design scalable data pipelines, build modern Lakehouse solutions, ...

... experience in event-driven data integration and streaming platforms, ideally with hands-on expertise in Confluent Kafka and CDC technologies. Experience Strong Data Engineering background, including data modelling, transformation, and integration Experience working within cloud environments and tools Knowledge of CI/CD pipelines ...

... Big Data Engineering. - 2+ years of experience building large-scale distributed data processing systems. - Experience supporting production-grade analytics and ML platforms. Large-scale data processing, performance tuning, batch and streaming pipelines. Event streaming, real-time data processing, and messaging architectures. ...

... https://jobeax.com/link/mYvMZkpRFRzMWb6X company culture revolves around maximizing decision velocity and minimizing decision risk for enterprises ambitious enough to make data their voice. Data Engineering Excellence : Design and implement data pipelines using formats like JSON, Parquet, CSV, and ORC, utilizing batch and streaming ingestion. Cloud Data Migration ...

... contributing to large-scale data projects on Google Cloud Platform. You will work closely with senior engineers and data analysts to build and maintain robust data pipelines, helping to turn raw data into actionable https://jobeax.com/link/d6zqLcygnqsI43u7 Responsibilities:- Develop, test, and maintain data pipelines and ...

... focus on Java, Microservices and Kafka Java Microservices Back end Developer Java Sprint boot Microservices with expected knowledge of Kafka, Basic knowledge of Database. Experience with TDD and BDD. Must have experience with one of cloud (GCP, AWS or Azure). Also experience with Kubernetes and containers - Hands-on experience ...

... pipelines, and data warehousing solutions. The ideal candidate will have strong expertise in distributed data processing, cloud technologies, and software engineering best practices. Key Responsibilities: Design, develop, and maintain scalable ETL/ELT pipelines. Build and optimize data warehouses, data lakes, and data ...

... Responsibilities : - Architect and maintain complex data models that serve as the foundation for enterprise-wide reporting and advanced analytics, ensuring high data integrity and performance.- Lead the end-to-end design and implementation of scalable ETL/ELT pipelines within the Snowflake environment to streamline data ingestion ...

... and convenience in a seamless digital experience. Collaboration with Data Engineering Team Partner closely with our Data Engineering team to ensure efficient data collection, storage, and processing Collaborate in designing and optimizing data pipelines for seamless data movement Work jointly on data architecture decisions ...

... by ensuring that data pipelines are robust, efficient, and scalable Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners. Implements and maintains reliable and scalable data infrastructure to move, process and serve data. ...

... accuracy across the network. Define and maintain strict access control, governance, and data privacy standard practices across the global insights platform. Engineering Hygiene & DevOps Packaged and deploy data services using Docker and Kubernetes. Maintain elegant CI/CD automation pipelines for data code deployments and ...

... affordable healthcare. Build and manage digital analytics datasets and reporting solutions Develop data pipelines and analytical reporting frameworks Support data validation, UAT, process improvements, and analytics initiatives. Experience & Qualification: Python Power BI & Dashboard Development Data Modeling & Data Validation ...