2,457 big data jobs in India.

... you an all-around data enthusiast with a knack for ETL We're hiring Data Engineers to help build and optimize the foundational architecture of our product's data. We've built a strong data engineering team to date, but have a lot of work ahead of us, Migrating from relational databases to a streaming and big data architecture, ...

... looking for a Big Data Engineer to drive our mission to unlock potential of data assets by consistently innovating, eliminating friction in how users access data from its Big Data repositories and enforce standards and principles in the Big Data space. The candidate will be part of an exciting, fast paced environment developing ...

... commitments. Leverage AI-assisted tools to accelerate delivery and improve quality and actively experiment with emerging capabilities as they evolve. Have 5+ years of data engineering experience - Experience with big data technologies such as Spark, Databricks, Delta lakes, Hive, etc. - 4+ years of experience in core languages such ...

• On-site

... leading the system design and implementation of technical solutions. Working with data excites you; You have created Big Data architecture, can build and operate data pipelines, and maintain data storage, all within distributed systems. You have a deep understanding of data modeling and experience with modern data engineering ...

... prescriptive) development using various statistical & machine learning techniques/algorithms Test/train the model, Improve Model accuracy, Monitor model performance Data Extraction from EDW/Big Data Platform, Dataset Preparation (creation of base data, aggregation, transformation), performing EDA Desired Experience & Education: ...

The ideal candidate will use their passion for big data and analytics to provide insights to the business covering a range of topics. They will be responsible for conducting both recurring and ad hoc analysis for business users. Responsibilities Understand the day-to-day issues that our business faces, which can be better ...

• Hybrid

20k

... architecture, and delivery of large-scale data engineering solutions across cloud and hybrid environments. Drive end-to-end data platform implementations encompassing data ingestion, transformation, storage, processing, governance, and consumption. Architect batch and real-time data pipelines leveraging modern big data frameworks ...

• Full-time

... reporting and product development teams 3 to 6 years of experience in the field of data engineering - Graduate degree or higher with courses in programming, data analytics - Good programming skill in Python/scala or any scripting language - Good knowledge of SQL is a required - Basic knowledge and understanding of big ...

About the Role : We are looking for a Big Data Engineer to design, build, and operate large-scale data pipelines and analytical infrastructure that transform high-volume raw data into reliable, query-ready datasets for analytics, reporting, and data-driven https://jobeax.com/link/HouIpt6AtbK1KWOU data platform ingests and ...

• Remote
• Contract

$ 62400 p.a.

... build, and maintain scalable data pipelines and architectures for large-scale data environments. - Translate business and technical requirements into reliable data engineering solutions. - Develop data integration, transformation, and processing workflows using Python and appropriate big data technologies. - Build, manage, ...

• Remote
• Contract

$ 62400 p.a.

... build, and maintain scalable data pipelines and architectures for large-scale data environments. - Translate business and technical requirements into reliable data engineering solutions. - Develop data integration, transformation, and processing workflows using Python and appropriate big data technologies. - Build, manage, ...

• Hybrid

... Big Data Engineer to join our high-performing data platform team. In this role, you will be responsible for architecting, developing, and maintaining robust data pipelines that process massive datasets to fuel our analytical engines. You will work closely with cross-functional teams, including data scientists, product ...

• Remote

... maintain scalable big data pipelines and architectures to support robust data solutions.- Collaborate with cross-functional teams to understand and deliver on data requirements and business objectives.- Implement data integration, transformation, and processing solutions using Python and relevant big data technologies.- ...

• Full-time

... experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. Experience building and optimizing 'big data' data pipelines, architectures and data sets. Experience performing root cause analysis of internal and external data and processes to answer specific business ...

Rs 22 - 60 lakhs p.a.

... accessibility and usability. Troubleshoot data-related issues and optimize data processing workflows. Skills and Qualifications - Bachelor's degree in Computer Science, Data Science, Statistics, or a related field. - 8-15 years of experience in data analysis or a similar role. - Proficiency in Databricks and Spark for big data processing. ...

... Modelling, OLAP cube modelling.- Data compression into PARQUET to improve processing and finetuning SQL programming skills.- Experience building and optimizing "big data" data pipelines, architectures and data sets.- Experience performing root cause analysis on internal and external data and processes to answer specific business ...

... distributed data processing. - Practical exposure to Machine Learning and Deep Learning model development and deployment. - Experience working with large, complex datasets in cloud-based or big data environments. - Practical understanding of Nixtla library is a plus. - Experience with MLOps , model monitoring, and CI/CD pipelines. ...

Big Data Processing: Design and manage scalable data pipelines to process massive datasets efficiently for model training and inference. Build, train, and fine-tune complex neural networks across text, audio, and visual modalities. Cloud Deployment: Architect and deploy models to cloud environments, leveraging distributed ...

... similar). Experience in building data pipelines or ETL processes. Familiarity with REST APIs and backend frameworks (Flask/Django is a plus). Understanding of data structures and algorithms. Good To Have Experience with big data tools (Spark, Hadoop). Knowledge of cloud platforms (AWS, Azure, or GCP). Exposure to machine ...

• On-site

... fundamentals and engineering principles, with hands-on experience in big data technologies such as Scala and Spark. The role involves working with cloud or on-premises data infrastructure and contributing to the design and development of robust, scalable data pipelines and solutions. Key Responsibilities: - Design and develop scalable ...