1,970 big data hadoop jobs in India.

• Hybrid

... consumers.- Partner with stakeholders to identify data bottlenecks and implement innovative engineering solutions that support the long-term scalability of our Big Data https://jobeax.com/link/1dkmzToQOwmnlB8O Skillset : - Demonstrated expertise in building distributed data systems using Hadoop, Spark, and Scala, with a ...

... Big Data repositories and enforce standards and principles in the Big Data space. The candidate will be part of an exciting, fast paced environment developing Data Engineering solutions in the data and analytics domain. Develop high quality, secure and scalable data pipelines using spark, Scala/ python on Hadoop or object ...

• Hybrid

20k

... architecture, and delivery of large-scale data engineering solutions across cloud and hybrid environments. Drive end-to-end data platform implementations encompassing data ingestion, transformation, storage, processing, governance, and consumption. Architect batch and real-time data pipelines leveraging modern big data frameworks ...

• Remote

... maintain scalable big data pipelines and architectures to support robust data solutions.- Collaborate with cross-functional teams to understand and deliver on data requirements and business objectives.- Implement data integration, transformation, and processing solutions using Python and relevant big data technologies.- ...

• Remote
• Contract

$ 62400 p.a.

... build, and maintain scalable data pipelines and architectures for large-scale data environments. - Translate business and technical requirements into reliable data engineering solutions. - Develop data integration, transformation, and processing workflows using Python and appropriate big data technologies. - Build, manage, ...

• Remote
• Contract

$ 62400 p.a.

... build, and maintain scalable data pipelines and architectures for large-scale data environments. - Translate business and technical requirements into reliable data engineering solutions. - Develop data integration, transformation, and processing workflows using Python and appropriate big data technologies. - Build, manage, ...

... you an all-around data enthusiast with a knack for ETL We're hiring Data Engineers to help build and optimize the foundational architecture of our product's data. We've built a strong data engineering team to date, but have a lot of work ahead of us, Migrating from relational databases to a streaming and big data architecture, ...

... commitments. Leverage AI-assisted tools to accelerate delivery and improve quality and actively experiment with emerging capabilities as they evolve. Have 5+ years of data engineering experience - Experience with big data technologies such as Spark, Databricks, Delta lakes, Hive, etc. - 4+ years of experience in core languages such ...

• On-site

... leading the system design and implementation of technical solutions. Working with data excites you; You have created Big Data architecture, can build and operate data pipelines, and maintain data storage, all within distributed systems. You have a deep understanding of data modeling and experience with modern data engineering ...

... prescriptive) development using various statistical & machine learning techniques/algorithms Test/train the model, Improve Model accuracy, Monitor model performance Data Extraction from EDW/Big Data Platform, Dataset Preparation (creation of base data, aggregation, transformation), performing EDA Desired Experience & Education: ...

The ideal candidate will use their passion for big data and analytics to provide insights to the business covering a range of topics. They will be responsible for conducting both recurring and ad hoc analysis for business users. Responsibilities Understand the day-to-day issues that our business faces, which can be better ...

• Full-time

... reporting and product development teams 3 to 6 years of experience in the field of data engineering - Graduate degree or higher with courses in programming, data analytics - Good programming skill in Python/scala or any scripting language - Good knowledge of SQL is a required - Basic knowledge and understanding of big ...

About the Role : We are looking for a Big Data Engineer to design, build, and operate large-scale data pipelines and analytical infrastructure that transform high-volume raw data into reliable, query-ready datasets for analytics, reporting, and data-driven https://jobeax.com/link/HouIpt6AtbK1KWOU data platform ingests and ...

• On-site

... efficient code using Scala and Spark - Work with Azure or on-premises Hadoop ecosystem for data processing - Solve real-world engineering problems related to data infrastructure - Collaborate with cross-functional teams to deliver data-driven solutions - Ensure data quality, reliability, and performance across data systems ...

... similar). Experience in building data pipelines or ETL processes. Familiarity with REST APIs and backend frameworks (Flask/Django is a plus). Understanding of data structures and algorithms. Good To Have Experience with big data tools (Spark, Hadoop). Knowledge of cloud platforms (AWS, Azure, or GCP). Exposure to machine ...

• Full-time

... stream-processing systems: Experience with object-oriented/object-function scripting languages: Python, Java, etc. Knowledge of data pipelines and workflow management tools like Airflow Hiring #SeniorDataEngineer #BigData #ChennaiJobs #ETL #AWS #SQL #DataPipelines #DataEngineering #Python #Java #Kafka #Hadoop #MachineLearning

... or TensorFlow for building, customizing, and training deep neural networks from scratch. Big Data Ecosystem: Experience with Apache Spark (PySpark) and the Hadoop Ecosystem (HDFS, Hive, MapReduce) for handling, transforming, and querying large-scale distributed datasets. Cloud Architecture: Experience building and deploying ...

... Learning and GenAI algorithms.- Experience with AI cloud platforms - AWS / Azure / GCP.- PySpark and Scala exposure is a plus.- Familiarity with Deep Learning, Big Data environments such as Hadoop/Hive is an advantage.- https://jobeax.com/link/5Im6Nfh21WlEEm2q MSc, MBA or https://jobeax.com/link/s1WvHFV9ITSwCkyS in Statistics, ...

• Remote

10k - 33k

... or Azure environments Python & scripting for automation and data processing Data streaming technologies (Kafka, Spark, Flink) Big Data platforms (Snowflake, Databricks, Hadoop, Teradata) Exposure to AI/ML and advanced analytics Experience with NoSQL databases Ability to design scalable and maintainable data architectures. ...

... product managers - Experience in agile methodology Development and support experience in Big Data domain Architecting, developing, implementing and maintaining Big Data solutions Experience with database modeling and development, data mining and warehousing. Experience with Hadoop ecosystem (HDFS, MapReduce, Oozie, Hive, ...