spark jobs in Gurugram, India.

... new product offering within a globally distributed, remote-first, open-source-oriented environment. Accountabilities - Own the product strategy and roadmap for Spark projects, guiding development from the initial MVP through general availability. - Make Spark seamless for AI agents and the platforms they run on, ensuring ...

... https://jobeax.com/link/9SbHpXxjiRp9wZ5W Data Pipeline team is tasked with creating, deploying, and managing this platform, utilizing leading technologies like Databricks, Delta Lake, Spark, PySpark, Scala, and the AWS https://jobeax.com/link/keezIFcXvGwAB2II are actively seeking skilled Data Engineers to join our team and contribute to scaling ...

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Software Engineer – (Sr. Spark) based in India. As a Senior Spark Software Engineer, you will design, develop, and optimize scalable big data processing solutions that support complex enterprise ...

... Python, SQL and Web Scrapping.- Understanding of databases like No Sql , relational database, In Memory database and technologies like MongoDB, Redis, Apache Spark would be add on..- Knowledge of distributed computing frameworks and big data technologies (e.g., Hadoop, Spark) is a plus.- Excellent analytical and problem-solving ...

... optimize operational efficiency at https://jobeax.com/link/8KuEYorn4an4hpi5 Responsibilities :- Architect and maintain robust data pipelines using Python and Apache Spark to ensure seamless ingestion and processing of high-volume datasets for downstream analytics.- Orchestrate complex workflows using Airflow to guarantee data ...

... leads, and build a strong engineering https://jobeax.com/link/IzdiRuPEDm9cn8k5 Development : - Build and optimize data processing applications using Hadoop, Spark, Kafka, and HBase.- Manage batch/streaming performance, low-latency querying, and partition https://jobeax.com/link/HJ3J7bahcw0HWFhe Engagement : - Act as the ...

Job Title: AWS Big Data Engineer About the Role: We are looking for a highly skilled AWS Big Data Engineer with extensive experience in PySpark, SQL, Spark, and Airflow. The ideal candidate will have a strong background in coding and a deep understanding of big data technologies. You will be responsible for designing, developing, ...

... https://jobeax.com/link/nnF4EyWTLvU0XkJo and Technical Requirements :- Strong experience in big data engineering, data processing, and distributed computing.- Proficiency in Apache Spark, PySpark, and Hadoop ecosystem technologies.- Experience developing scalable data pipelines for batch and real-time data processing.- Strong programming skills ...

... https://jobeax.com/link/nnF4EyWTLvU0XkJo and Technical Requirements :- Strong experience in big data engineering, data processing, and distributed computing.- Proficiency in Apache Spark, PySpark, and Hadoop ecosystem technologies.- Experience developing scalable data pipelines for batch and real-time data processing.- Strong programming skills ...

... https://jobeax.com/link/nnF4EyWTLvU0XkJo and Technical Requirements :- Strong experience in big data engineering, data processing, and distributed computing.- Proficiency in Apache Spark, PySpark, and Hadoop ecosystem technologies.- Experience developing scalable data pipelines for batch and real-time data processing.- Strong programming skills ...