Back to list

Vacancy description

Senior Big Data Engineer - Azure/AWS Databricks in Gurgaon, भारत

SUPERSOURCING TECHNOLOGIES PRIVATE LIMITED

Gurgaon, भारत

About the Opportunity : We are looking for experienced Big Data Engineers and Databricks professionals who can design, develop, and optimize scalable data engineering solutions using modern Big Data technologies and cloud https://jobeax.com/link/UuxHBYkbQjke5gQz ideal candidate should have strong hands-on experience with Apache Spark, Python, and Databricks, along with practical exposure to Azure or AWS cloud environments. You will work on large-scale data processing systems, building reliable data pipelines and contributing to high-performance data https://jobeax.com/link/tlplQAnK5B36KMXq Responsibilities : - Design, develop, and maintain scalable Big Data processing solutions using Apache Spark, Python, and Databricks.- Build and optimize data pipelines for processing structured and unstructured datasets.- Work with distributed computing frameworks to handle large-scale data processing requirements.- Develop data ingestion and transformation workflows from relational databases, ERP systems, files, and other data sources.- Optimize Spark jobs, troubleshoot performance bottlenecks, and improve data processing efficiency.- Implement real-time and streaming data solutions using technologies such as Spark Streaming and Kafka.- Work with cloud-native data services and integrate Databricks with Azure or AWS environments.- Collaborate with architects, data engineers, and cross-functional teams to deliver robust data solutions.- Contribute to technical design, solution architecture, code reviews, and engineering best practices.- Support Agile delivery practices and provide technical guidance to team members where https://jobeax.com/link/LQxweRav14OdzbnR Technical Skills : - Strong hands-on experience with Azure Databricks or AWS Databricks.- Excellent programming skills in Python.- Strong expertise in Apache Spark and PySpark.- Practical experience with Azure or AWS cloud platforms.- Good understanding of Big Data architecture and distributed computing.- Experience in Spark performance tuning and optimization.- Strong SQL knowledge, including joins, stored procedures, and relational database https://jobeax.com/link/GFtTrVxYSXfnUlnr Skills : - Hadoop ecosystem : HDFS, MapReduce, Sqoop.- Streaming technologies : Spark Streaming, Apache Storm.- Messaging platforms : Kafka, RabbitMQ.- Data processing tools : Hive, Impala.- NoSQL databases : HBase, Cassandra, MongoDB.- ETL development and data integration.- Experience integrating data from RDBMS, ERP systems, and file-based sources.- Big Data solution design and technical leadership https://jobeax.com/link/4Z6ZpJ6utwrpL5Ty We Are Looking For : - Professionals with strong hands-on development experience rather than application support-only backgrounds.- Candidates who have worked on enterprise-scale Big Data platforms.- Engineers capable of designing and implementing efficient data processing solutions.- Candidates with good problem-solving, analytical, and collaboration skills.- Technical leads who can contribute to architecture and guide engineering https://jobeax.com/link/N0YmOpffjXqba14c Drive Details : - Date : 14 November 2026- Location : Gurgaon- Venue : 1st Floor, Block 2, DLF Downtown, Commercial Site, Block V, DLF City, Phase (ref:hirist.tech)

Loading similar vacancies…