Vacancy description

Senior Big Data Engineer - Azure/AWS Databricks in Gurgaon, भारत

SUPERSOURCING TECHNOLOGIES PRIVATE LIMITED

Gurgaon, भारत

About the Opportunity : We are looking for experienced Big Data Engineers and Databricks professionals who can design, develop, and optimize scalable data engineering solutions using modern Big Data technologies and cloud https://jobeax.com/link/UuxHBYkbQjke5gQz ideal candidate should have strong hands-on experience with Apache Spark, Python, and Databricks, along with practical exposure to Azure or AWS cloud environments. You will work on large-scale data processing systems, building reliable data pipelines and contributing to high-performance data https://jobeax.com/link/tlplQAnK5B36KMXq Responsibilities : - Design, develop, and maintain scalable Big Data processing solutions using Apache Spark, Python, and Databricks.- Build and optimize data pipelines for processing structured and unstructured datasets.- Work with distributed computing frameworks to handle large-scale data processing requirements.- Develop data ingestion and transformation workflows from relational databases, ERP systems, files, and other data sources.- Optimize Spark jobs, troubleshoot performance bottlenecks, and improve data processing efficiency.- Implement real-time and streaming data solutions using technologies such as Spark Streaming and Kafka.- Work with cloud-native data services and integrate Databricks with Azure or AWS environments.- Collaborate with architects, data engineers, and cross-functional teams to deliver robust data solutions.- Contribute to technical design, solution architecture, code reviews, and engineering best practices.- Support Agile delivery practices and provide technical guidance to team members where https://jobeax.com/link/LQxweRav14OdzbnR Technical Skills : - Strong hands-on experience with Azure Databricks or AWS Databricks.- Excellent programming skills in Python.- Strong expertise in Apache Spark and PySpark.- Practical experience with Azure or AWS cloud platforms.- Good understanding of Big Data architecture and distributed computing.- Experience in Spark performance tuning and optimization.- Strong SQL knowledge, including joins, stored procedures, and relational database https://jobeax.com/link/GFtTrVxYSXfnUlnr Skills : - Hadoop ecosystem : HDFS, MapReduce, Sqoop.- Streaming technologies : Spark Streaming, Apache Storm.- Messaging platforms : Kafka, RabbitMQ.- Data processing tools : Hive, Impala.- NoSQL databases : HBase, Cassandra, MongoDB.- ETL development and data integration.- Experience integrating data from RDBMS, ERP systems, and file-based sources.- Big Data solution design and technical leadership https://jobeax.com/link/4Z6ZpJ6utwrpL5Ty We Are Looking For : - Professionals with strong hands-on development experience rather than application support-only backgrounds.- Candidates who have worked on enterprise-scale Big Data platforms.- Engineers capable of designing and implementing efficient data processing solutions.- Candidates with good problem-solving, analytical, and collaboration skills.- Technical leads who can contribute to architecture and guide engineering https://jobeax.com/link/N0YmOpffjXqba14c Drive Details : - Date : 14 November 2026- Location : Gurgaon- Venue : 1st Floor, Block 2, DLF Downtown, Commercial Site, Block V, DLF City, Phase (ref:hirist.tech)

Similar vacancies

More like this role

Zorba Consulting India

AWS Big Data Engineer

Rs 10 - 19 lakhs p.a.

We are looking for an experienced AWS Big Data Engineer with strong expertise in Python/Scala, Apache Spark, AWS cloud services, and Apache Airflow. The ideal candidate will have hands-on experience developing scalable data engineering solutions, API-driven backend services, and distributed Big Data applications. Key Responsibilities ...

Hyderabad, भारत

  • Full-time
  • IT
Mid-level data science role at JPMorgan Chase in Bengaluru. Needs 3+ years. What you'll do - Analyzes, develops, tests and supports cloud, big data and reporting solutions required to fulfil business and technology requirements - Troubleshoots technical issues by breaking down problems and ensuring permanent resolution ...

Bangalore, भारत

  • Full-time
  • IT
... to work in collaborative teams to achieve organizational goals. - Proven technical proficiency in Big data stack – HDFS, Spark, Impala, etc. with expertise in AWS including S3, EMR, SQS, etc. - Experience in some Industry Standard Reporting Tool like Cognos/Sigma/Thoughtspot etc. with knowledge in Advanced SQL and data ...

Bangalore, भारत

  • On-site
  • Full-time
... volumes of structured and unstructured data - Independently lead solution architecture, technical design, effort estimation, and implementation planning for data engineering initiatives What you need - SQL - ETL - Python - Spark - Azure Data Factory - Hadoop Good to have - LLMs - Kafka - CI/CD - MongoDB - Shell scripting ...

Pune, भारत

Cynosure Corporate Solutions

Senior Cloud Security Engineer - AWS/Azure

  • Cybersecurity
Role Overview :The Senior Cloud Security Engineer will be responsible for designing, implementing, and managing security controls across AWS and Azure cloud environments. The role involves developing secure cloud architectures, implementing preventive and detective security measures, integrating security practices into ...

Hyderabad, भारत

  • Full-time
... implementing modelled attributes and contributing to brainstorming sessions - Build and maintain a robust data engineering process to develop and implement self-serve data and tools for Visa’s product management teams and data scientists What you need - Spark - AWS - Data warehousing - ETL - Azure Data Factory - Hadoop Good to have ...

Bangalore, भारत

Zorba Consulting India

Big Data Engineer

  • On-site

Rs 10 - 19 lakhs p.a.

1. Utilize strong software engineering skills in Java, Python, Scala, and Apache Spark to analyze complex systems and design scalable data solutions. 2. Design, develop, and maintain scalable Big Data applications and distributed data processing solutions. 3. Integrate new data sources, tools, and technologies into existing ...

Hyderabad, भारत

Zorba Consulting India

Big Data Engineer

  • On-site

Rs 10 - 18 lakhs p.a.

... testing requirements for Big Data applications. Excellent written and verbal communication skills. Good to Have Experience with Apache Airflow. Experience with Big Data workflow orchestration and automation. Experience mentoring developers and providing technical direction. Preferred Candidate: Big Data Engineers / Java ...

Hyderabad, भारत

  • Hybrid
  • Full-time
  • IT
- The usability of the implemented presentations - Application package expertise - The overall production schedule - Automation based on Cloudera CDP 7.1 based on Ansible and Terraform in a hybrid context of internal cloud and physical servers - Maintenance of production: resolution of customer tickets, infrastructure

Bangalore, भारत

... Technology, Data Engineering or a related https://jobeax.com/link/kfLTLT6enIMYonWk Certifications : - AWS Certified Data Engineer - Associate- Google Professional Data Engineer- Microsoft Certified : Fabric Data Engineer Associate- Snowflake SnowPro Core Certification- Databricks Certified Data Engineer Associate (ref:hirist.tech) ...

Calcutta, भारत