Back to list

Vacancy description

Big Data Applications Engineer_AWS in Hyderabad, भारत

Zorba Consulting India

  • On-siteWork from the office

Rs 10 - 19 lakhs p.a.

Hyderabad, भारत

We are looking for an experienced Big Data Applications Engineer with strong software development skills and hands-on experience in AWS, distributed data processing, and API development.

Key Responsibilities:
1. Design, develop, test, and deploy scalable Big Data applications using Java, Scala, Python, and Spark.
2. Build and maintain distributed batch-processing applications using Hadoop, HDFS, Spark, and MapReduce.
3. Integrate new data sources and tools into existing Big Data ecosystems.
4. Develop and support REST APIs, SOAP web services, microservices, and API integrations.
5. Design and implement scalable data-processing solutions using AWS services.
6. Optimize batch application performance across Spark, Hadoop, EMR, Java, and Python workloads.
7. Work with cross-functional teams to design, develop, and deploy reliable data solutions.
8. Collaborate with onsite and offshore teams, providing technical guidance on architecture and development.
9. Follow secure development practices, automated testing, and CI/CD processes.
Mandatory Technical Skills:
- Programming: Java, Scala, Python
- Big Data: Apache Spark, Hadoop, HDFS, MapReduce, Cassandra
- AWS: EMR, EC2, ECS, S3, Airflow, Step Functions, API Gateway
- API Development: REST APIs, SOAP Web Services, Microservices
- Scripting: Linux, Shell Scripting, Python
- Performance Tuning: Spark, Hadoop, EMR, Java, and Python batch applications
Preferred Skills:
- Git, GitHub, Bitbucket, GitLab
- Maven, Gradle, Jenkins, Artifactory
- AWS CodeCommit and CloudFormation
- IntelliJ IDEA / PyCharm
- CI/CD and automated deployment practices

Similar vacancies

More like this role

  • Full-time
... scoping and designing analytic data assets, implementing modelled attributes and contributing to brainstorming sessions - Build and maintain a robust data engineering process to develop and implement self-serve data and tools for Visa’s product management teams and data scientists What you need - Spark - AWS - Data warehousing ...

Bangalore, भारत

Zorba Consulting India

Big Data Engineer

  • On-site

Rs 10 - 19 lakhs p.a.

1. Utilize strong software engineering skills in Java, Python, Scala, and Apache Spark to analyze complex systems and design scalable data solutions. 2. Design, develop, and maintain scalable Big Data applications and distributed data processing solutions. 3. Integrate new data sources, tools, and technologies into existing ...

Hyderabad, भारत

Zorba Consulting India

Big Data Engineer

  • On-site

Rs 10 - 18 lakhs p.a.

... testing requirements for Big Data applications. Excellent written and verbal communication skills. Good to Have Experience with Apache Airflow. Experience with Big Data workflow orchestration and automation. Experience mentoring developers and providing technical direction. Preferred Candidate: Big Data Engineers / Java ...

Hyderabad, भारत

PradeepIT Consulting Services

Big Data Developer

  • Full-time
Senior data science role at PradeepIT Consulting Services in Bengaluru. Needs 7–10 years. What you'll do - Design, develop, and implement highly scalable and distributed big data - Architect HBase schemas and data models to accommodate evolving business - Develop complex Hive queries and data processing pipelines to transform ...

Bangalore, भारत

Zorba Consulting India

AWS Big Data Engineer

Rs 10 - 19 lakhs p.a.

... and distributed Big Data applications. Key Responsibilities Design, develop, test, and deploy scalable Big Data applications and data engineering solutions on AWS. Develop API-driven backend services to manage, monitor, and govern large-scale batch data processing applications. Build and maintain data pipelines using Apache ...

Hyderabad, भारत

  • Full-time
  • Data Analytics
... reporting, or liquidity risk. - Demonstrated expertise with Hadoop, Spark including PySpark and Scala Spark, Kafka, and cloud-based data platforms such as AWS S3 and Databricks. - Experience with data modeling tools and techniques. - Experience with Python or R for data analysis is highly desirable. - Experience preparing data ...

Pune, भारत

Match Me Resume Match | Citi

Big Data pyspark developer

  • Full-time
... recommend solutions and improvements - Conduct testing and debugging, utilize script tools, and write basic code for design specifications What you need - Spark - AWS - Data modelling - Hadoop - Kafka - Databricks Good to have - Machine learning - Python - R - Scala Job details - Location: Pune - Experience: 3–5 years - Education: ...

Pune, भारत

  • Full-time
Data science role at Capco in Pune. What you'll do - Design, develop, and maintain scalable Big Data applications and data pipelines - Develop high-performance data-processing solutions using Scala and Apache Spark - Build and optimize ETL/ELT pipelines for large volumes of structured and unstructured data What you need ...

Pune, भारत

  • On-site
  • Full-time
... platforms for batch and real-time data processing - Build scalable data ingestion and processing frameworks to handle structured, semi-structured, and unstructured datasets - Solve complex business problems by leveraging data engineering best practices and advanced technologies What you need - SQL - ETL - Python - Spark - Azure ...

Pune, भारत

  • Full-time
... scalable data pipelines using spark, Scala/ python on Hadoop or object storage - Leverage new technologies and approaches to innovate with increasingly large data sets - Drive automation and efficiency in Data ingestion, data movement and data access workflows by innovation and collaboration What you need - Python - ETL ...

Pune, भारत