Vacancy description
Big Data Applications Engineer_AWS in Hyderabad, भारत
Zorba Consulting India
- On-siteWork from the office
Rs 10 - 19 lakhs p.a.
Hyderabad, भारत
We are looking for an experienced Big Data Applications Engineer with strong software development skills and hands-on experience in AWS, distributed data processing, and API development.
Key Responsibilities:
1. Design, develop, test, and deploy scalable Big Data applications using Java, Scala, Python, and Spark.
2. Build and maintain distributed batch-processing applications using Hadoop, HDFS, Spark, and MapReduce.
3. Integrate new data sources and tools into existing Big Data ecosystems.
4. Develop and support REST APIs, SOAP web services, microservices, and API integrations.
5. Design and implement scalable data-processing solutions using AWS services.
6. Optimize batch application performance across Spark, Hadoop, EMR, Java, and Python workloads.
7. Work with cross-functional teams to design, develop, and deploy reliable data solutions.
8. Collaborate with onsite and offshore teams, providing technical guidance on architecture and development.
9. Follow secure development practices, automated testing, and CI/CD processes.
Mandatory Technical Skills:
- Programming: Java, Scala, Python
- Big Data: Apache Spark, Hadoop, HDFS, MapReduce, Cassandra
- AWS: EMR, EC2, ECS, S3, Airflow, Step Functions, API Gateway
- API Development: REST APIs, SOAP Web Services, Microservices
- Scripting: Linux, Shell Scripting, Python
- Performance Tuning: Spark, Hadoop, EMR, Java, and Python batch applications
Preferred Skills:
- Git, GitHub, Bitbucket, GitLab
- Maven, Gradle, Jenkins, Artifactory
- AWS CodeCommit and CloudFormation
- IntelliJ IDEA / PyCharm
- CI/CD and automated deployment practices