Vacancy description

Big Data Engineer - Spark/Python in Hyderabad, भारत

MYTECH GLOBAL PRIVATE LIMITED

  • ContractFixed-term or freelance

Hyderabad, भारत

Job Description : - 6+ Years of in Big Data & Data related technology experience.- Expert level understanding of distributed computing principles.- Expert level knowledge and experience in Apache Spark.- Hands on programming with Python.- Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop.- Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming.- Experience with messaging systems, such as Kafka or RabbitMQ.- Good understanding of Big Data querying tools, such as Hive, and Impala.- Experience with integration of data from multiple data sources such as RDBMS (SQL Server, Oracle), ERP, Files.- Good understanding of SQL queries, joins, stored procedures, relational schemas.- Experience with NoSQL databases, such as HBase, Cassandra, MongoDB.- Knowledge of ETL techniques and frameworks.- Performance tuning of Spark Jobs.- Experience with native Cloud data services Azure databricks OR GCP.- Ability to lead a team efficiently.- Experience with designing and implementing Big data solutions.- Practitioner of AGILE https://jobeax.com/link/N0i8lsKvbJt9uilT Offer : - Opportunity to work on technical challenges that may impact across geographies.- Vast opportunities for self-development : online university, knowledge sharing opportunities globally, learning opportunities through external certifications.- Opportunity to share your ideas on international platforms.- Sponsored Tech Talks & Hackathons.- Possibility to relocate to any EPAM office for short and long-term projects.- Focused individual https://jobeax.com/link/L1F0UIC4u0wIAPPG package : - Health benefits, Medical Benefits.- Retirement benefits.- Paid time off.- Flexible benefits. (ref:hirist.tech)

Similar vacancies

More like this role

  • Full-time
... efficient, reusable, and reliable Python/Scala code - Ensure the best possible performance, quality, and responsiveness of the applications What you need - Python - Spark - SQL - Scala - Prototyping - Hadoop Good to have - Kafka - JIRA - Git - Jenkins - Linux - Data structures Job details - Location: Pune - Experience: ...

Pune, भारत

GANIT BUSINESS SOLUTIONS PRIVATE LIMITED

Ganit - Senior Data Engineer - Python/Spark

  • On-site
... cloud-based data migration projects.- Education: Bachelors or higher degree in Computer Science, Data Engineering, or a related field.Skills:- Proficiency in Spark, SQL, Python, and other relevant data processing technologies.- Expertise in on-premises to cloud Spark code optimization and Medallion Architecture.- Strong ...

Gurgaon, भारत

  • On-site

Rs 10 - 19 lakhs p.a.

We are looking for an experienced Big Data Applications Engineer with strong software development skills and hands-on experience in AWS, distributed data processing, and API development. Key Responsibilities: 1. Design, develop, test, and deploy scalable Big Data applications using Java, Scala, Python, and Spark. 2. Build ...

Hyderabad, भारत

  • Full-time
... scoping and designing analytic data assets, implementing modelled attributes and contributing to brainstorming sessions - Build and maintain a robust data engineering process to develop and implement self-serve data and tools for Visa’s product management teams and data scientists What you need - Spark - AWS - Data warehousing ...

Bangalore, भारत

Zorba Consulting India

Big Data Engineer

  • On-site

Rs 10 - 19 lakhs p.a.

1. Utilize strong software engineering skills in Java, Python, Scala, and Apache Spark to analyze complex systems and design scalable data solutions. 2. Design, develop, and maintain scalable Big Data applications and distributed data processing solutions. 3. Integrate new data sources, tools, and technologies into existing ...

Hyderabad, भारत

Zorba Consulting India

Big Data Engineer

  • On-site

Rs 10 - 18 lakhs p.a.

We are looking for an experienced Big Data Engineer with strong software engineering and distributed data processing skills. The ideal candidate should have hands-on experience with Java, Apache Spark, Python/Scala, and the Hadoop ecosystem to build scalable, reliable data solutions. Roles & Responsibilities Analyze complex ...

Hyderabad, भारत

  • Full-time
Leadership data science role at Match Me Resume Match | Citi in Pune. Needs 13+ years. What you'll do - Lead the architecture, design, and development of large-scale, high-performance applications using Java, Apache Spark, and Big Data technologies - Shape technical strategy and influence architecture decisions across multiple ...

Pune, भारत

SUPERSOURCING TECHNOLOGIES PRIVATE LIMITED

EPAM - Big Data Engineer - ETL/Databricks

  • Full-time
... Hands-on experience with Azure Databricks or AWS Databricks.- Strong expertise in Apache Spark and distributed computing.- Hands-on programming experience with Python.- Big Data technologies and data engineering concepts.- Spark job performance tuning and optimization.- Cloud-based data engineering https://jobeax.com/link/uhm0YrInQB0jQSD2 ...

Gurgaon, भारत

Zorba Consulting India

AWS Big Data Engineer

Rs 10 - 19 lakhs p.a.

We are looking for an experienced AWS Big Data Engineer with strong expertise in Python/Scala, Apache Spark, AWS cloud services, and Apache Airflow. The ideal candidate will have hands-on experience developing scalable data engineering solutions, API-driven backend services, and distributed Big Data applications. Key Responsibilities ...

Hyderabad, भारत

  • Full-time
Data science role at Capco in Pune. What you'll do - Design, develop, and maintain scalable Big Data applications and data pipelines - Develop high-performance data-processing solutions using Scala and Apache Spark - Build and optimize ETL/ELT pipelines for large volumes of structured and unstructured data What you need ...

Pune, भारत