Back to list

Vacancy description

Big Data Engineer - Spark/Python in Bangalore, भारत

MYTECH GLOBAL PRIVATE LIMITED

  • ContractFixed-term or freelance

Bangalore, भारत

Job Description : - 6+ Years of in Big Data & Data related technology experience- Expert level understanding of distributed computing principles- Expert level knowledge and experience in Apache Spark- Hands on programming with Python- Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop- Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming- Experience with messaging systems, such as Kafka or RabbitMQ- Good understanding of Big Data querying tools, such as Hive, and Impala- Experience with integration of data from multiple data sources such as RDBMS (SQL Server, Oracle), ERP, Files- Good understanding of SQL queries, joins, stored procedures, relational schemas- Experience with NoSQL databases, such as HBase, Cassandra, MongoDB- Knowledge of ETL techniques and frameworks- Performance tuning of Spark Jobs- Experience with native Cloud data services AWS databricks OR Azure databricks- Ability to lead a team efficiently- Experience with designing and implementing Big data solutions- Practitioner of AGILE methodologyWE OFFER : - Opportunity to work on technical challenges that may impact across geographies- Vast opportunities for self-development : online university, knowledge sharing opportunities globally, learning opportunities through external certifications- Opportunity to share your ideas on international platforms- Sponsored Tech Talks & Hackathons- Possibility to relocate to any EPAM office for short and long-term projects- Focused individual developmentBenefit package : - Health benefits, Medical Benefits- Retirement benefits- Paid time off- Flexible benefits- Forums to explore beyond work passion (CSR, photography, painting, sports, etc) (ref:hirist.tech)

Similar vacancies

More like this role

Sciative Solutions Private Limited

Sciative Solutions- Data Engineer - Python/Spark

... problem-solving.- Solid understanding of data engineering concepts, data modeling, and data integration techniques.- Proficiency in programming languages such as Python, SQL and Web Scrapping.- Understanding of databases like No Sql , relational database, In Memory database and technologies like MongoDB, Redis, Apache Spark ...

Bombay, भारत

  • Hybrid
... Collaborate with engineering teams to establish best practices in data governance, security, and performance tuning, ensuring the long-term stability of our data https://jobeax.com/link/1dkmzToQOwmnlB8O Skillset :- Demonstrated expertise in building high-performance data pipelines using Python and Apache Spark, with a ...

Gurgaon, भारत

... issues.- Collaborate with data architects, analysts, and engineering teams to support data platform requirements.- Maintain technical documentation and follow data engineering best https://jobeax.com/link/wJIgo45kO3tINlTo Skills :- Apache Spark, PySpark, Hadoop, SQL, Python/Scala/Java, ETL, Big Data ProcessingSupported Skills ...

Hyderabad, भारत

... issues.- Collaborate with data architects, analysts, and engineering teams to support data platform requirements.- Maintain technical documentation and follow data engineering best https://jobeax.com/link/wJIgo45kO3tINlTo Skills :- Apache Spark, PySpark, Hadoop, SQL, Python/Scala/Java, ETL, Big Data ProcessingSupported Skills ...

Bangalore, भारत

... issues.- Collaborate with data architects, analysts, and engineering teams to support data platform requirements.- Maintain technical documentation and follow data engineering best https://jobeax.com/link/wJIgo45kO3tINlTo Skills :- Apache Spark, PySpark, Hadoop, SQL, Python/Scala/Java, ETL, Big Data ProcessingSupported Skills ...

Noida, भारत

... Professional Skills : - Experience : 8 to 10 years in software engineering and big data development, including experience leading client-facing delivery teams.- Big Data Stack : Strong hands-on experience with Hadoop (HDFS, MapReduce, YARN), Apache Spark (Core, SQL, Streaming), Apache Kafka, and HBase.- Architecture : Deep ...

Hyderabad, भारत

Job Title: AWS Big Data Engineer About the Role: We are looking for a highly skilled AWS Big Data Engineer with extensive experience in PySpark, SQL, Spark, and Airflow. The ideal candidate will have a strong background in coding and a deep understanding of big data technologies. You will be responsible for designing, developing, ...

भारत

  • Full-time
... interactive visualizations etc) which can offer ways to improve a business thus affecting business decisions. Must Have: - Strong design and coding skills using Big Data technologies such as Hadoop Spark(Pyspark) Hive and Airflow. - Experience with at least one cloud platform or service such as Azure or AWS. - Data warehousing ...

Bangalore, भारत

Vserv Digital Services Pvt. Ltd.

Vserv - Python Team Lead - Big Data

... establish engineering best practices.- Define scalable and maintainable solutions for complex data and analytics problems.- Troubleshoot complex production, data, performance, and scalability issues.- Mentor team members on Python, Big Data, AWS, statistics, and AI technologies.- Collaborate with Product, Data Science, ...

Bombay, भारत

  • Data Analytics
... they don't: numbers you'll present, causal claims, anything you can't verify. You know the difference between a fast answer and a correct one, and you check.- Big data and pipelines: Redshift, Athena, BigQuery, Hive or Spark, plus orchestration.- Real statistical foundations: experiment design, causal inference basics, ...

Bangalore, भारत

Patch Infotech Private Limited

Data Scientist - Python/Spark ML

  • Data Science
... Present findings and recommendations to client stakeholders as https://jobeax.com/link/157UJ0YGZTFgXNZ4 Skills:- Strong data science background with hands-on Databricks/Spark ML experience.- Proficiency in Python, statistical modeling, and ML frameworks.- Ability to translate business use cases into data science approaches. ...

भारत