Vacancy description

Senior Data Engineer - Python/Big Data in Bangalore, भारत

Youth4 Talent Solutions and Services

Bangalore, भारत

The core activities of this role are :- Design, construct, install, test and maintain data management systems.- Build high-performance algorithms, predictive models, and prototypes.- Ensure that all systems meet the business/company requirements as well as industry practices.- Integrate up-and-coming data management and software engineering technologies into existing data structures.- Develop set processes for data integration, data mining, data modeling, and data production.- Research new uses for existing data.- Collaborate with members of your team (e.g., Business Analysts, the IT team, data scientists) on the project's goals.- Install/update disaster recovery procedures.- Work with cloud computing environments.- Recommend different ways to constantly improve data reliability and quality.- Build and develop custom marketing dashboards for campaign effectiveness, daily/weekly/monthly trends on various KPIs- Highlight key metrics, analyze and interpret trends and provide actionable insights for future marketing activities based on available data- Conduct ROI analysis and attribution to evaluate the efficiency and effectiveness of various marketing initiatives- Define baselines and benchmarks to define the success and failure of marketing campaignsKey Skills :- Proficiency in Python and SQL- Thorough understanding of SQL/NOSQL databases such as Snowflake, Google Big Query, PostgreSQL, MongoDB, Amazon Redshift, MYSQL- Proficiency in developing dashboards, reports using Data Visualization/BI tools such as Tableau, Google Looker, Sisense- Exposure to various analytical & marketing campaign platforms (e.g. Google Analytics, Clevertap, Facebook Ads, Google Ads, Adobe Analytics, YouTube Analytics, etc.)Nice to have :- Familiarity with Big Data technologies such as Apache Spark, Apache Kafka, Apache Storm- Experience in analytics/ML libraries such as Pandas, Numpy, Skilearn, Scipy or similar libraries- Familiarity with Tensorflow, Keras- Familiarity with Data Integration libraries such as Apache Airflow, Luigi- Experience on developing and deploying applications on Google Cloud Platform and/or AWS (ref:hirist.tech)

Similar vacancies

More like this role

MYTECH GLOBAL PRIVATE LIMITED

Big Data Engineer - Spark/Python

  • Contract
Job Description : - 6+ Years of in Big Data & Data related technology experience.- Expert level understanding of distributed computing principles.- Expert level knowledge and experience in Apache Spark.- Hands on programming with Python.- Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop.- Experience with building stream-processing ...

Hyderabad, भारत

  • On-site
  • Full-time
... volumes of structured and unstructured data - Independently lead solution architecture, technical design, effort estimation, and implementation planning for data engineering initiatives What you need - SQL - ETL - Python - Spark - Azure Data Factory - Hadoop Good to have - LLMs - Kafka - CI/CD - MongoDB - Shell scripting ...

Pune, भारत

  • Full-time
... scoping and designing analytic data assets, implementing modelled attributes and contributing to brainstorming sessions - Build and maintain a robust data engineering process to develop and implement self-serve data and tools for Visa’s product management teams and data scientists What you need - Spark - AWS - Data warehousing ...

Bangalore, भारत

Zorba Consulting India

Big Data Engineer

  • On-site

Rs 10 - 19 lakhs p.a.

1. Utilize strong software engineering skills in Java, Python, Scala, and Apache Spark to analyze complex systems and design scalable data solutions. 2. Design, develop, and maintain scalable Big Data applications and distributed data processing solutions. 3. Integrate new data sources, tools, and technologies into existing ...

Hyderabad, भारत

Zorba Consulting India

Big Data Engineer

  • On-site

Rs 10 - 18 lakhs p.a.

We are looking for an experienced Big Data Engineer with strong software engineering and distributed data processing skills. The ideal candidate should have hands-on experience with Java, Apache Spark, Python/Scala, and the Hadoop ecosystem to build scalable, reliable data solutions. Roles & Responsibilities Analyze complex ...

Hyderabad, भारत

PradeepIT Consulting Services

Big Data & GCP- Senior Software Engineer

  • Full-time
  • IT
Senior data science role at PradeepIT Consulting Services in Bengaluru. Needs 5–7 years. What you'll do - Design, developing and maintaining the data architecture, data models and standards for various Data Integration & Data Warehousing projects in GCP cloud - Ensure the use of Big Query SQL, Java/Python/Scala and Spark ...

Bangalore, भारत

Zorba Consulting India

AWS Big Data Engineer

Rs 10 - 19 lakhs p.a.

We are looking for an experienced AWS Big Data Engineer with strong expertise in Python/Scala, Apache Spark, AWS cloud services, and Apache Airflow. The ideal candidate will have hands-on experience developing scalable data engineering solutions, API-driven backend services, and distributed Big Data applications. Key Responsibilities ...

Hyderabad, भारत

  • Full-time
Data science role at Capco in Pune. What you'll do - Design, develop, and maintain scalable Big Data applications and data pipelines - Develop high-performance data-processing solutions using Scala and Apache Spark - Build and optimize ETL/ELT pipelines for large volumes of structured and unstructured data What you need ...

Pune, भारत

  • On-site
  • Full-time
... platforms for batch and real-time data processing - Build scalable data ingestion and processing frameworks to handle structured, semi-structured, and unstructured datasets - Solve complex business problems by leveraging data engineering best practices and advanced technologies What you need - SQL - ETL - Python - Spark - Azure ...

Pune, भारत

  • On-site
  • Full-time
... Develop scalable data solutions to collect, ingest, transform, and store large volumes of structured and unstructured data - Monitor, optimize, and troubleshoot data pipelines to ensure high availability, reliability, scalability, and performance What you need - SQL - ETL - Python - Spark - Databricks - Azure Data Factory ...

Pune, भारत