Senior data science role at MetLife in Pune. Needs 8–10 years and a https://jobeax.com/link/wOcGjnRrrRFUZzB4, https://jobeax.com/link/2DENLGgQM7whDhaE or B.E..
What you'll do
Design, build, and maintain robust ETL/ELT pipelines across Azure cloud and on-premises environments for batch and real-time data processing
Develop scalable solutions to collect, ingest, transform, and store large volumes of structured and unstructured data
Independently lead solution architecture, technical design, effort estimation, and implementation planning for data engineering initiatives
What you need
SQL
ETL
Python
Spark
Azure Data Factory
Hadoop
Good to have
LLMs
Kafka
CI/CD
MongoDB
Shell scripting
Git
Job details
Location: Pune
Experience: 8–10 years
Education: https://jobeax.com/link/wOcGjnRrrRFUZzB4 or https://jobeax.com/link/2DENLGgQM7whDhaE or B.E. or BCA
... scoping and designing analytic data assets, implementing modelled attributes and contributing to brainstorming sessions - Build and maintain a robust data engineering process to develop and implement self-serve data and tools for Visa’s product management teams and data scientists What you need - Spark - AWS - Data warehousing ...
1. Utilize strong software engineering skills in Java, Python, Scala, and Apache Spark to analyze complex systems and design scalable data solutions. 2. Design, develop, and maintain scalable Big Data applications and distributed data processing solutions. 3. Integrate new data sources, tools, and technologies into existing ...
... testing requirements for Big Data applications. Excellent written and verbal communication skills. Good to Have Experience with Apache Airflow. Experience with Big Data workflow orchestration and automation. Experience mentoring developers and providing technical direction. Preferred Candidate: Big Data Engineers / Java ...
Senior data science role at PradeepIT Consulting Services in Bengaluru. Needs 5–7 years. What you'll do - Design, developing and maintaining the data architecture, data models and standards for various Data Integration & Data Warehousing projects in GCP cloud - Ensure the use of Big Query SQL, Java/Python/Scala and Spark ...
... Apache Airflow. The ideal candidate will have hands-on experience developing scalable data engineering solutions, API-driven backend services, and distributed Big Data applications. Key Responsibilities Design, develop, test, and deploy scalable Big Data applications and data engineering solutions on AWS. Develop API-driven ...
Data science role at Capco in Pune. What you'll do - Design, develop, and maintain scalable Big Data applications and data pipelines - Develop high-performance data-processing solutions using Scala and Apache Spark - Build and optimize ETL/ELT pipelines for large volumes of structured and unstructured data What you need ...
... platforms for batch and real-time data processing - Build scalable data ingestion and processing frameworks to handle structured, semi-structured, and unstructured datasets - Solve complex business problems by leveraging data engineering best practices and advanced technologies What you need - SQL - ETL - Python - Spark - Azure ...
... scalable data pipelines using spark, Scala/ python on Hadoop or object storage - Leverage new technologies and approaches to innovate with increasingly large data sets - Drive automation and efficiency in Data ingestion, data movement and data access workflows by innovation and collaboration What you need - Python - ETL ...
Senior data science role at MetLife in Pune. Needs 5–8 years and a https://jobeax.com/link/wOcGjnRrrRFUZzB4, https://jobeax.com/link/2DENLGgQM7whDhaE or B.E.. What you'll do - Design, build, and maintain robust ETL/ELT pipelines on Azure cloud and on-premises platforms for batch and real-time data processing - Develop scalable ...
Mid-level data science role at Citi in Pune. Needs 4+ years. What you'll do - Responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team What you need - Spark - SQL - Python - Hadoop - ETL - Linux Good to have - FastAPI ...