Vacancy description

Lead Big Data Engineer in Pune, भारत

Capco

Pune, भारत

Job Title: Big Data Engineers

About Us

“Capco, a Wipro company, is a global technology and management consulting firm. Awarded with  Consultancy of the year in the British Bank Award and has been ranked  Top 100 Best Companies for Women in India 2022 by  Avtar & Seramount . With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. 

WHY JOIN CAPCO?

You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.

MAKE AN IMPACT

Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.

#BEYOURSELFATWORK

Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.

CAREER ADVANCEMENT

With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.

DIVERSITY & INCLUSION

We believe that diversity of people and perspective gives us a competitive advantage.

Position: Data Engineer

Location: Pune, Maharashtra

Job Description

The Data semantic solution team is looking for a Big Data Engineer to drive our mission to unlock potential of data assets by consistently innovating, eliminating friction in how users access data from its Big Data repositories and enforce standards and principles in the Big Data space. The candidate will be part of an exciting, fast paced environment developing Data Engineering solutions in the data and analytics domain.

Role

• Develop high quality, secure and scalable data pipelines using spark, Scala/ python on Hadoop or object storage. • Leverage new technologies and approaches to innovate with increasingly large data sets. • Drive automation and efficiency in Data ingestion, data movement and data access workflows by innovation and collaboration. • Understand, implement and enforce Software development standards and engineering principles in the Big Data space. • Work closely with business stakeholders and embedded engineering teams within business teams in a collaborative manner to help them build scalable products in quick time. • Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency. • Perform assigned tasks and production incident independently.

All About You

• 10+ years of experience in Data Warehouse related projects and implementing multiple end-to-end DW projects in Big Data environment • Experience of building data pipelines through Spark with Scala/Python/Java on Hadoop or Object storage • Experience of building Nifi pipelines • Experience of working with Databases like Oracle, Netezza would be added advantage • Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan • Strong communication skills - both verbal and written – and strong relationship, collaboration skills and organizational skills • Ability to multi-task across multiple projects, interface with external / internal resources and provide technical leadership to junior team members • Ability to be high-energy, detail-oriented, proactive and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results • Ability to quickly learn and implement new technologies, and perform POC to explore best solution for the problem statement • Flexibility to work as a member of a matrix based diverse and geographically distributed project teams

If you are keen to join us, you will be part of an organization that values your contributions, recognizes your potential, and provides ample opportunities for growth. For more information, visit Follow us on Twitter, Facebook, LinkedIn, and YouTube.

Similar vacancies

More like this role

  • Full-time
... brainstorming sessions. - Build and maintain a robust data engineering process to develop and implement self-serve data and tools for Visas product management teams and data scientists. - Find opportunities to create automate and scale repeatable analyses or build self-service tools for business users. - Execute data engineering projects ...

Bangalore, भारत

... Engineer – Scala We are looking for an experienced Big Data Engineer with strong expertise in Scala and Apache Spark to design, develop, and optimize scalable data-processing solutions. The ideal candidate should have hands-on experience with distributed data platforms, large-scale ETL/data pipelines, and big data technologies. ...

Pune, भारत

  • Full-time
Responsibilities - Develop and enhance application systems and programs using application development procedures, programming concepts, and script tools. - Analyze and interpret code to identify system enhancements, vulnerabilities, and security issues.

Pune, भारत

Vserv Digital Services Pvt. Ltd.

Vserv - Python Team Lead - Big Data

Role Overview:We are looking for an experienced Python Team Lead with strong expertise in Big Data, statistical data analysis, AWS cloud services, and Agentic https://jobeax.com/link/1zoyWH1AVQN1pQPx Responsibilities:- Lead, mentor, and guide a team of Python developers/engineers.- Own technical architecture, design, development, ...

Bombay, भारत

  • Data Analytics
... metrics, and the integrity to call a flat result flat.- Own the data. Architect and optimise pipelines connecting game telemetry, the warehouse, and ML systems. Data quality, definitions and cost are yours, not just the final chart.- Make leadership fluent. Turn analysis into narrative for Product and Engineering leadership ...

Bangalore, भारत

... Set up monitoring and automated recovery https://jobeax.com/link/0kSopwW8F6ag7jjD Technical & Professional Skills : - Experience : 8 to 10 years in software engineering and big data development, including experience leading client-facing delivery teams.- Big Data Stack : Strong hands-on experience with Hadoop (HDFS, MapReduce, ...

Hyderabad, भारत

Runmap Infotech Private Ltd.

Senior Big Data Engineer - AWS Platform

... Spark | PySpark / https://jobeax.com/link/rvQtoDz2MEe5S7Tx are looking for an experienced Senior Big Data Engineer to design, develop, and optimize scalable big data solutions in an AWS-based https://jobeax.com/link/EG3PG5FSTAqKZnRA Responsibilities : - Design, develop, and maintain scalable big data solutions and data pipelines ...

Bangalore, भारत

About the Role:We are looking for a Big Data Engineer to design, build, and operate large-scale data pipelines and analytical infrastructure that transform high-volume raw data into reliable, query-ready datasets for analytics, reporting, and data-driven https://jobeax.com/link/HouIpt6AtbK1KWOU data platform ingests and ...

Delhi, भारत

SUPERSOURCING TECHNOLOGIES PRIVATE LIMITED

Senior Big Data Engineer - Azure/AWS Databricks

... application support-only backgrounds.- Candidates who have worked on enterprise-scale Big Data platforms.- Engineers capable of designing and implementing efficient data processing solutions.- Candidates with good problem-solving, analytical, and collaboration skills.- Technical leads who can contribute to architecture and guide ...

Gurgaon, भारत

... Data Engineering, SQL Unix + Big Data (Hadoop + Hive), Airflow, Datawarehousing, Data modelling and data processing frameworks.- Strong knowledge of SQL and database concepts.- Experience working with large-scale datasets in distributed environments.- Understanding of Data Warehousing concepts and dimensional data modeling.- ...

Chennai, भारत