Back to list

Vacancy description

Python/Pyspark Lead/Architect in भारत

Terrabit Consulting Pvt. Ltd - India

  • Full-timeStandard weekly hours

भारत

We
are seeking a highly skilled and experienced Python/PySpark Lead to drive the
design, development, and delivery of large-scale data engineering solutions.
The ideal candidate should possess strong technical expertise in Python and
PySpark, coupled with proven leadership capabilities to manage project
deliverables, mentor development teams, and engage effectively with business
and technology stakeholders  

Responsibilities

  • Lead the end-to-end delivery of Python/PySpark-based solutions,
    ensuring adherence to project timelines and quality standards. 
  • Provide technical leadership and guidance to development teams
    across design, development, testing, and deployment phases. 
  • Collaborate with business stakeholders, project managers, and
    technical teams to understand requirements and translate them into
    scalable solutions. 
  • Drive stakeholder communication by providing regular project
    updates, highlighting risks, dependencies, and mitigation plans. 
  • Perform hands-on development and code reviews to ensure
    adherence to coding standards, best practices, and performance
    optimization techniques. 
  • Foster collaboration, accountability, and a high-performance
    culture within the team. 
  • Support estimation, planning, resource coordination, and
    delivery governance activities. 
  • Ensure production stability, resiliency, and continuous
    improvement of data processing frameworks.

Qualifications

  • 10+ years of overall IT experience with strong expertise in
    Python and PySpark. 
  • Extensive experience in designing and developing scalable data
    processing and data transformation solutions. 
  • Strong knowledge of Spark architecture, distributed computing,
    performance tuning, and optimization. 
  • Experience working with Hadoop ecosystem components, Hive, SQL,
    and large-scale data platforms. 
  • Strong understanding of software engineering principles, design
    patterns, and Agile delivery methodologies. 
  • Excellent problem-solving, debugging, and analytical skills. 
  • Proven experience in leading technical teams and driving
    project execution. 
  • Excellent verbal and written communication skills with
    demonstrated stakeholder management experience. 

Preferred
Qualifications

  • Experience in Banking and Financial Markets domain is an added
    advantage. 
  • Exposure to cloud-based data platforms such as Databricks, AWS,
    or Azure is desirable. 
  • Experience in mentoring and developing high-performing
    engineering teams.
Loading similar vacancies…