Vacancy description
Python/Pyspark Lead/Architect in भारत
Terrabit Consulting Pvt. Ltd - India
- Full-timeStandard weekly hours
भारत
We
are seeking a highly skilled and experienced Python/PySpark Lead to drive the
design, development, and delivery of large-scale data engineering solutions.
The ideal candidate should possess strong technical expertise in Python and
PySpark, coupled with proven leadership capabilities to manage project
deliverables, mentor development teams, and engage effectively with business
and technology stakeholders
Responsibilities
- Lead the end-to-end delivery of Python/PySpark-based solutions,
ensuring adherence to project timelines and quality standards. - Provide technical leadership and guidance to development teams
across design, development, testing, and deployment phases. - Collaborate with business stakeholders, project managers, and
technical teams to understand requirements and translate them into
scalable solutions. - Drive stakeholder communication by providing regular project
updates, highlighting risks, dependencies, and mitigation plans. - Perform hands-on development and code reviews to ensure
adherence to coding standards, best practices, and performance
optimization techniques. - Foster collaboration, accountability, and a high-performance
culture within the team. - Support estimation, planning, resource coordination, and
delivery governance activities. - Ensure production stability, resiliency, and continuous
improvement of data processing frameworks.
Qualifications
- 10+ years of overall IT experience with strong expertise in
Python and PySpark. - Extensive experience in designing and developing scalable data
processing and data transformation solutions. - Strong knowledge of Spark architecture, distributed computing,
performance tuning, and optimization. - Experience working with Hadoop ecosystem components, Hive, SQL,
and large-scale data platforms. - Strong understanding of software engineering principles, design
patterns, and Agile delivery methodologies. - Excellent problem-solving, debugging, and analytical skills.
- Proven experience in leading technical teams and driving
project execution. - Excellent verbal and written communication skills with
demonstrated stakeholder management experience.
Preferred
Qualifications
- Experience in Banking and Financial Markets domain is an added
advantage. - Exposure to cloud-based data platforms such as Databricks, AWS,
or Azure is desirable. - Experience in mentoring and developing high-performing
engineering teams.
Loading similar vacancies…