Vacancy description
Infinite Computer Solutions India Ltd.
Bangalore, भारत
Key Responsibilities :- Lead the design and implementation of scalable batch and real-time data pipelines on GCP.- Drive technical solutions using BigQuery, Dataflow, Dataproc, Pub/Sub, and related GCP services.- Design and optimize complex ETL/ELT workflows and distributed data processing solutions.- Develop and review Python code and advanced SQL queries for performance, maintainability, and reliability.- Establish standards for data pipeline development, testing, monitoring, and deployment.- Optimize BigQuery workloads, query performance, resource utilization, and cloud costs.- Lead technical discussions, architecture reviews, and solution design sessions.- Mentor engineers, conduct code reviews, and drive engineering excellence across the team.- Collaborate with enterprise architects, product owners, and business stakeholders to translate requirements into technical solutions.- Manage technical risks, resolve complex production issues, and ensure adherence to security and governance standards.- Support CI/CD implementation, automated testing, and DevOps practices for data engineering https://jobeax.com/link/jxoqTsknnvMnKMwn Skills :- 10-14 years of overall experience in data engineering, cloud data platforms, or related technologies.- Strong hands-on expertise in GCP data engineering services, particularly BigQuery, Dataflow, Dataproc, and Pub/Sub.- Advanced proficiency in Python and SQL.- Proven experience designing enterprise-grade data pipelines and data processing architectures.- Strong knowledge of batch processing, streaming, distributed computing, and data warehousing.- Experience in technical leadership, code reviews, mentoring, and delivery ownership.- Strong troubleshooting, performance optimization, and problem-solving skills.- Excellent communication and stakeholder management capabilities- (ref:hirist.tech)