Senior Data Engineer (Engineer 3) - GCP in Chennai, भारत

Senior Data Engineer (Engineer 3)

Position Overview

We are seeking an experienced Senior Data Engineer with 7+ years of professional experience. In this role, you will design, build, and maintain data infrastructure, pipelines, and platforms for collecting, storing, processing, and analyzing large volumes of data. You will collaborate with business and technology stakeholders to deliver scalable, reliable, and cost-effective data solutions that support analytics, machine learning, and business intelligence initiatives.

Key Responsibilities

• Work with business and technology stakeholders to understand data requirements and translate them into actionable solutions.
• Design, build, and maintain scalable data infrastructure, pipelines, data models, and applications.
• Develop and maintain data warehouses, data lakes, and data lakehouses for structured and unstructured data.
• Develop analytical tools, algorithms, and programs; write scripts and automate tasks.
• Monitor data systems, optimize performance, and identify opportunities for improvement.
• Design data architecture and select appropriate data transformation mechanisms and big data tools, considering long-term needs and cost-effectiveness.
• Develop analytical data models to support data science, machine learning, visualization, and business requirements.
• Implement CI/CD practices to improve development and deployment quality and reliability.
• Establish performance benchmarks, monitoring, and reliability practices.
• Implement data governance processes that support data protection requirements.
• Own initiatives and projects, manage risks, and deliver high-quality solutions on schedule.
• Participate in retrospectives and identify opportunities for continuous improvement.
• Mentor junior team members and help resolve roadblocks.
• Productionize components and models at scale, working with large data volumes.
• Stay current with emerging technologies and share relevant best practices.
• Communicate clearly with cross-functional teams and stakeholders.

Required Qualifications

• Experience: 7+ years of professional data engineering experience.
• Google Cloud Platform (GCP): Hands-on experience with BigQuery, Dataflow, Dataproc, Data Fusion, and Cloud SQL.
• Infrastructure and orchestration: Proficiency with Terraform, Tekton, and Apache Airflow.
• Data processing and streaming: Strong experience with Kafka, Pub/Sub, and PySpark.
• Programming: Expert-level proficiency in Python and API development.
• Databases: Solid experience with PostgreSQL and relational database design.
• Data architecture: Experience designing and implementing scalable data solutions and data models.
• Big data: Strong knowledge of tools and frameworks for large-scale data processing.
• CI/CD and DevOps: Understanding of continuous integration and continuous deployment practices.
• Problem-solving: Strong analytical and troubleshooting skills, including the ability to optimize data systems.
• Communication: Strong oral, written, and interpersonal communication skills, with the ability to work across teams.

Preferred Qualifications

• Experience with Jira for project tracking and collaboration.
• Knowledge of data governance frameworks and best practices.
• Experience with machine learning platforms and model deployment.
• Familiarity with data visualization tools and business intelligence platforms.
• Background in cloud data architecture and multi-cloud environments.
• Experience with containerization technologies and Kubernetes.

Key Competencies

• Technical excellence: Strong knowledge of data engineering technologies and best practices.
• Scalability and performance: Ability to design systems for large data volumes and optimize performance.
• Architecture design: Ability to design data solutions aligned with business requirements.
• Data governance and compliance: Understanding of data protection requirements and governance practices.
• Ownership and accountability: Takes ownership of projects and delivers results on schedule.
• Collaboration: Works effectively with data scientists, analysts, business stakeholders, and other teams.
• Innovation and learning: Learns new technologies and contributes relevant solutions and practices.
• Mentorship: Ability to mentor and guide junior team members.
• Reliability and monitoring: Establishes monitoring practices and supports system reliability and availability.
• Self-motivation: Takes initiative and contributes to team success.

Why Join Us?

This role offers the opportunity to:

• Work with modern cloud technologies and big data platforms.
• Design and implement solutions that support business outcomes.
• Collaborate with cross-functional teams and mentor junior team members.
• Contribute to organizational innovation and best practices.
• Work on large-scale data challenges in a dynamic environment.