Back to list

Vacancy description

GCP Data Engineer - Python in Chennai, भारत

xTag Services

Chennai, भारत

GCP Data Engineer - Python / PySparkExperience : 5.5 - 9 YearsOpenings : 8Role Overview : We are looking for experienced Data Engineers with strong expertise in Python or PySpark, SQL, GCP cloud services, data processing, data warehousing, and data pipelines. The ideal candidate should have hands-on experience with BigQuery, Dataflow or Dataproc, Pub/Sub, Apache Kafka, Airflow/Cloud Composer, and https://jobeax.com/link/u7IOHpkfssJtR5tu Responsibilities : - Design, develop, and maintain scalable data pipelines.- Develop data processing solutions using Python and/or PySpark.- Develop complex SQL queries and optimize data processing workloads.- Work with GCP data services including BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Functions.- Build and maintain data ingestion and transformation pipelines.- Develop and manage workflows using Airflow, Astronomer, or Cloud Composer.- Work with Apache Kafka for real-time data processing and streaming.- Implement infrastructure automation using Terraform.- Monitor data pipelines and troubleshoot production issues.- Develop monitoring dashboards and ensure pipeline reliability.- Collaborate with Data Scientists, Software Engineers, business stakeholders, and other technical https://jobeax.com/link/b98mNqN2dpm2gqBN Technical Skills : - SQL - minimum 4 years- Python or PySpark - minimum 4 years- GCP - minimum 3 years- BigQuery- Dataflow or Dataproc- Pub/Sub- Scheduled Queries- Cloud Functions- Monitoring Tools / Dashboards- Apache Kafka- Terraform scripting - minimum 2 years- Airflow / Astronomer / Cloud Composer - minimum 2 yearsGood to Have : - Data Fusion, Tekton Pipeline, CI/CD Pipeline, GCP Secret Manager- Data/ML solutions and advanced analytics exposure- Prompt Engineering, Generative AI, LLM, Agentic AI, LangGraph, CrewAI, OpenAI SDK, Google ADKSoft Skills : - Strong written and verbal communication skills- Strong presentation and stakeholder management skills- Excellent analytical and problem-solving abilities- Strong collaboration and interpersonal skills (ref:hirist.tech)

Similar vacancies

More like this role

  • Hybrid
  • Full-time
Position: Data Engineer – GCP Required Skills: Python, PySpark, SQL, Airflow, GCP, Bigdata Years of experience: 5+ Years Locations: Gurgaon We are seeking skilled Data Engineers with experience in modern data engineering practices and data modeling. You will leverage your knowledge and experience in programming languages ...

Indhur, भारत

  • IT
  • Cloud
... , Hyderabad , Chennai - Min 8-12 years of hands-on experience in GCP Data Engineering designing, building and supporting distributed systems and large-scale data processing systems in production with a proven track record. - Expertise in GCP Data Products e.g. BigQuery, Dataflow, Cloud Storage, Pub/Sub, and Cloud Composer, ...

Chennai, भारत

Cephas Consultancy Services Private Limited

Senior Data Engineer (Engineer 3) - GCP

  • Full-time
  • Contract
... Required Qualifications - Experience: 7+ years of professional data engineering experience. - Google Cloud Platform (GCP): Hands-on experience with BigQuery, Dataflow, Dataproc, Data Fusion, and Cloud SQL. - Infrastructure and orchestration: Proficiency with Terraform, Tekton, and Apache Airflow. - Data processing and streaming: ...

Chennai, भारत

Vsquare Systems Pvt. Ltd.

Vsquare Systems - GCP Data Engineer

... Platform (GCP) while ensuring data quality, performance, and scalable https://jobeax.com/link/60A4LTP1RtnIcSFF Responsibilities : - Design, develop, and maintain data pipelines on Google Cloud Platform (GCP).- Migrate ETL pipelines from Teradata Enterprise Data Warehouse (EDW) to GCP.- Develop and optimize complex SQL queries ...

Pune, भारत

  • Full-time

$14.68 USD

... flattening . Strong hands on experience with Terraform for GCP infrastructure provisioning, including modules and state management. . Working knowledge of Python for data engineering tasks . Experience with data validation, historical data migration, reconciliation, and performance optimization. . Working knowledge of GCP IAM, ...

Bangalore, भारत

... work. Job Summary As a key member of the Data Team at Equinix, we are seeking a skilled GCP Data Engineer who will be responsible for end-to-end development of Data Engineering use cases, Equinix Data Lake platform and tools. You will design, build, and maintain scalable data infrastructure and analytics solutions on Google ...

Bangalore, भारत

  • Contract
About the Role : We are hiring experienced Data Engineers for an exciting https://jobeax.com/link/7CRLQjGein4Ib5fK Skills : - Strong expertise in Advanced SQL, Python, and PySpark- Hands-on experience with Snowflake, Apache Spark, AWS Glue, and Airflow- AWS services : Lambda, Glue, S3, and related data engineering services- ...

Bangalore, भारत

Crescendo Global Leadership Hiring India Pvt Ltd

GCP Engineer - BigQuery/Data Build Tool

  • Hybrid
Consultant - GCP Engineer | 4 - 6 Years | BangaloreHiring a hands-on GCP Engineer with strong experience in Google Cloud Platform (GCP), BigQuery, and dbt. This is an excellent opportunity for professionals who enjoy building scalable cloud-based data solutions, developing data transformation workflows, optimizing data ...

Bangalore, भारत

  • Full-time
... Skills and Experience :- 4+ years of hands-on experience in data engineering.- Advanced proficiency in Python and SQL.- Strong expertise in ETL/ELT workflows and data pipeline development and maintenance.- Experience with PostgreSQL, MySQL, and MongoDB.- Experience with cloud platforms such as AWS, GCP, or Azure.- Hands-on ...

Coimbatore, भारत

  • Hybrid
  • Contract
... decisions.- Troubleshoot complex data engineering, CDC, streaming, performance, and production issues.- Mentor engineers and provide technical direction across data engineering initiatives.Must-Have Skills:- Strong hands-on experience with Databricks and Lakehouse architecture.- Advanced Python and SQL skills.- Strong expertise ...

Bangalore, भारत