Back to list

Vacancy description

GCP Data Engineer - Python in Chennai, भारत

xTag Services

Chennai, भारत

GCP Data Engineer - Python / PySparkExperience : 5.5 - 9 YearsOpenings : 8Role Overview : We are looking for experienced Data Engineers with strong expertise in Python or PySpark, SQL, GCP cloud services, data processing, data warehousing, and data pipelines. The ideal candidate should have hands-on experience with BigQuery, Dataflow or Dataproc, Pub/Sub, Apache Kafka, Airflow/Cloud Composer, and https://jobeax.com/link/u7IOHpkfssJtR5tu Responsibilities : - Design, develop, and maintain scalable data pipelines.- Develop data processing solutions using Python and/or PySpark.- Develop complex SQL queries and optimize data processing workloads.- Work with GCP data services including BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Functions.- Build and maintain data ingestion and transformation pipelines.- Develop and manage workflows using Airflow, Astronomer, or Cloud Composer.- Work with Apache Kafka for real-time data processing and streaming.- Implement infrastructure automation using Terraform.- Monitor data pipelines and troubleshoot production issues.- Develop monitoring dashboards and ensure pipeline reliability.- Collaborate with Data Scientists, Software Engineers, business stakeholders, and other technical https://jobeax.com/link/b98mNqN2dpm2gqBN Technical Skills : - SQL - minimum 4 years- Python or PySpark - minimum 4 years- GCP - minimum 3 years- BigQuery- Dataflow or Dataproc- Pub/Sub- Scheduled Queries- Cloud Functions- Monitoring Tools / Dashboards- Apache Kafka- Terraform scripting - minimum 2 years- Airflow / Astronomer / Cloud Composer - minimum 2 yearsGood to Have : - Data Fusion, Tekton Pipeline, CI/CD Pipeline, GCP Secret Manager- Data/ML solutions and advanced analytics exposure- Prompt Engineering, Generative AI, LLM, Agentic AI, LangGraph, CrewAI, OpenAI SDK, Google ADKSoft Skills : - Strong written and verbal communication skills- Strong presentation and stakeholder management skills- Excellent analytical and problem-solving abilities- Strong collaboration and interpersonal skills (ref:hirist.tech)

Similar vacancies

More like this role

  • Hybrid
  • Full-time
Position: Data Engineer – GCP Required Skills: Python, PySpark, SQL, Airflow, GCP, Bigdata Years of experience: 5+ Years Locations: Gurgaon We are seeking skilled Data Engineers with experience in modern data engineering practices and data modeling. You will leverage your knowledge and experience in programming languages ...

Indhur, भारत

  • IT
  • Cloud
... , Hyderabad , Chennai - Min 8-12 years of hands-on experience in GCP Data Engineering designing, building and supporting distributed systems and large-scale data processing systems in production with a proven track record. - Expertise in GCP Data Products e.g. BigQuery, Dataflow, Cloud Storage, Pub/Sub, and Cloud Composer, ...

Chennai, भारत

Cephas Consultancy Services Private Limited

Senior Data Engineer (Engineer 3) - GCP

  • Full-time
  • Contract
... Required Qualifications - Experience: 7+ years of professional data engineering experience. - Google Cloud Platform (GCP): Hands-on experience with BigQuery, Dataflow, Dataproc, Data Fusion, and Cloud SQL. - Infrastructure and orchestration: Proficiency with Terraform, Tekton, and Apache Airflow. - Data processing and streaming: ...

Chennai, भारत

Vsquare Systems Pvt. Ltd.

Vsquare Systems - GCP Data Engineer

... Platform (GCP) while ensuring data quality, performance, and scalable https://jobeax.com/link/60A4LTP1RtnIcSFF Responsibilities : - Design, develop, and maintain data pipelines on Google Cloud Platform (GCP).- Migrate ETL pipelines from Teradata Enterprise Data Warehouse (EDW) to GCP.- Develop and optimize complex SQL queries ...

Pune, भारत

  • Full-time

$14.68 USD

... flattening . Strong hands on experience with Terraform for GCP infrastructure provisioning, including modules and state management. . Working knowledge of Python for data engineering tasks . Experience with data validation, historical data migration, reconciliation, and performance optimization. . Working knowledge of GCP IAM, ...

Bangalore, भारत

... work. Job Summary As a key member of the Data Team at Equinix, we are seeking a skilled GCP Data Engineer who will be responsible for end-to-end development of Data Engineering use cases, Equinix Data Lake platform and tools. You will design, build, and maintain scalable data infrastructure and analytics solutions on Google ...

Bangalore, भारत

  • Contract
About the Role : We are hiring experienced Data Engineers for an exciting https://jobeax.com/link/7CRLQjGein4Ib5fK Skills : - Strong expertise in Advanced SQL, Python, and PySpark- Hands-on experience with Snowflake, Apache Spark, AWS Glue, and Airflow- AWS services : Lambda, Glue, S3, and related data engineering services- ...

Bangalore, भारत

Crescendo Global Leadership Hiring India Pvt Ltd

GCP Engineer - BigQuery/Data Build Tool

  • Hybrid
Consultant - GCP Engineer | 4 - 6 Years | BangaloreHiring a hands-on GCP Engineer with strong experience in Google Cloud Platform (GCP), BigQuery, and dbt. This is an excellent opportunity for professionals who enjoy building scalable cloud-based data solutions, developing data transformation workflows, optimizing data ...

Bangalore, भारत

  • Remote

Rs 20 - 25 lakhs p.a.

Senior GCP Data Engineer – (BigQuery & Tableau Security) Experience: 5–8 Years Work Mode: Remote Job Description We are looking for a Senior GCP Data Engineer with strong experience in BigQuery and Tableau security. The candidate will be responsible for implementing data governance, privacy, access controls, masking, monitoring, ...

India, भारत

SPOORTHI HIRES CONSULTING SERVICES PRIVATE LIMITED

Senior Data Engineer - SQL/Python

  • Full-time
... experienced Data Engineers with opportunities across 2 Global Capability Centres (GCCs) and 3 Indian product https://jobeax.com/link/q0hxsD8hhwuimQsL are looking for Data Engineers with strong expertise in Python, SQL, PySpark, Apache Spark, ETL/ELT pipelines and cloud data engineering. Candidates should have hands - on experience ...

Hyderabad, भारत