Back to list

Vacancy description

GCP Data Engineer - Python in Chennai, भारत

xTag Services

Chennai, भारत

GCP Data Engineer - Python / PySparkExperience : 5.5 - 9 YearsOpenings : 8Role Overview : We are looking for experienced Data Engineers with strong expertise in Python or PySpark, SQL, GCP cloud services, data processing, data warehousing, and data pipelines. The ideal candidate should have hands-on experience with BigQuery, Dataflow or Dataproc, Pub/Sub, Apache Kafka, Airflow/Cloud Composer, and https://jobeax.com/link/u7IOHpkfssJtR5tu Responsibilities : - Design, develop, and maintain scalable data pipelines.- Develop data processing solutions using Python and/or PySpark.- Develop complex SQL queries and optimize data processing workloads.- Work with GCP data services including BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Functions.- Build and maintain data ingestion and transformation pipelines.- Develop and manage workflows using Airflow, Astronomer, or Cloud Composer.- Work with Apache Kafka for real-time data processing and streaming.- Implement infrastructure automation using Terraform.- Monitor data pipelines and troubleshoot production issues.- Develop monitoring dashboards and ensure pipeline reliability.- Collaborate with Data Scientists, Software Engineers, business stakeholders, and other technical https://jobeax.com/link/b98mNqN2dpm2gqBN Technical Skills : - SQL - minimum 4 years- Python or PySpark - minimum 4 years- GCP - minimum 3 years- BigQuery- Dataflow or Dataproc- Pub/Sub- Scheduled Queries- Cloud Functions- Monitoring Tools / Dashboards- Apache Kafka- Terraform scripting - minimum 2 years- Airflow / Astronomer / Cloud Composer - minimum 2 yearsGood to Have : - Data Fusion, Tekton Pipeline, CI/CD Pipeline, GCP Secret Manager- Data/ML solutions and advanced analytics exposure- Prompt Engineering, Generative AI, LLM, Agentic AI, LangGraph, CrewAI, OpenAI SDK, Google ADKSoft Skills : - Strong written and verbal communication skills- Strong presentation and stakeholder management skills- Excellent analytical and problem-solving abilities- Strong collaboration and interpersonal skills (ref:hirist.tech)

Similar vacancies

More like this role

  • IT
  • Cloud
... , Hyderabad , Chennai - Min 8-12 years of hands-on experience in GCP Data Engineering designing, building and supporting distributed systems and large-scale data processing systems in production with a proven track record. - Expertise in GCP Data Products e.g. BigQuery, Dataflow, Cloud Storage, Pub/Sub, and Cloud Composer, ...

Chennai, भारत

Cephas Consultancy Services Private Limited

Senior Data Engineer (Engineer 3) - GCP

  • Full-time
  • Contract
... Required Qualifications - Experience: 7+ years of professional data engineering experience. - Google Cloud Platform (GCP): Hands-on experience with BigQuery, Dataflow, Dataproc, Data Fusion, and Cloud SQL. - Infrastructure and orchestration: Proficiency with Terraform, Tekton, and Apache Airflow. - Data processing and streaming: ...

Chennai, भारत

Vsquare Systems Pvt. Ltd.

Vsquare Systems - GCP Data Engineer

... Platform (GCP) while ensuring data quality, performance, and scalable https://jobeax.com/link/60A4LTP1RtnIcSFF Responsibilities : - Design, develop, and maintain data pipelines on Google Cloud Platform (GCP).- Migrate ETL pipelines from Teradata Enterprise Data Warehouse (EDW) to GCP.- Develop and optimize complex SQL queries ...

Pune, भारत

  • Full-time

$14.68 USD

... flattening . Strong hands on experience with Terraform for GCP infrastructure provisioning, including modules and state management. . Working knowledge of Python for data engineering tasks . Experience with data validation, historical data migration, reconciliation, and performance optimization. . Working knowledge of GCP IAM, ...

Bangalore, भारत

... work. Job Summary As a key member of the Data Team at Equinix, we are seeking a skilled GCP Data Engineer who will be responsible for end-to-end development of Data Engineering use cases, Equinix Data Lake platform and tools. You will design, build, and maintain scalable data infrastructure and analytics solutions on Google ...

Bangalore, भारत

Crescendo Global Leadership Hiring India Pvt Ltd

GCP Engineer - BigQuery/Data Build Tool

  • Hybrid
Consultant - GCP Engineer | 4 - 6 Years | BangaloreHiring a hands-on GCP Engineer with strong experience in Google Cloud Platform (GCP), BigQuery, and dbt. This is an excellent opportunity for professionals who enjoy building scalable cloud-based data solutions, developing data transformation workflows, optimizing data ...

Bangalore, भारत

  • Hybrid
  • Contract
... decisions.- Troubleshoot complex data engineering, CDC, streaming, performance, and production issues.- Mentor engineers and provide technical direction across data engineering initiatives.Must-Have Skills:- Strong hands-on experience with Databricks and Lakehouse architecture.- Advanced Python and SQL skills.- Strong expertise ...

Bangalore, भारत

Role : Data Engineer Location : ChennaiExperience : 5+ yearsInterview : FridayMust-Have Skills : - Python- PySpark- AWS- SQL- Azure Data Factory (ADF)- dbtKey Responsibilities : - Develop and maintain data pipelines and ETL/ELT processes.- Build data solutions using Python and PySpark.- Work with AWS cloud services for ...

Chennai, भारत

  • Remote

Rs 20 - 25 lakhs p.a.

Senior GCP Data Engineer – (BigQuery & Tableau Security) Experience: 5–8 Years Work Mode: Remote Job Description We are looking for a Senior GCP Data Engineer with strong experience in BigQuery and Tableau security. The candidate will be responsible for implementing data governance, privacy, access controls, masking, monitoring, ...

India, भारत

  • Data Analytics
... and data engineering.- Strong hands-on experience with SQL and Python.- Experience with ETL/ELT pipelines and data integration.- Knowledge of data modeling and data warehousing.- Experience with Power BI or Tableau for reporting and visualization.- Familiarity with cloud data platforms such as Azure, AWS, or GCP.- Strong ...

Bangalore, भारत