NucleusTeq
Data Engineer-GCP
- Hybrid
- Full-time
Indhur, भारत
Vacancy description
xTag Services
Chennai, भारत
GCP Data Engineer - Python / PySparkExperience : 5.5 - 9 YearsOpenings : 8Role Overview : We are looking for experienced Data Engineers with strong expertise in Python or PySpark, SQL, GCP cloud services, data processing, data warehousing, and data pipelines. The ideal candidate should have hands-on experience with BigQuery, Dataflow or Dataproc, Pub/Sub, Apache Kafka, Airflow/Cloud Composer, and https://jobeax.com/link/u7IOHpkfssJtR5tu Responsibilities : - Design, develop, and maintain scalable data pipelines.- Develop data processing solutions using Python and/or PySpark.- Develop complex SQL queries and optimize data processing workloads.- Work with GCP data services including BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Functions.- Build and maintain data ingestion and transformation pipelines.- Develop and manage workflows using Airflow, Astronomer, or Cloud Composer.- Work with Apache Kafka for real-time data processing and streaming.- Implement infrastructure automation using Terraform.- Monitor data pipelines and troubleshoot production issues.- Develop monitoring dashboards and ensure pipeline reliability.- Collaborate with Data Scientists, Software Engineers, business stakeholders, and other technical https://jobeax.com/link/b98mNqN2dpm2gqBN Technical Skills : - SQL - minimum 4 years- Python or PySpark - minimum 4 years- GCP - minimum 3 years- BigQuery- Dataflow or Dataproc- Pub/Sub- Scheduled Queries- Cloud Functions- Monitoring Tools / Dashboards- Apache Kafka- Terraform scripting - minimum 2 years- Airflow / Astronomer / Cloud Composer - minimum 2 yearsGood to Have : - Data Fusion, Tekton Pipeline, CI/CD Pipeline, GCP Secret Manager- Data/ML solutions and advanced analytics exposure- Prompt Engineering, Generative AI, LLM, Agentic AI, LangGraph, CrewAI, OpenAI SDK, Google ADKSoft Skills : - Strong written and verbal communication skills- Strong presentation and stakeholder management skills- Excellent analytical and problem-solving abilities- Strong collaboration and interpersonal skills (ref:hirist.tech)
Similar vacancies
NucleusTeq
Indhur, भारत
Cephas Consultancy Services Private Limited
Chennai, भारत
Vsquare Systems Pvt. Ltd.
Pune, भारत
$14.68 USD
Bangalore, भारत
Harmony Data Integration Technologies Pvt. Ltd.
Delhi, भारत
KOMANDLA ANUSHA
Bangalore, भारत
Scaling Theory Technologies Pvt Ltd
Bangalore, भारत
SPOORTHI HIRES CONSULTING SERVICES PRIVATE LIMITED
Hyderabad, भारत
Coimbatore, भारत
Kooe Private Limited
Rs 20 - 25 lakhs p.a.
India, भारत