Data Engineer in Pune, भारत

Job Title : Data EngineerExperience : 4 - 6 YearsLocation : PuneJob Type : Full-TimeShift Timing : 2:00 PM - 11:00 PMJob Overview :We are looking for an experienced Data Engineer to design, develop, and maintain scalable data pipelines and data integration workflows that support analytics, operational reporting, and AI/ML applications. The ideal candidate should have strong expertise in Python, SQL, cloud-based data engineering, and distributed data processing https://jobeax.com/link/LNO4qyefA3UlJa2l Responsibilities :- Design, build, and maintain scalable batch and streaming data pipelines for structured and unstructured data.- Develop data ingestion, transformation, and integration workflows using Python, SQL, and modern data engineering frameworks.- Build and maintain streaming pipelines using Kafka or equivalent messaging platforms.- Work with cloud data services, preferably GCP, including BigQuery, Cloud Storage, Dataflow, Pub/Sub, and Cloud Spanner.- Develop and maintain REST and GraphQL APIs for data access and integration across microservices.- Integrate data pipelines with AI/ML models and collaborate with Data Scientists and MLOps teams.- Build data processing workflows for NLP applications and healthcare datasets, including claims and clinical documents.- Implement data quality checks, pipeline monitoring, logging, and observability frameworks.- Automate data pipeline deployment using CI/CD tools such as GitHub Actions, Jenkins, or Argo CD.- Optimize pipeline performance, data reliability, scalability, and processing https://jobeax.com/link/hGtX6zTSf2DC9SxB Qualifications :- 4 - 6 years of experience in data engineering, data pipelines, or backend data workflows.- Strong proficiency in Python and SQL.- Experience with relational databases such as PostgreSQL.- Hands-on experience building batch and streaming data pipelines.- Experience with Kafka or similar streaming technologies.- Experience with REST APIs and GraphQL for data integration and service development.- Experience with cloud platforms, preferably Google Cloud Platform (GCP).- Familiarity with BigQuery, Cloud Storage, Dataflow, Pub/Sub, or equivalent cloud data services.- Experience with CI/CD practices and version control tools.- Understanding of distributed systems, data modeling, data quality, and pipeline https://jobeax.com/link/uNCZPEV1Q14b1QhD Qualifications :- Experience processing healthcare data, claims data, or clinical documents.- Exposure to AI/ML data pipelines and NLP workflows.- Familiarity with GCP Composer, Cloud Spanner, or Cloud Functions.- Knowledge of Docker, Kubernetes, and Infrastructure as Code.- Experience with large-scale data processing and cloud cost https://jobeax.com/link/jegq7nQMX2ZbHVpV :- Bachelors degree in Computer Science, Data Engineering, Information Systems, or a related field, or equivalent practical experience. (ref:hirist.tech)