Sr. Specialist, Data Engineering in Hyderabad, भारत

Senior Data Engineering specialist at a global biopharma company in Hyderabad. Design and maintain scalable data pipelines supporting drug development, working with data scientists and business teams in a matrix environment to deliver production-grade solutions.

Responsibilities

• Design, develop, and maintain data pipelines extracting from diverse sources into data lake and warehouse
• Partner with data scientists, analysts, and business teams to translate requirements into scalable solutions
• Build and maintain platforms for data ingestion, transformation, and orchestration across internal and external sources
• Implement monitoring, logging, and automation to ensure pipeline reliability, performance, and governance
• Troubleshoot operational issues and maintain comprehensive documentation for pipeline configurations and code

Requirements

• Bachelor's degree in Information Technology, Computer Science, or Technology stream
• 7–11 years building data pipelines and infrastructure, preferably in life sciences or drug development
• Advanced SQL and Python proficiency including PySpark
• Hands-on experience with AWS (S3, IAM, core console concepts) and Apache Spark
• Demonstrated expertise with Databricks, Delta Lake, and cloud data warehouses (Redshift, Snowflake, Synapse)
• Implementation experience with monitoring, logging, and data quality checks in production pipelines
• Familiarity with CI/CD tooling (Git, GitHub Actions, Jenkins, Azure DevOps) and data modeling patterns