Senior Data Engineer in Bangalore, भारत

Illumina seeks a Senior Data Engineer to own and operate a Databricks Lakehouse platform at enterprise scale in Bengaluru. The role focuses on platform reliability, security, automation, and cost efficiency while mentoring the India engineering team on modern data infrastructure practices.

Responsibilities

• Own workspace and account-level architecture including Unity Catalog, compute policies, identity management, and environment promotion
• Design and build infrastructure automation, CI/CD capabilities, and observability standards for the platform
• Manage platform reliability, availability, incident response, and define SLOs for shared services
• Implement FinOps practices including cost monitoring, optimization, and chargeback for consuming teams
• Build reference implementations and paved-road patterns to enable self-service for analytics and AI/ML teams

Requirements

• 3–5 years data platform or data engineering experience, including 2+ years administering Databricks in production
• Infrastructure-as-code design and implementation (Terraform or equivalent) with CI/CD pipeline experience
• Strong Python, PySpark proficiency and advanced SQL skills
• Platform operations experience: monitoring, incident management, capacity planning, performance tuning
• Databricks cost management and FinOps practices knowledge
• Platform security expertise: identity management, service principals, audit logging, RBAC, PII handling
• AWS fundamentals: S3, IAM, VPC, KMS, and Databricks integration