Back to list

Vacancy description

CloudKeeper - Associate Director - Data Engineering in Noida, भारत

CloudKeeper

Noida, भारत

Role : Associate Director, Data EngineeringLocation : Noida, IndiaWork Mode : 5 days WFOAbout CloudKeeper : CloudKeeper is a cloud cost optimization partner that combines the power of group buying and commitments management, expert cloud consulting and support, and an enhanced visibility and analytics platform to reduce cloud cost and help businesses maximize the value from AWS, Microsoft Azure, and Google Cloud.A certified AWS Premier Partner, Azure Technology Consulting Partner, Google Cloud Partner, and FinOps Foundation Premier Member, CloudKeeper has helped 350+ global companies save an average of 20% on their cloud bills, modernize their cloud set-up and maximize https://jobeax.com/link/6bc7UKG2A9zL4qDk Platform Suite is a leading enterprise FinOps platform that helps organizations optimize and govern their multi-cloud spend across AWS, Azure, and Google Cloud. Our platform processes billions of dollars in cloud spend, delivering actionable cost optimization recommendations, automated governance, and financial accountability to enterprises https://jobeax.com/link/umr34EiTGWJng2IM know more - : // Opportunity : CloudKeeper's products are federated, but they stand on one shared foundation : cost and usage data. Every CK-Lens dashboard, every CK-Commit purchase decision, every CK-Tuner recommendation, and every FinOps for AI insight is only as good as the billing data underneath it. Today that data flows through pipelines that grew up inside individual products, spanning the Stormus backend, Jenkins-driven data jobs, and Airflow https://jobeax.com/link/TcMZ6zcYpyhtTyuQ are hiring an Associate Director, Data Engineering to own this layer as a product in its own right. You will define the target architecture for a multi-cloud billing data platform, consolidate ingestion across AWS, Azure, and Google Cloud, set the warehouse and lakehouse strategy, and build the team that runs it. The bar is unforgiving : customers make financial decisions on these numbers, so every figure has to reconcile to the https://jobeax.com/link/GOGpbC04gVLL0Nof You'll Own : Multi-Cloud Billing Data Platform : - A single ingestion layer for AWS Cost and Usage Reports and Data Exports, Azure Cost Management exports and Billing APIs, and GCP BigQuery billing exports, on daily and intra-day schedules- Normalization of provider-specific line items into a common cost model, aligned to the FinOps Foundation's FOCUS specification- Correct handling of restatements, late-arriving usage, credits, discounts, marketplace charges, and consolidated billing across payer accounts, so reported cost always matches what the customer is invoicedWarehouse and Lakehouse Architecture : - The analytics engine behind 100+ CK-Lens dashboards, anomaly detection, custom reports, and LensGPT natural-language queries, which runs on Snowflake today- The target architecture for the next three years : where a warehouse ends and a lakehouse begins, which workloads belong in each, and how the platform scales with customer count without scaling spend at the same rate- Warehouse and lake cost governance. CloudKeeper sells data-platform cost optimization, and the platform should be the proofData Foundation for New Products : - Ingestion for FinOps for AI : GPU instance usage, managed AI services such as Bedrock, Azure OpenAI, and Vertex AI, and LLM API consumption from providers such as OpenAI and Anthropic- Kubernetes cost telemetry from Prometheus and OpenCost feeding CK-Tuner Kubernetes- Cost allocation and virtual-tagging datasets that power unit economics reporting- A governed semantic layer and data contracts so that LensGPT and the LensGPT MCP server can answer questions about cost data reliablyResponsibilities : Data Engineering Leadership : - Build and lead the data engineering pod : hire and mentor Data Engineers and Senior Engineers in data engineering, set coding, testing, and review standards, and grow the team as the product lines scale- Own delivery against a data-platform roadmap agreed with Product Management, with explicit data contracts for each product and published service levels for data freshness and accuracy- Run the platform like a product : define and report its metrics, including data freshness, reconciliation accuracy against source billing, pipeline reliability, and warehouse cost per customer, and review them monthly- Represent data engineering in architecture, security, and customer conversations, including due-diligence and security questionnaires from enterprise customersTechnical Strategy : - Define the target data architecture across batch and streaming, warehouse and lake, and three cloud providers, and sequence the migration from today's product-embedded pipelines without disrupting delivery- Design the reconciliation and data-quality framework : every pipeline proves its output against the source invoice, and every restatement is traceable- Establish data governance that satisfies CloudKeeper's SOC 2 Type 2 controls and UK GDPR obligations : access control, retention, lineage, and customer data isolation- Build the integration points with CK-Lens for visibility, CK-Commit and CK-Tuner for optimization, and the FinOps for AI and Kubernetes products for new data domains- Lead the team's adoption of AI-assisted development. CloudKeeper builds AI-first and expects measurable output gains from AI in the software development lifecycleTechnical Landscape You'll Navigate : Cloud Billing and Usage Sources : - AWS : Cost and Usage Reports, Data Exports, Organizations consolidated billing, S3, CloudWatch- Azure : Cost Management exports, Billing and Consumption APIs, Azure Monitor- GCP : BigQuery billing export, Cloud Billing APIs- Standards : FinOps Foundation FOCUS specificationWarehouse and Lakehouse : - Warehouse : Snowflake (current analytics platform); BigQuery, Redshift, or Synapse experience relevant- Lake and table formats : S3, ADLS, or GCS object storage with Apache Iceberg, Delta Lake, or Hudi; Parquet- Modeling and transformation : dimensional and semantic-layer modeling; dbt or equivalent transformation frameworksProcessing and Orchestration : - Compute : Apache Spark (SQL, DataFrames, Structured Streaming); Hadoop ecosystem familiarity- Orchestration : Apache Airflow; Jenkins-driven jobs in the current estate- Messaging : Apache Kafka, RabbitMQ, AWS SQS- Languages : Python plus Java or ScalaOperational Stack : - Application data : MySQL, MongoDB, behind Java and Spring Boot services- Observability : Prometheus, Grafana, OpenTelemetry, OpenCost- Platform : Kubernetes, multi-tenant SaaS on AWS with Azure and GCP footprintsRole Requirements : Experience : - 10+ years in data engineering with 3+ years leading data engineering teams of 4 - 10 people building and shipping SaaS or data products. Leadership experience in services, consulting, or systems integration (SI) teams does not apply- Hands-on production experience with the data ecosystems of at least two of AWS, Azure, and Google Cloud- Has built and operated both a cloud data warehouse (Snowflake, BigQuery, Redshift, or Synapse) and a data lake or lakehouse (Iceberg, Delta Lake, or Hudi on object storage) at multi-terabyte scale, and can explain when to use which- Track record of pipelines whose output reconciles to a financial source of truth, such as billing, payments, or ledgers, strongly preferred- Experience with cloud billing data (Cost and Usage Reports, Azure cost exports, BigQuery billing export) or FinOps practice is a significant advantageTechnical Depth : - Expert-level Spark and SQL; strong Python, with Java or Scala- Warehouse performance and cost engineering : clustering, partitioning, materialization strategy, query cost governance- Streaming with Kafka and batch orchestration with Airflow in production- Data modeling for analytics : dimensional models, semantic layers, and data contracts consumed by multiple products- Data quality, lineage, metadata, and governance tooling, and the judgment to apply them without slowing delivery- Working understanding of SOC 2 and GDPR obligations as they apply to a data platformLeadership : - Ability to operate in a 'founding team' mode : small team, high ownership, rapid shipping- Experience hiring and building data engineering teams from scratch- Comfortable wearing multiple hats : architecture, coding, hiring, product input- Strong communicator who can influence product, platform, security, and customer-facing teams, and can explain a reconciliation gap to a CFO as clearly as to an engineer- Sets the expectation for AI-assisted development by using it personallyWhy CloudKeeper : - Market Opportunity : Cloud spend optimization is a $10B+ market growing rapidly as enterprises accelerate cloud adoption- Data at the Core : The platform processes billions of dollars in cloud spend. Data engineering is the foundation every product stands on, not a support function- Platform Ownership : Define and build the shared data platform for a federated product portfolio within a revenue-generating company : startup speed with enterprise stability- New Domains : FinOps for AI, Kubernetes cost, and data-platform cost optimization are new data problems being solved for the first time, and this role owns their data foundation- Impact : The north-star metric for the whole product line is savings delivered per customer per month. Every improvement in data accuracy, freshness, and coverage moves it directly- Growth : Build the team and the platform from their current state to scale, with the metrics and ownership that come with running it as a productCloudKeeper is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. (ref:hirist.tech)

Similar vacancies

More like this role

... priorities - Define the target-state data architecture, reporting ecosystem, and analytics roadmap What you need - Power BI - Dashboarding - SQL - Business analysis - Data analysis - Data modelling Good to have - Data warehousing - ETL - Azure - Performance management - LLMs - Azure Data Factory Job details - Location: Bengaluru ...

Bangalore, भारत

... with business priorities, enterprise architecture, and long-term technology roadmaps - Lead development of enterprise data and analytics capabilities, including data engineering, business intelligence, machine learning, and generative AI What you need - Data analysis - SQL - Power BI - ETL - Data warehousing - Snowflake Good ...

Bangalore, भारत

Zimmer Biomet seeks an Associate Director of Data, Analytics & AI to lead strategic and technical initiatives across data platforms, analytics, and AI/ML capabilities. The role involves directing multidisciplinary teams, establishing enterprise data architecture and governance, and delivering measurable business impact ...

Bangalore, भारत

Associate Director leading medical data review teams and portfolio delivery within clinical development at Amgen's Hyderabad site. The role manages people, capacity allocation, quality oversight, and stakeholder engagement across therapeutic area-aligned study portfolios while ensuring high-quality, risk-based execution. ...

Hyderabad, भारत

  • Full-time
  • Contract
  • Product Management
... observability, automation, and cloud management, we are seeking a Product Manager who can drive the vision, roadmap, and execution for one or more products within the CloudKeeper Platform Suite such as Lens, Tuner, Commit, Gen AI and https://jobeax.com/link/j0ltIrHQ6hdF1XAJ will work cross-functionally across engineering, data science, ...

Noida, भारत

  • Hybrid
  • Full-time

Rs 63833 per month

Leadership data science role at Novartis in Hyderabad. Needs a https://jobeax.com/link/2DENLGgQM7whDhaE, B.E. or B.Sc. Hybrid; pays ₹63,800 a month. What you'll do - Lead the architecture and design of cloud data platform capabilities supporting Drug Development use cases - Define technology strategy, architecture standards ...

Hyderabad, भारत

  • Hybrid
  • On-site
  • Full-time
... provide hands-on operational leadership for one or more therapeutic areas across Takeda U.S. Business Unit (USBU) and Oncology Business Unit (OBU) markets. The Associate Director will report to the Director of Data Execution & Operations and will be responsible for day-to-day execution operational performance issue resolution ...

Bangalore, भारत

  • Hybrid
  • Contract
Summary Location: Hyderabad, India #LI-Hybrid Internal job title: Associate Director, PO&CF Data Enablement About the Role: The Associate Director, PO&CF Data Enablement will lead the strategy, governance, adoption, and value realization of enterprise data enablement capabilities across People & Organization (P&O) and Corporate ...

Hyderabad, भारत

... implementation, performance assessment, documentation, and stakeholder engagement. - Bachelor’s or master’s degree in Statistics, Mathematics, Economics, Finance, Engineering, Computer Science, Data Science, or another quantitative discipline; advanced degree preferred. - Strong technical knowledge of statistical modeling and financial-services ...

Gurgaon, भारत

  • Full-time
... and the control model that makes it safe - Vulnerability identification, prioritization, and remediation What you need - SIEM - Incident response - IAM - DLP - Data visualisation - EDR Good to have - CISSP - CISM - IPR - Cloud security - Vulnerability assessment - ISO 27001 Job details - Location: Pune, Mumbai - Experience: ...

Bombay, भारत