Step 1 of 8 - Virtualization
You're running an estate, not a cluster
Every cluster below was sized for its own peak, so every one of them idles.
Deployment model
546 nodes running 655 vCPU of actual work.
The arithmetic, in full
| Step | Working | Result |
|---|---|---|
| Provisioned today | 50 clusters totalling 546 nodes (drawn around 11, 9 to 13) x 8 vCPU | 4368 vCPU |
| Mean demand | 4368 vCPU x 15.0% estate average utilization (per-cluster 0.5% to 28.3%, sd 5.3%) | 655 vCPU |
| Aggregate peak | 655.2 vCPU x (1 + (2.23 - 1) / sqrt(50)), a pooled peak-to-mean of 1.174 | 769 vCPU |
| Consolidated, sized once for the peak | max(3, ceil(769.0 vCPU / (8 vCPU x 37.5% target))) = max(3, ceil(256.33)); the mean sits well under that peak | 257 nodes, averaging 31.9% |
| Auto-scaled through the day | the pool follows the pooled curve in whole nodes, 30 minutes behind it, holding its size for 2 hours before shrinking | 224 nodes on average, at 36.6% CPU |
| Utilization across the day | 32.1% to 38.9% against a 37.5% setpoint: the pool runs hot while it's a bucket behind a rise, and cool while the cooldown is still holding capacity after a peak | 32.1%-38.9% |
Assumptions
- 8 vCPU per node. Standalone clusters are drawn around 11 nodes, snapped to an odd number for quorum and held between 3 and 15; in this estate they run 9 to 13, a 1.3-node standard deviation, for 546 nodes in total.
- Each standalone cluster's CPU is a draw from a normal distribution centred on 15.0% and held between 0% and 100%; in this estate they run 0.5% to 28.3%, a 5.3-point standard deviation. The published band is 10-15% today against a 30-45% auto-scaled target, and this Private Host Cluster is set to 37.5%.
- The Private Host Cluster floors at 3 nodes and must reach 257 at peak.
- The auto-scaler sizes for what it saw 30 minutes ago and waits 2 hours before shrinking, so the pool averages 36.6% rather than sitting on its 37.5% setpoint.
- Workloads are independent; consolidation moves where work runs, not how much there is.
What a virtual cluster gives an app team
Its own connection string, databases, schemas, users, roles and backups, and no visibility into the Private Host Cluster or any other virtual cluster.