GPUs are scarce.Margin is scarcer
Token prices fall every quarter. GPU capacity doesn't. And the tenant burning your H100 pool looks identical to the one paying for it. Price every tenant on what they actually cost — tokens, GPU-seconds, and bursts — without rewriting your billing stack.
Four things every inference platform needs to ship.
See cost per tenant. Re-cost pool moves without a price change. Gate quotas on the hot path. Compose tokens and GPU-hours into one plan. One ledger, wired in once.
Cost, by tenant. Live.
Every prefill, every decode, every GPU-second pinned to the tenant who triggered it. The noisy neighbor and the underwater account stop hiding inside an aggregate cloud bill.
- GPU + token + storage costs joined to tenant_id. One ledger, not three spreadsheets.
- Alerts the second a tenant flips negative. By pool, by region, by SKU.
- Re-rate any month against any future plan. "What if H100 traffic moved to L40S?"
- Loam AICluster · H100$48,200+364%
- Spire RoboticsPool · A100$12,400+152%
- Aperture LabsPool · L40S$3,800−938%
- Drift SynthBurst · shared$640−35-22%
- Forge VisionCluster · H100$26,500+259%
- Pico GenomicsPool · A100$2,100−51-38%
- Freetier · 01vllm-shared→l40s-batched+18%margin
- Teamtier · 02a100-shared→h100-shared+9%throughput
- Clustertier · 03h100-private→h100-private—no change
- Enterprisetier · 04h100-reserved→h100-reserved🔒contract
Move traffic between pools rewriting your pricing.without
An H100 pool fills. A new region opens. Batched throughput drops the unit cost by 40%. Update the pool's rate in your Cost Sheet and every new event is re-costed — the price your tenants see doesn't move.
- Per-pool cost rates. Different tenants, different pools, same ledger.
- Plans are versioned and reversible. Roll back v17 of your pool map without a migration.
- Forecast margin before you commit. Margin trend and forecast per tenant.
Enforce quotas at the gate. Not the dashboard.
A free tenant ships a viral demo. An enterprise wants a paid burst before close. A scraper hammers your embedding pool at 3am. Set quotas per tenant, per pool, per SKU — enforced on the hot path, billed when they overflow, lifted with a flag instead of a deploy.
- Quota checks on the hot path. Atomic check-and-deduct on every request.
- Block, or bill the burst. A burst is a line item, not an outage.
- Per-tenant override on the fly. Lift a cap for one customer. No deploy, no PR.
- Loam AICluster · H100 · reserved240 GPU-min/hr182 GPU-min/hrwithin
- Spire RoboticsPool · A100 · shared8,000 tok/s6,420 tok/swithin
- Aperture LabsPool · L40S · shared1,200 tok/s1,200 tok/sblocked└─ free tier · hard limit hit
- Drift SynthBurst · shared0 GPU-min/hr+12 GPU-min/hrburst└─ burst until 14:32 · auto-bill at $0.04/min
- Forge VisionCluster · H100 · reserved180 GPU-min/hr92 GPU-min/hrwithin
- meter[in]$0.0008/ 1k tok · free_tier: 1,000,000
- meter[out]$0.0024/ 1k tok
- meter[h100]$2.40/ GPU-hour · per-second
- burst[h100]$0.04/ GPU-min · over-quota
- discount25%reserved_capacity
Mix tokens and GPU-hours in one plan.
Inference bills three units at once: tokens, GPU-seconds, and reservations. Describe the plan in English; ship it versioned, without a deploy. Hybrid pricing stops being the quarter you don't ship features.
- Compose any inference shape. Token, GPU-min, request, reservation — combine per plan.
- Versioned at the tenant level. Grandfathering is a flag, not a migration.
- A/B prices, then keep what wins. Promote the version that lands the margin you want.
Stop guessing.
Start knowing.
Wire Nozle into your stack and see your first margin report in 60 minutes.
- Setup
- 60 min
- Card required
- no
- Sales call
- no
- First invoice
- in 60 min