The Definitive Guide toAI Data Centers
Ask the GuideAboutAccount

Chapter 0.2

In this chapter · 7 sections
Term help

How to Read This Guide: Decisions, Consequences & Reference Data

Each chapter names one engineering fork, the downstream cost of each branch, and the date-stamped numbers needed to choose. Read the chapter that matches the decision in front of you.

POWER-BOUNDGOODPUTDENSITY-RAMP

What you'll decide here

  1. Which entry path fits your job: lifecycle stage (siting), discipline (cooling) or workload archetype (an inference fleet). The three lead to different chapters first.
  2. How to read a decision-and-consequence block: name the fork, read the consequence column for your leaning branch, and check reversibility before a number drives it.
  3. Which reference artifact a chapter asks you to produce: design-basis sheet, scalable-unit (SU) budget, decision matrix or scorecard. These, not prose, are the durable output.
  4. How much weight a figure deserves: read its as-of date and caveat first, then check irreversible-fork numbers in the Numbers Register (Appendix D).
  5. Whether a forward-pointer is a bullet, a one-line signpost you can skip, or a real cross-reference to a canonical derivation you should open before deciding.
Sort decisions by the cost of reversal: compare building capacity now, reserving an upgrade path, and accepting a fixed envelope. Extra capacity must justify its cost.

Every chapter here is built around a fork: a point where a real project commits to one branch over another, the branches pull the rest of the facility in incompatible directions, and choosing wrong is expensive or irreversible. The chapter names the fork, lays out the consequence of each branch across the axes that matter (cost, power, reach, latency, reliability, serviceability, schedule), and hands you the date-stamped numbers you need to choose. Most engineering references are organized for the author's convenience: by topic, alphabetically, by the structure of the underlying standard. This one is organized around what you have to decide, and that changes how to read it.

What follows is the user's manual. It covers the decision-and-consequence pattern every chapter follows; the three orthogonal navigation paths (by lifecycle stage, by engineering discipline, by workload archetype) and how to pick yours; the reference artifacts the guide repeatedly asks you to produce (design-basis sheets, SU budgets, decision matrices, scorecards); and, because the field moves fast, how to read the numbers: their vintage, their confidence, and the habit of keeping a stale forecast away from an irreversible decision. It ends with the altitude rule that keeps the guide navigable: a roadmap forward-pointer is a bullet, never a chapter. Leave the chapter with a chosen branch, its acceptance evidence, an accountable owner and the input that would reopen it.

The decision-and-consequence pattern

The unit of this guide is the fork and its consequence. A fact tells you that cooling capacity depends on airflow, inlet conditions, heat capture, water availability, climate and equipment limits. A fork tells you that because the cited HPE GB200 profile removes ~115 kW in liquid and leaves ~17 kW to air, committing to that product commits you to its supported direct-to-chip and room-air architecture, a plumbed hall, a floor proven for the rack and its delivery route, and a heat-rejection strategy, and that this commitment is a one-way door. Every chapter is written to surface that second kind of statement: name the fork, then the downstream cost of choosing wrong. When you hit one, slow down; that is where the money and the regret concentrate.

The pattern appears in three forms on the page, and reading each quickly is most of what it takes to use the guide efficiently. Decision callouts (the boxed asides) isolate a single high-leverage fork and state the condition under which the evidence favors a branch. They are the chapter's load-bearing claims, so if you read nothing else in a chapter, read these. Decision tables put the branches in rows and the consequences in columns, so you can scan across the branch you are leaning toward and read its full bill of consequences at once. Cross-references (the inline chapter links) mark where a consequence is derived rather than asserted; when a fork hinges on a number you do not trust, follow the link to the chapter that builds it.

How to read each block type in this guide
BlockWhat it carriesHow to read itAction it implies
Thesis + threadsThe chapter's single claim and which of POWER-BOUND / GOODPUT / DENSITY-RAMP it advancesRead first, always; it frames everything belowDecide if this chapter bears on your current fork at all
Decide listThe 3–5 forks this chapter actually resolvesRead second; treat as the chapter's table of contentsMap each bullet to a decision you own
ProseThe derivation — why a fork leads to its consequenceRead closely where the fork is yours; skim elsewhereTrace the causal chain before trusting the conclusion
Decision calloutA single high-leverage fork and the favored branchNever skip; this is the load-bearing claimAdopt, or form an explicit reason to deviate
Decision tableBranches × consequence axesScan across your leaning branch; read its full rowLift directly into your decision matrix
KeynumbersDate-stamped headline figures — sometimes one pinned number, sometimes a dozenRead the as-of and caveat before the valueUse as level only if fresh; else use as direction
Details (deep-dive)Optional engineering depth behind a claimOpen only when the claim is load-bearing for youVerify the derivation; otherwise defer
Cross-reference (xref)Where the canonical derivation livesFollow when you distrust an asserted consequenceOpen the linked chapter before committing
Every chapter is assembled from these blocks. The right reading speed and the action each one implies differ: skim the wrong one and you miss the decision; over-read the wrong one and you drown in reference data.

Three ways in: stage, discipline, archetype

The guide can be entered from three orthogonal directions, and a common mistake is reading it from the wrong one for the question you have. The three indices do not contradict each other. They are three projections of the same material, but they put different chapters in front of you first, and starting from the wrong one wastes time and hides the fork you came to resolve.

By lifecycle stage is the spine and the default. The Parts run in the order a real project runs: strategy and delivery, then siting, power, electrical, cooling, the building, compute, networking, storage, software, security and reliability, commissioning, operations, sustainability, and the future. If you are at a stage, say you have a site and you are sizing the power chain, read the corresponding Part top to bottom; each chapter tees up the decision in the next. This is the right path for project teams executing in order.

By engineering discipline cuts across the spine. If you own cooling, the decisions you live with are scattered across Part 1 (the archetype that sets your density), Part 5 (the thermal engineering itself), Part 13 (commissioning the plant) and Part 14 (operating it). The cross-reference links are the connective tissue: follow them and you assemble a discipline-shaped reading list out of a stage-shaped book. This is the right path for specialists who go deep on one subsystem across every project.

By workload archetype is the path for strategists and anyone scoping a new facility. As Chapter 1.1 argues at length, the workload sets the requirements that density, cooling, fabric, redundancy and siting must meet; the label alone never selects a topology, the measured requirements it implies do. Start from your dominant archetype (pre-training, post-training/RL, online inference, batch inference, edge), read the cascade it implies, and let that cascade tell you which discipline chapters you are now forced to care about. This is the right path when the facility does not exist yet and the question is what to build.

Navigation path → who it is for, where to start, what it optimizes
PathBest forStart atReading orderWhat it optimizes
By lifecycle stageProject teams executing in sequenceThe Part matching your current stageLinear within the Part; follow the spineDecisions teed up in dependency order
By engineering disciplineSubsystem specialists (power, cooling, fabric)Your subsystem's home PartHop the cross-reference links across PartsDepth on one subsystem, every project
By workload archetypeStrategists scoping a new facilityChapter 1.1, then your archetype's chapterCascade outward to the disciplines it forcesGetting the workload decision right first
Three projections of the same material. Pick the one that matches the question you have today; switch projections as the project moves from scoping to execution to operation.

The reference artifacts: what using this guide produces

Using this guide produces a small set of artifacts that the chapters repeatedly ask you to fill in: durable documents that survive board scrutiny and lender diligence because they pin down a decision and its consequences in a form someone else can audit. Four recur throughout, and recognizing which one a chapter is asking for is half of using it well.

  • Design-basis sheet. The frozen assumptions everything downstream inherits: density tier, cooling modality, redundancy topology, voltage architecture, siting class, and the reversible-vs-irreversible register that records which assumptions are hedged and which are committed. Keep one per facility (or per hall). It sets what the workload decision requires of every subsystem. Per-archetype reference sheets are built in Chapter 1.7.
  • Scalable-unit (SU) budget. The repeatable building block you replicate to scale a facility: a defined quantum of compute, power, cooling and fabric (a pod, an NVLink-domain-aligned block) with its power, space, weight, water and cost rolled up. Scoping in SUs rather than raw GPU counts makes a capacity ramp tractable. The SU vocabulary is defined in Chapter 0.3.
  • Decision matrix. The branches-by-consequences table you lift from a chapter's decision tables and adapt to your weights. It turns a fork into a defensible choice on paper: branches in rows, axes (cost, power, reach, latency, reliability, serviceability, schedule) in weighted columns, and the chosen branch and its rejected alternatives recorded.
  • Scorecard. The quantitative roll-up that scores a completed scope: a site-scoring playbook output (Chapter 3.13), an ROI scorecard (Chapter 1.8), an availability/goodput number (Chapter 12.5). Where the matrix chooses a branch, the scorecard grades the whole.

When a chapter hands you a table, ask which artifact it feeds. Most decision tables feed a decision matrix; most keynumbers blocks feed an SU budget or a scorecard; most callouts feed the design-basis sheet's irreversible register. The guide is, in effect, a long set of instructions for assembling these four documents.

Deep dive: how a chapter feeds the four artifacts

Take the density decision from Chapter 1.1 and watch it flow into every artifact. The chapter's decision callout ("training-shaped vs inference-shaped") opens the workload fork, and the design-basis sheet records "training-shaped, liquid-plumbed, power-first siting" only when the equipment and service requirements support that combination. The chapter's cascade table (archetype to requirements) becomes the spine of a decision matrix: copy the row for your archetype, weight the consequence columns by your priorities, and record the rejected alternatives. The chapter's keynumbers (per-rack NVL72 draw, the rack's OEM heat split and TCS/air limits, the interconnection-queue wait) drop into the SU budget. A training SU is then N GB300 NVL72 racks, each provisioned to the up-to-142 kW facility design basis, with a separately priced substrate-reserve scenario against VR200’s 330 kW facility design basis. Add the cooling service and fabric proven to meet your equipment and measured traffic/SLO requirements, and roll it all up to MW and dollars per SU. The chapter's economics pointer to Chapter 1.8 then feeds the scorecard that grades the resulting scope's ROI.

Read this way, a chapter leaves four populated rows across four living documents. If you finish a chapter and none of your artifacts changed, you either did not need that chapter or you read it as a textbook instead of an instrument.

A first screening decision: reserve the route, not the whole future plant

$60kmodeled
Route reservation now
Pays for access and space; it buys no usable kW.
Scope & caveats

0.2 only. Empty accessible route, isolation provisions and space reservation; excludes buying future cooling capacity. Assumed sensitivity: 40000–80000 $; bounds explained in the case ledger.

$180kmodeled
Upgrade with reserved route
Paid only if the expansion is needed.
Scope & caveats

0.2 only. Incremental equipment, installation and allowed outage; same resulting capacity and service as the unreserved alternative. Assumed sensitivity: 120000–240000 $; bounds explained in the case ledger.

$420kmodeled
Upgrade through the fixed envelope
Same service outcome, with retrofit and outage included.
Scope & caveats

0.2 only. Incremental equipment, retrofit and lost-service allowance to the same final capacity; assumes the work remains physically feasible. Assumed sensitivity: 300000–600000 $; bounds explained in the case ledger.

Screen: IT load = 4 × 2 × 12 + 4 = 100 kW. Coincident facility demand = 100 + 28 = 128 kW, leaving 160 − 128 = 32 kW of service headroom; heat-removal headroom is 120 − 100 = 20 kW. The fifth rack adds 24 kW: 152 kW fits the electrical service, but 124 kW exceeds heat removal by 4 kW. It fails the screen even though the electrical meter has room. Annual PUE has not entered this peak-capacity test.

Price reversibility: call the displayed reservation cost R, reserved upgrade U and unreserved retrofit F. Expected present cost of reservation = R + 0.50U/(1.10)², about $130k. Waiting costs 0.50F/(1.10)², about $170k. Reserve the route under these assumptions, saving about $40k in expected present cost; do not buy or sell the fifth rack’s cooling capacity yet. The crossover is p = R(1.10)²/(F − U), about 30%. Below that expansion probability, waiting is cheaper; at 20%, reservation costs about $90k against about $70k for waiting. A route that cannot carry the upgrade fails regardless of price.

The four artifacts now have content. The design basis records the 100 kW IT boundary and 128 kW facility demand; the scalable-unit budget counts eight nodes across four racks; the decision matrix selects route reservation over waiting; the scorecard marks the fifth rack’s cooling as failed and physical feasibility as HOLD pending survey. The service owner must obtain the demand case, and the facility engineer the route and capacity evidence, before purchase. This is an orientation screen: Chapter 1.7 owns the full basis, Chapter 5.1 the heat boundary and Chapter 1.8 the cash comparison. Epoch’s capital-recovery method supplies the primary time-value reference; the assumed prices are guide inputs.

Numbers provenance and vintage: how to read volatile figures

The figures in this guide span three very different half-lives, and treating them as equally durable is how teams anchor an irreversible decision to a number that was already obsolete when the ink dried. Read every figure through its as-of date and its confidence caveat first, and the value second.

Physics and standards are durable. The thermodynamics of a delta-T across a cold plate and the availability algebra of serial-versus-parallel composition do not move on a quarterly cycle. When a chapter cites them, you can treat them as levels and design against them directly. Rack-cooling selection is an engineering limit, not a universal kW threshold: for your equipment, verify airflow and inlet limits, liquid heat fraction, water-system interfaces, climate, residual room heat, serviceability, redundancy and the future density tail (Chapter 5.1). Hardware specifications are semi-durable. A shipping GB300 NVL72 draws what it draws, and the VR200 NVL72 racks shipping since June 2026 (Dell's first racks went to CoreWeave) are a near-term part you can schedule against: NVIDIA reported racks running at CoreWeave, Google Cloud, Microsoft Azure, OCI and Nebius as Vera Rubin ramped into full production (Q2 FY27 results, 2026-08-26). Confirm your allocation date with the OEM. Rubin Ultra and its ~600 kW Kyber-class rack remain announced, not shipping, and every such figure in this guide is marked as roadmap so you do not budget against a number that may slip a generation. Market and economic figures are volatile. Rental rates, colocation pricing, capex forecasts, depreciation policy and interconnection-queue depth can move 30–40% in two quarters. Read these as direction and order of magnitude, never as a level you can underwrite, and re-check them against a live source before they drive a financial decision.

Every volatile headline figure in the guide is logged, date-stamped and caveated in the Numbers Register (Appendix D), so a critical number is always one click from its source, its vintage and an honest note on how contested it is. Some figures are flagged explicitly as contested, among them GPU economic-versus-book life, hyperscaler depreciation policy and liquid-cooling retrofit capex, because reasonable analysts disagree and the disagreement is itself load-bearing. When a contested figure drives one of your irreversible forks, run the decision across the plausible range rather than a point estimate, and confirm the branch is robust to where the number lands.

~2/3forecast
Deloitte November 2025 forecast: inference share of 2026 AI compute; not an observed fleet allocation
Scope & caveats

Deloitte’s November 2025 prediction for inference as a share of AI compute in 2026. Not an observed fleet share, installed capacity, energy or instantaneous electrical draw. The forecast does not allocate an individual fleet.

A forecast for calendar 2026, not an observed 2026 outcome.

more than $1Tforecast
Dell'Oro June 2026 full-year worldwide data-center infrastructure capex outlook; forecast, not realized spend
Scope & caveats

Dell'Oro Data Center IT Capex taxonomy: infrastructure capex across the ten largest cloud providers, rest-of-cloud, telco and enterprise segments; a full-year outlook, not realized 2026 spend.

Full-year 2026 forecast issued by Dell'Oro on June 10, 2026. Its September 16, 2026 release reports higher memory and storage prices lifting server costs and capex; spending growth is not equivalent to growth in installed capacity.

132 kW nominal TDP: 115 kW liquid + 17 kW air
NVIDIA GB200 NVL72 by HPE: 132 kW nominal rack TDP, with 115 kW liquid and 17 kW air heat-removal duties
Scope & caveats

Exact HPE product profile. Keep this 132 kW / 115 kW liquid / 17 kW air record separate from the OCP MGX Rev. 1.1 reference profile of 120 kW / approximately 102 kW liquid / 18 kW air.

~600 kWforecast
per Rubin Ultra Kyber-class rack: roadmap, announced and not shipping; do not budget it as a shipping figure
H2 2027 roadmap (GTC 2025); 2028 reported July 2026NVIDIA GTC (Jensen Huang); DCD, Tom's Hardwareregister ↗
Scope & caveats

NVIDIA's published figure (GTC 2025) is 600 kW per Rubin Ultra Kyber rack and GTC 2026 did not revise it. SemiAnalysis (2026-05-26) reports Kyber Ultra 'approaching 660 kW' — a single-source analyst estimate, recorded here rather than adopted, since the vendor primary figure still stands. Timing contested: SemiAnalysis (July 2026) reports Kyber NVL144 delayed to 2028 on PCB-midplane manufacturability; NVIDIA says its roadmap is intact and has not published a revised date.

30–40 kW typical RDHx; >50 kW with active fans; not a universal limit
SemiAnalysis/nVent cited RDHx range: 30–40 kW typical, >50 kW with active rear-door fans; verify your door, rack and facility limits
Scope & caveats

Select on the named door/rack, air and water conditions, fan state, containment, heat-capture target, residual room heat, climate/rejection, serviceability, redundancy, and future density.

Reference capacity, not a universal ceiling; verify named door/rack, water and air conditions, fan state, containment, and capture target.

2–3 yr bear case vs 4–6 yr estimateforecast
GPU economic vs book life, flagged CONTESTED; run irreversible decisions across the range, not a point estimate
Scope & caveats

The 2–3-year endpoint is a contested stress case rather than an observed universal life.

90% vs 96% scenariomodeled
Training-goodput sensitivity scenario: 90% vs 96% (illustrative; replace with your fleet's measured goodput)
Sep 2026Guide analysis — stipulated sensitivity scenario; no claim of an industry measurement.register ↗
Scope & caveats

Stipulated endpoints for sensitivity only. They are neither measured provider outcomes nor universal targets. Chapter 14.1 reconciles productive-time boundaries; a site measures its own baseline.

>$3T by 2030forecast
Dell'Oro forecast: 2030 worldwide data-center capex outlook, nearly 2× its January 2026 forecast
the forecast floor keeps moving up mid-year; date-stamp every capex figure you plan against

The altitude rule: roadmaps are bullets, not chapters

A guide this large stays navigable only if it obeys one structural rule, and the rule shapes how you read forward-pointers. A roadmap forward-pointer is a bullet, never a chapter. When a chapter says "this density trend continues toward 1 MW racks," that is a one-line signpost: read it as orientation, do not expect the chapter to derive it, and do not look for a roadmap chapter that does not exist. The per-part roadmaps, the consolidated 2026 to 2030 subsystem trajectories, live in exactly one place, Chapter 16.2, so the forward-looking material does not spread across forty chapters and rot independently in each. Every other chapter points forward with a bullet and sideways to its canonical derivation with a cross-reference.

The same single-source discipline governs the whole guide: a concept is defined once, in its canonical home, and referenced everywhere else. The facility metric stack is defined in Chapter 15.1 and the useful-work metrics in Chapter 14.1, both merely oriented in Chapter 0.3; the redundancy vocabulary is primed in Chapter 0.5 and engineered in Chapter 12.1; the standards landscape is indexed in Chapter 0.4. When you hit a term defined elsewhere, the cross-reference tells you this chapter is consuming a definition it does not own, and that if you distrust the definition you should follow the link rather than re-derive it locally. Read the cross-references as the dependency graph of the guide, and you will always know where the authoritative version of any claim lives.

Deep dive: the three narrative threads and how to read for them

Three threads run the length of the guide, and most chapters advance one or two. Reading for the thread that matches your pressure is a fast way to find the chapters that bear on your situation. POWER-BOUND is the recognition that the binding constraint moved from chips to megawatts: the question is no longer how many accelerators you can buy but how many MW you can energize, and when. The chapters carrying this thread decide time-to-power, interconnection queues and behind-the-meter generation; read them when your gate is the grid. GOODPUT is the insight that AI factories optimize effective work delivered (useful training or serving time at MFU), not raw uptime. The redundancy and reliability worth buying is the kind that protects goodput, which is frequently less facility availability than traditional IT would commission. Read this thread when you are tempted to over-build nines. DENSITY-RAMP is the warning that designing to today's density and being surprised by the ramp is the era's signature irreversible mistake. The fix is to make the substrate (floor, power, water, plumbing) accommodate the ramp while keeping the IT fit-out matched to the current generation.

The threads are not chapters, and you cannot read them in isolation; they are lenses. Each chapter's threads field tells you which lenses it sharpens. If your project is gated on power, follow POWER-BOUND; if you are arguing about redundancy, follow GOODPUT; if you are scoping a multi-generation facility, follow DENSITY-RAMP. The same chapter often reads differently through each lens, which is the point.

Reading the guide well: a short protocol

Put the pieces together into a protocol you can run on any chapter. One: read the thesis and the decide list, and ask whether the chapter bears on a fork you own. If not, move on; the guide is not meant to be read whole. Two: for each fork it does raise, classify it on the reversibility axis before you let any number drive it. Three: read the decision callouts as the chapter's central claims, and scan the decision tables across the branch you are leaning toward. Four: before lifting any figure into an artifact, check its as-of date and caveat, and test volatile market numbers as dated ranges. Five: when a consequence is asserted rather than derived and the fork is yours, follow the cross-reference to the canonical chapter. Six: capture the outcome in the right artifact (design-basis sheet, SU budget, decision matrix or scorecard), because the artifact, with its owner, acceptance evidence and reopening trigger, is the durable output. Run that loop and the guide does what it is for: it turns a fast-moving, power-bound, multi-disciplinary build into a sequence of well-posed, well-dated decisions.

This chapter's framework is exercised immediately in Chapter 1.1, where the workload archetype is established as the master variable and the reversibility lens is applied in full. The vocabulary and metric stack you need to parse every figure are oriented in Chapter 0.3 (useful-output accounting in Chapter 14.1, efficiency definitions in Chapter 15.1, cost denominator in Chapter 1.8). The standards every decision is graded against are indexed in Chapter 0.4. The redundancy and availability primer that the GOODPUT thread builds on is in Chapter 0.5, engineered in Chapter 12.1 and reframed as goodput versus availability in Chapter 12.2. The reference artifacts live with their decisions: design-basis sheets and SU budgets in Chapter 1.7, the site scorecard in Chapter 3.13, the ROI scorecard in Chapter 1.8. All consolidated forward-looking roadmaps live in one place, Chapter 16.2, as the altitude rule requires.
Cite this chapter
Fehn, J. (2026). How to Read This Guide: Decisions, Consequences & Reference Data (Chapter 0.2). The Definitive Guide to AI Data Centers. https://aidatacenterguide.com/part-0-foundations-and-how-to-use-this-guide/0-2-how-to-read-this-guide-decisions-consequences-and-reference-data (accessed 2026-10-05).
@misc{aidc-0-2,
  author       = {Fehn, Jacob},
  title        = {How to Read This Guide: Decisions, Consequences & Reference Data (Chapter 0.2)},
  howpublished = {The Definitive Guide to AI Data Centers},
  year         = {2026},
  url          = {https://aidatacenterguide.com/part-0-foundations-and-how-to-use-this-guide/0-2-how-to-read-this-guide-decisions-consequences-and-reference-data},
  note         = {Accessed 2026-10-05}
}
Spotted an error? Suggest an edit