Live · Reports & Diagrams Online

32-Node NVIDIA B300 Compute Farm

256 deployed GPUs · 72-node-standard network baseline · 204.8 Tb/s live InfiniBand compute fabric

Live simulation — 32-node compute fabric on refreshed 72-node-standard network envelope
Farm Specifications
Deployed Nodes
0
Current compute population
Total GPUs
0
NVIDIA B300 (current deployment)
Standard Baseline
0
Node-capacity reference for the refreshed network design
GPU Memory
0
73.73 TB HBM3e (256 × 288 GB)
FP8 Peak Compute
0
PFLOPS dense
IB Bisection BW
0
Tb/s · live 32-node compute fabric
IB Switches
0
Q3400-RA · 8 leaf + 4 spine
UFM Nodes
0
Production + standby / HA pair
SN5610 Layer
0
Standard-aligned converged / storage-network layer
SN4700 Layer
0
Border + control layer
SN2201 Layer
0
Management-layer switch count
Contracted Racks
0
Current package count; final placement redraw pending
Facility Allocation
0
kW · 1.5 MW project envelope
Documentation & Reports
FULL REPORT

Full Network & Topology Report

Primary report now separates the 32-node deployed compute scope from the 72-node-standard network baseline. Covers split BOM, dual UFM, SN5610/SN4700/SN2201 layers, and the revised 1.5 MW versus 680 kW framing.

ARCHITECTURE

Farm & Network Tower Architecture

Updated architecture summary treats N1-N6 as the refreshed network/services placement envelope rather than a simple N1/N2 occupied story. Covers live Q3400 compute fabric, retained Spectrum-4, dual UFM, and the added SN5610/SN4700/SN2201 layers.

SINGLE RACK

Single Rack Server Unit Architecture

Per-server deep-dive: ASUS XA NB3I-E12 BOM, CX8 rail mapping, BF3 wiring, X710 management mapping into the SN2201 layer, and server-side power audit for the live 32-node compute layer.

PLANNING SUMMARY

Farm Planning Summary

High-level summary for the current package: 32 deployed nodes, 72-node-standard network baseline, 34 contracted racks, 1.5 MW facility allocation, and split baseline-versus-deployment reporting rules.

INFRASTRUCTURE

Infrastructure & Supporting Systems

Cooling stays anchored to 650+ kW with 4 total CRAC/CRAH units and N+1 coverage, while power framing is updated to 1.5 MW facility allocation and a 680 kW current rack ceiling. Supporting systems now assume the refreshed SN2201/SN4700/SN5610 management and service layers.

Diagram Viewer
IDC Farm Planning topology overview
Diagram 1
IDC Farm Planning & Connectivity
Refreshed IDC overview showing the 32-node live compute deployment inside a 72-node-standard network/services envelope with SN4700, SN5610, SN2201, and dual-UFM layers.
SVG viewerFit / 100%Scroll + zoom
Farm InfiniBand Rail Topology diagram
Diagram 2
Farm InfiniBand Rail Topology
Live 32-node compute fabric with the surrounding management, border, and service layers updated to the refreshed SN4700/SN5610/SN2201 and dual-UFM architecture.
SVG viewer2400px exportDetail review
Single Rack per-port connection detail diagram
Diagram 3
Single Rack — Per-Port Connection Detail
Single-rack server-side port map aligned to the refreshed management wording, with X710 links landing in the SN2201 management layer and UFM HA messaging carried consistently.
SVG viewerPort mappingScroll + inspect