Network Bisection Bandwidth
Network bisection bandwidth is the maximum aggregate data rate between two equal halves of a network when cut across its middle - it is a critical capacity metric for assessing whether a cluster can sustain large-scale all-to-all communication.
What Is Network bisection bandwidth?
- Definition: Throughput available across the minimum cut that splits network nodes into two equal groups.
- Workload Relevance: Collective operations often stress bisection limits in distributed training clusters.
- Oversubscription Link: Lower bisection relative to edge bandwidth indicates potential contention under load.
- Measurement: Evaluated through synthetic communication tests and real workload profiling.
Why Network bisection bandwidth Matters
- Scaling Bound: Insufficient bisection causes synchronization delays that cap effective cluster speedup.
- Capacity Forecast: Guides whether planned model scale can run without severe network tax.
- Design Comparison: Useful for choosing between topology options and switch investment levels.
- Performance Debug: Low observed throughput versus expected can indicate fabric misconfiguration.
- Procurement Decisions: Bisection targets are key in specifying AI-ready network infrastructure.
How It Is Used in Practice
- Benchmark Campaign: Run multi-node all-to-all and all-reduce tests at varying world sizes.
- Link Audit: Verify uplink wiring, ECMP policy, and congestion-control settings against design intent.
- Continuous Monitoring: Track bisection-sensitive metrics during production workloads to catch drift.
Network bisection bandwidth is a core indicator of cluster communication headroom - distributed training performance depends heavily on having enough cross-fabric capacity at scale.