InfiniBand
A high-speed network fabric used in data centres (200+ GB/s).
A high-speed network fabric used in data centres (200+ GB/s). Allows Ring Attention across multiple machines in a cluster. Slower than NVLink but adequate if well-managed.
A high-speed network fabric used in data centres (200+ GB/s).
A high-speed network fabric used in data centres (200+ GB/s). Allows Ring Attention across multiple machines in a cluster. Slower than NVLink but adequate if well-managed.