KV block / page / block table
The fixed-size unit of KV memory, and the per-request map from logical token positions to physical blocks.
The fixed-size unit of KV memory, and the per-request map from logical token positions to physical blocks.
The fixed-size unit of KV memory, and the per-request map from logical token positions to physical blocks.
The fixed-size unit of KV memory, and the per-request map from logical token positions to physical blocks.