Compute-bound
Limited by calculation speed (cores busy, data plentiful).
Limited by calculation speed (cores busy, data plentiful). Prefill is typically compute-bound.
Limited by calculation speed (cores busy, data plentiful).
Limited by calculation speed (cores busy, data plentiful). Prefill is typically compute-bound.