Weight-only vs weight+activation quantization

Compressing just the stored weights (big memory/bandwidth win, easy on quality) vs also quantizing the live activations for compute speedups (harder, due to outliers).