Why E8 lattice quantization beats scalar quantization for KV caches

Most KV cache quantization methods treat each number independently: round each float to the nearest...