atomic.chat发布DeepSeek V4 Flash 14款量化版

atomic[.]chat just released 14 compressed quantized builds of DeepSeek V4 Flash 0731.

From lossless BF16 to 1-bit, GGUF versions for local inference runtimes.

This release measures KL divergence against the uncompressed weights instead, which asks how far the whole probability distribution drifts at every token.

The verdict is that everything above 3 bits is close to the original, and everything below falls apart fast.

The option it recommends for 128GB hardware is AD-IQ2_M. It matches the original's token choice 83.6% of the time, measured against all other V4 Flash GGUFs in the community.

@atomic_chat_hq is a desktop app that runs LLMs locally.