We also released 1-bit Qwen3.8-27B quants which run on 8GB RAM. They retain ~77% of accuracy compared to BF16. We originally didn't want to release them but were shocked that they worked extremely well on our internal testing!
We also released 1-bit Qwen3.8-27B quants which run on 8GB RAM.
AISummary
We also released 1-bit Qwen3.8-27B quants which run on 8GB RAM. They retain ~77% of accuracy compared to BF16. We originally didn't want to release them but were shocked that they worked extremely well on our internal testing!
Source: Daniel Han · x.com