we're working on another one for speculative decoding, and then quantization, make sure to check out Llama App docs!
Hugging Face working on speculative decoding and quantization guides
AISummary
Merve Noyan, of Hugging Face, says a new guide on speculative decoding is in progress, followed by one on quantization. She points readers to the Llama App docs page comparing prefill and decode.
Post on XView on X
Source: merve · x.comPublished · added here