CohereLabs releases Eagle draft model for North-Mini-Code-1.0 speculative decoding
Original titleCohereLabs/North-Mini-Code-1.0-eagle
AISummary
CohereLabs has published North-Mini-Code-1.0-eagle, an Eagle draft model for its North-Mini-Code-1.0 target model. The three-layer draft uses dense transformer blocks and sliding window attention, and it is compatible with fp8 and w4a16 target checkpoints in vLLM.
Source: Cohere · new models on Hugging Face · huggingface.coPublished · added here