LiquidAI LFM2.5-1.2B-Instruct-DSpark Drafter Speeds Up Decoding About 2x
Original titleLiquidAI/LFM2.5-1.2B-Instruct-DSpark
AISummary
Liquid AI released LFM2.5-1.2B-Instruct-DSpark, a 295.7M-parameter speculative-decoding draft model for the LFM2.5-1.2B-Instruct target on Hugging Face. On an H100 it averages 4.81 accepted tokens per step and runs about 2.10x faster across benchmarks, with about 2x speedup in SGLang and on-device Apple silicon support via Metal.
Source: Liquid AI · new models on Hugging Face · huggingface.coPublished · added here