Huawei and Nvidia Move KV Cache Into Dedicated Storage, but SSD Specs Remain Undefined

Huawei launched the OceanStor M900 and Nvidia introduced CMX Context Memory Storage to manage inference KV Cache in tiered storage, reducing repeated computation on cache hits. Sources say SSD requirements for this workload are not standardized: some plans have moved from 3 DWPD to 9 DWPD, and the industry may need 6–12 months to reach a common product standard.