Skip to content
Read the original: LMSYS Org· lmsysorg·Published AI score32/100

RLinf adds Cosmos3 support with SGLang, boosting evaluation throughput 3.33x

Original title🚀 New blog: Cosmos3 in RLinf: 3.33× End-to-End Evaluation Throughput with SGLang

AISummary

RLinf, an open-source framework for embodied intelligence and AI agents, now supports Cosmos3 from fine-tuning through robot evaluation.

With SGLang inference, it delivers 3.33x end-to-end evaluation throughput, batching inference for 128 parallel environments on 8 GPUs across 500 episodes of the full LIBERO-10 evaluation.

RLinf also overlaps CPU simulation with GPU inference to reduce waiting between stages.

Read the original x.com

Source: LMSYS Org · x.com