Apple releases CLaRa-7B-E2E, an end-to-end RAG model with 16x and 128x compression

Apple's CLaRa-7B-E2E is a fully end-to-end unified RAG model that jointly optimizes retrieval and generation, with 16x and 128x document compression. It is trained with end-to-end finetuning using differentiable top-k retrieval and a unified language-modeling objective. The model is available on Hugging Face with example end-to-end inference code.