We overcome gold-chunk supervision limits by distilling relevance from our query-aware context compression model.
Original titleWe overcome gold-chunk supervision limits by distilling relevance from our query-aware context compression model.
AISummary
It scores every document token against the query. Aggregated into chunk-level targets, those scores train the embedder to retrieve answer and supporting chunks.
Source: Perplexity · x.com