The amazingly fast (only 30M!) and extremely accurate @answerdotai ColBERT model is now supported in Sentence Transformers to make it easy to create and query embedding indexes locally directly in Python! 🥳
Sentence Transformers adds fast 30M-parameter ColBERT model support
AISummary
Sentence Transformers now supports Answer.AI's ColBERT model, which has only 30M parameters, for local embedding index creation and querying in Python. The update comes with Sentence Transformers v6.0, which adds MultiVectorEncoder for ColBERT-style late interaction models alongside dense, sparse, and reranker models.
Post on XView on X
@jeremyphoward
🚨I've just released Sentence Transformers v6.0! MultiVectorEncoder joins the family: ColBERT-style late interaction models are now a first-class model type, for training, inference & interpretation, alongside dense, sparse & reranker models. Big thread 🧵
Source: Jeremy Howard · x.comPublished · added here