Google Gemma introduces EmbeddingGemma 2, a multimodal on-device embedding model

Google Gemma announces EmbeddingGemma 2, a lightweight embedding model that maps text, code, images, video, and audio into a single unified embedding space.

The model has a 740M parameter form factor with modular encoders, Matryoshka Representation Learning dimensions from 768 down to 128, and an 8K context window that is 4x larger than the text-only EmbeddingGemma.

It is released under the commercially permissive Apache 2.0 license.