Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

EmbeddingGemma-2

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 1

  1. Author Reports EmbeddingGemma-2 PCA Head Tops Audio-Only MAEB

    In two Reddit posts by /u/JeanMichelRanu, the author reports adding a 2.37 MB safetensors file of frozen PCA matrices to Google’s EmbeddingGemma-2 (577M). The adapter compresses acoustic features from Conformer layers 2 and 6 and injects them into the model’s unused 256-dimensional null space without training model weights. According to the author, the MAEB macro score rose from 49.3% to 54.4%, moving the model from 26th to first on audio-only MAEB and from 16th to first on full MAEB. The reported audio-to-audio results include gender clustering rising from 0.05% to 63.1%, artist retrieval from 55.2% to 93.8%, vocal emotion classification from 19.7% to 40.2%, and environmental-sound performance from 38.8% to 56.3%. The author says text-to-audio retrieval across more than 100 languages remained within 0.05 points, while text embeddings were unchanged. Reported trade-offs include the loss of Matryoshka truncation options for audio embeddings and weaker spoken-intent results, including MInDS14 falling from 97.6% to 88.3%. The supplied reports contain the author’s results but no independent rerun or verification.

    r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my EmbeddingGemma-2 experienceAsk about EmbeddingGemma-2

Nobody has shared their experience with EmbeddingGemma-2 yet.