BrunoHays/embeddinggemma-2-nullspace-audio
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Author Reports EmbeddingGemma-2 PCA Head Tops Audio-Only MAEB
In two Reddit posts by /u/JeanMichelRanu, the author reports adding a 2.37 MB safetensors file of frozen PCA matrices to Google’s EmbeddingGemma-2 (577M). The adapter compresses acoustic features from Conformer layers 2 and 6 and injects them into the model’s unused 256-dimensional null space without training model weights. According to the author, the MAEB macro score rose from 49.3% to 54.4%, moving the model from 26th to first on audio-only MAEB and from 16th to first on full MAEB. The reported audio-to-audio results include gender clustering rising from 0.05% to 63.1%, artist retrieval from 55.2% to 93.8%, vocal emotion classification from 19.7% to 40.2%, and environmental-sound performance from 38.8% to 56.3%. The author says text-to-audio retrieval across more than 100 languages remained within 0.05 points, while text embeddings were unchanged. Reported trade-offs include the loss of Matryoshka truncation options for audio embeddings and weaker spoken-intent results, including MInDS14 falling from 97.6% to 88.3%. The supplied reports contain the author’s results but no independent rerun or verification.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my BrunoHays/embeddinggemma-2-nullspace-audio experienceAsk about BrunoHays/embeddinggemma-2-nullspace-audio
Nobody has shared their experience with BrunoHays/embeddinggemma-2-nullspace-audio yet.