Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Llama-3.1

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 1

  1. VocabX Cuts Inference Cost 77% by Rebuilding Vocabulary for Domain Models

    Dharma AI, in a Hugging Face article, previewed VocabX, a method that rebuilds a language model's tokenizer around the cost of each token rather than how often it appears, combining a domain-specific sub-word vocabulary with multi-token macros for repeated spans such as JSON envelopes. The authors say they applied it to a production Portuguese essay grader built on Qwen3-4B, keeping the same base model, data and training recipe, and cut measured inference cost by 77% while shrinking the output layer from about 152,000 to about 65,000 rows. They also report that VocabX beat fast vocabulary transfer, multi-word tokenization and Liquid AI's in-place BPE across 15 domain and model combinations (contracts, medical papers, scientific papers, news and Python code on Qwen3, Llama-3.1 and Gemma-3). The results come from a VocabX paper that Dharma AI says is still under review and may change before publication.

    Hugging Face · 🔥 0

Experience and discussion from the community

Share my Llama-3.1 experienceAsk about Llama-3.1

OBLITERATUS: An open-source toolkit for understanding and removing refusal behaviors from large language models.

What problem it solves Refusal mechanisms in transformer models can block legitimate research, creative writing, and red-teaming alongside genuinely harmful content. Researchers need transparent, reproducible ways to locate refusal representations, evaluate their relationship to other capabilities, and apply controlled interventions without retraining or fine-tuning. Key features Refusal direction…

github.comhttps://github.com/elder-plinius/OBLITERATUS