Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Llama-3.2-1B

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 3

  1. ConeML 1.2B experimental MoE opens for reproduction

    Solo developer Significant-Serve-58 released the ConeML 1.2B experimental sparse mixture-of-experts model, its GGUF quantization, and an evaluation set. The model has 1.17B stored parameters, activates about 348M per token, and was trained from scratch on roughly 11B tokens; in the developer’s local test, it answered 438 of 512 shuffled fact-chain questions at depth 5, or 85.5%. The developer explicitly said these exploratory results are not controlled training comparisons and that the model is not a general assistant.

    r/LocalLLaMA · 🔥 0
  2. Study probes whether causal neuron circuits transfer across prompts

    A paper by Ömer Tekin Yavuz examines whether intervening on neuron groups changes language-model answers in a necessary or transferable way. Across Qwen3, Llama-3.2-1B, and Gemma-3-1B, the experiments find that a few neurons can often suffice, while group effects transfer to rephrasings of the same reasoning chain but weaken on other chains.

    Hugging Face · Papers · 🔥 0
  3. OASIS adds null routing to attention residuals

    A team from Northwestern University, the Illinois Institute of Technology, Rutgers University, and other institutions proposed OASIS, whose token- and depth-level null options let Attention Residuals abstain from assigning full probability mass to real branches. According to Xinzhiyuan’s report on the paper, the method was accepted to NeurIPS 2026 and reduced average activation kurtosis by 95.90% versus Vanilla AttnResidual across LLaMA-3.2-1B, Qwen3-0.6B, and Phi-4. The reported experiments also found a 13.21-point Qwen3-0.6B W4A4 GSM8K Pass@1 advantage over Vanilla AttnResidual and recovered 77.3%–91.8% of selected RULER and LongBench performance losses at 12K-token contexts.

    新智元 · 🔥 0

Experience and discussion from the community

Share my Llama-3.2-1B experienceAsk about Llama-3.2-1B

Nobody has shared their experience with Llama-3.2-1B yet.