Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Hugging Face Transformers

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 19

  1. Transformers v5.24.0 Adds Inkling 2 Mini and Variable-Loop Checkpoint

    Transformers v5.24.0 added support for Inkling 2 Mini, a multimodal model from Thinking Machines Lab that accepts text and image inputs and generates text. According to the release notes, its 24-layer decoder repeats layers 6 through 17 three times, uses a learned message-passing mechanism, and routes each token to 8 of 128 experts with a hidden size of 2304. The release also added the TML-d24-varloop-research checkpoint, which supports a variable number of loop passes, trading speed for quality.

    Transformers Releases · 🔥 10
  2. A Practical Workflow for Fine-Tuning ChatGLM for Vertical Domains

    A Juejin tutorial presents an end-to-end workflow for adapting ChatGLM3-6B to industry-specific business scenarios using PEFT-LoRA. It covers requirements analysis, model configuration, business-data collection and cleaning, ChatGLM conversation templating, tokenization, train-validation splitting, and PyTorch DataLoader construction, with runnable code intended to prepare data for model training. The article also recommends aligning training and inference prompts and discusses evaluation with human review and Rouge.

    掘金 · 人工智能 · 🔥 2
  3. Learned predictors improve LLM fine-tuning duration estimates

    Dharma-AI R&D analyzed 272 production supervised fine-tuning jobs totaling about 7,382 GPU-hours on NVIDIA H200 clusters. In five-fold cross-validation, its CatBoost predictor achieved R² of 0.98 and a mean absolute error of 1.71 hours, compared with R² of 0.31 and 12.41 hours for the tested FLOP-based baseline. The study covers only SFT workloads on H200 infrastructure, and the full paper is planned for arXiv.

    Hugging Face · 🔥 0
  4. Transformers streams SSD-hosted experts for 180B MoE inference

    Tarek Ziadé reported a Transformers implementation that streams quantized MoE experts from SSD into a bounded device cache, enabling the 180B-parameter Qwen3.8-Flash-Next model to run on a MacBook M5 with 32 GB of unified memory. The author measured 13.9 tokens per second after optimization and said this remained about 6% behind Strata, with per-layer synchronization identified as the remaining gap. The implementation is available through an open pull request, but its API was still under discussion with maintainers.

    Hugging Face · 🔥 1
  5. Salesforce releases SOV-Transcribe-1 open-weight speech-to-text model

    Salesforce and Missionforce Sovereign AI released SOV-Transcribe-1, an open-weight, speech-augmented language model for non-streaming automatic speech recognition. Artificial Analysis reported that it ranked first among open-weight speech-to-text models with a 2.3% AA-WER score and seventh among 44 models overall, while a Salesforce description cited by r/LocalLLaMA placed it second of 23 systems on VoiceCodeBench for entity accuracy and task success. The model supports seven languages, natural-language transcription controls, context biasing, and deployment through vLLM or Hugging Face Transformers.

    ArtificialAnlys (X) · 🔥 0
  6. txtai Is an All-in-One AI Framework

    According to its project documentation, txtai is an open-source Python framework for semantic search, LLM orchestration and language-model workflows. Its core embeddings database combines sparse and dense vector indexes, graph networks and relational databases. Documented features include retrieval-augmented generation, autonomous agents, multimodal indexing, language-model pipelines, workflows and web and Model Context Protocol APIs. The project is built with Python 3.11+, Hugging Face Transformers, Sentence Transformers and FastAPI, and is licensed under Apache 2.0.

    GitHub Trending · Python · 🔥 0
  7. Qwen releases FP8 weights for Qwen3.8-2.4T-A95B

    Qwen introduced Qwen3.8 as an open release in its open-model family, with FP8-quantized weights and configuration files for the post-trained Qwen3.8-2.4T-A95B model in Hugging Face Transformers format. The model has 2.4 trillion total parameters and 95 billion activated parameters. Its artifacts are reported as compatible with vLLM, SGLang, TokenSpeed and other listed frameworks. Qwen says fine-grained FP8 quantization with a block size of 128 produces performance metrics nearly identical to those of the original model, but the supplied report provides no independent measurements.

    Qwen · Hugging Face · 🔥 0
  8. Qwen releases Qwen3.8-2.4T-A95B model weights

    Qwen released the model weights and configuration files for Qwen3.8-2.4T-A95B in Hugging Face Transformers format. The 2.4T-parameter MoE model activates 95B parameters per token and is natively designed for 262,144-token context, with extension up to 1,010,000 tokens. Qwen says the artifacts support vLLM, SGLang, and TokenSpeed, while the separate Qwen3.8-Max adds vision input, non-thinking support, a default 1M context length, and built-in tools.

    Qwen · Hugging Face · 🔥 0
  9. Qwen releases Qwen3.8-Flash-Next-FP8 open weights

    Qwen published FP8-quantized weights and configuration files for Qwen3.8-Flash-Next in Hugging Face Transformers format. According to Qwen, the fine-grained FP8 quantization uses a block size of 128 and has performance metrics close to those of the original model. The repository also lists compatibility with Transformers, vLLM, SGLang, and TokenSpeed, but the supplied report contains no independent compatibility tests or benchmark results.

    Qwen · Hugging Face · 🔥 0
  10. Qwen Releases Qwen3.8-27B-FP8 Vision-Language Weights

    Qwen’s Hugging Face repository provides FP8-quantized weights and configuration files for the post-trained Qwen3.8-27B-FP8, a 27B-parameter vision-language model. The artifacts use the Hugging Face Transformers format and are reported as compatible with Transformers, vLLM, SGLang and TokenSpeed. Qwen says fine-grained FP8 quantization with a block size of 128 produces performance nearly identical to the original model.

    Qwen · Hugging Face · 🔥 0
  11. Qwen Releases Qwen3.8-27B Open-Weight Vision-Language Model

    Qwen released the Qwen3.8-27B model weights and configuration files under the Apache 2.0 license in Hugging Face Transformers format. The 27B dense vision-language model handles images and video, supports flexible thinking controls, and natively offers a 262,144-token context that Qwen says can be extended to 1 million tokens. Its artifacts are compatible with Transformers, vLLM, SGLang, and TokenSpeed, while a hosted Qwen Cloud version is still described as coming soon.

    Qwen · Hugging Face · 🔥 0
  12. Qwen Releases Qwen3.8-Flash-Next Open-Weight Preview

    Qwen published the post-trained weights and configuration files for Qwen3.8-Flash-Next, a 180B-parameter image-text-to-text model presented as an experimental preview of the architecture intended for Qwen4. The artifacts are listed as compatible with Hugging Face Transformers, vLLM, SGLang and TokenSpeed, while Qwen Cloud offers a managed API; Qwen says its hybrid attention, gated residual and n-gram embedding designs improve long-context efficiency and parameter scaling.

    Qwen · Hugging Face · 🔥 0
  13. LLM Pretraining Engineering: Frameworks, Parallelism, and Scaling Laws

    The supplied article surveys large-model pretraining, covering data, tokenization, optimizers, memory, distributed parallelism, checkpoints, and model evaluation. It compares Megatron-LM, DeepSpeed, and torchtitan; explains the different configuration guidance in Kaplan’s and Chinchilla’s scaling laws; and discusses cost estimation, loss spikes, checkpoint recovery, and resuming distributed training. Framework and performance characterizations are the article’s assessments, while its cost calculation is presented without accompanying source calculations.

    掘金 · 人工智能 · 🔥 0
  14. AWS walkthrough: training Qwen3 on Trainium with torchtitan

    An AWS Machine Learning Blog post walks through training Qwen3 on a single trn2.48xlarge Trainium instance using torchtitan, saying TorchNeuron registers Trainium as a native PyTorch device so torchtitan can use it through standard PyTorch interfaces. The post describes three configurations that share the same torchrun launch pattern and config structure: Hugging Face Transformers v5 as a modeling backend running Hub models through AutoModelForCausalLM with published safetensors, torchtitan's native Qwen3 selected by changing config.model_spec, and an NKI mixture-of-experts path using kernels from the torchtitan-neuron recipes attached via torchtitan's override registry. AWS says the setups support both pre-training from random initialization and fine-tuning published weights, and pins versions including torch 2.14.0, torch_neuronx 2.14.3, transformers 5.16.0 and torchtitan-neuron release-2.33.

    AWS Machine Learning Blog · 🔥 0
  15. Gradium releases open-source Phonon on-device TTS models

    Gradium released Phonon, a collection of 31M- and 40M-parameter text-to-speech models designed to run locally without a server or network connection. It also open-sourced the ptts inference stack, which Gradium says targets more than 10 CPU, GPU, and NPU backends. The models support five languages, with Phonon 31m under Apache 2.0 and Phonon 40m under a non-commercial license.

    r/LocalLLaMA · 🔥 0
  16. CPU low-bit benchmark: bitnet.cpp wrong, Bonsai correct, ik_llama.cpp fastest

    A community benchmark posted on r/LocalLLaMA compared low-bit GGUF runtimes against reference outputs on an ARM Neoverse-N1 server and x86 AVX2 VMs. It reports that bitnet.cpp main (commit 0b341e5) is incorrect for BitNet b1.58 2B4T: x86 text looks fine but perplexity is about 6× the HF transformers reference on the same tokens, while ARM prints ????; the author says fixes from issue #588 and an ARM kernel, bundled in PR #642's third version dated Oct 15, are correct on both. Ternary-Bonsai 1.7B files gave correct output wherever they loaded in llama.cpp, the Prism fork and ik_llama.cpp, with prompt-processing speeds varying by file, runtime and CPU — 71 t/s for PQ2_0 in ik_llama.cpp with -rtr versus 28 in Prism — and the Q2_0 file marked recommended on the model card did not load in any of the three runtimes.

    r/LocalLLaMA · 🔥 0
  17. Transformers v5.20.1 adds Reflection AI's Beam coding model

    The Transformers v5.20.1 release notes say the update adds Beam, a new model from Reflection AI described as a token-efficient, frontier-scale model focused on coding and agentic use cases. The notes say Beam is built for teams that want to run a powerful model on their own hardware, infrastructure or cloud and customize it. The same patch release fixes a regression that broke model loading on older PyTorch versions and includes fixes for HunYuan-VL image assignment in batched generation and DeepGEMM Mega MoE under expert parallelism.

    Transformers Releases · 🔥 0
  18. Hugging Face Transformers 5.20.0 adds Meta's Muse Spark Open and other models

    Hugging Face released Transformers 5.20.0, which adds support for several new models, most notably Meta's Muse Spark Open. According to the release notes, Muse Spark Open is a multimodal mixture-of-experts model that takes text, images, audio and video as input and generates text, with 816B total parameters (42B active per token), a context window of up to 1,048,576 tokens shared across modalities, training for agentic coding tasks such as multi-file editing, debugging and tool use, and checkpoints in BF16 and NVFP4 formats. The same release adds InclusionAI's Ling 3.0 Flash, Aleph Alpha's Kolibri 1, OpenBMB's MiniCPM-V 4.7, Baidu's UnlimitedOcr and UltraBERT, among others.

    Transformers Releases · 🔥 0
  19. Transformers v5.19.0 adds EmbeddingGemma 2 support

    Hugging Face Transformers v5.19.0 adds support for EmbeddingGemma 2, Google’s multimodal embedding model for text, images, audio, and video in a shared 768-dimensional vector space. The release also changes MoE router-logit outputs, expands expert-parallel token dispatch, updates continuous-batching attention behavior, and fixes quantized and per-layer cache handling.

    Transformers Releases · 🔥 0

Experience and discussion from the community

Share my Hugging Face Transformers experienceAsk about Hugging Face Transformers

Nobody has shared their experience with Hugging Face Transformers yet.