Tencent’s Hugging Face model repository lists a new FP8 Block128 Safetensors variant of WeMM-Video-35B-A3B under the ID tencent/WeMM-Video-35BA3B-FP8. The checkpoint is based on the quantized 35B-A3B model, uses Apache-2.0 licensing, and contains 36.09 GiB of weight files. Tencent says the bilingual model accepts text, images, audio, and video, with loading and generation checks reported on an NVIDIA L20 and H20.
Tencent published an AWQ W4A16 Safetensors checkpoint for WeMM-Video-35B-A3B, with 22.69 GiB of weight files and INT4 feed-forward weights. The bilingual audio-visual model accepts text, images, audio, and video; its documentation includes Transformers loading instructions, patched vLLM 0.18.0 serving guidance, and validation on NVIDIA L20 and H20 hardware.
Tencent's model card describes WeMM-Video-9B as the dense 9B checkpoint in the bilingual WeMM-Video family for joint audio-visual understanding and reasoning. It accepts text, images, audio, and video and generates text responses. The release includes BF16 Safetensors, quantized variants, Transformers support, and serving instructions for patched vLLM and SGLang versions.
Tencent released the FP8 Block128 Safetensors variant of WeMM-Video-9B under the Apache 2.0 license, with 13.10 GiB of weight files available on Hugging Face. The Chinese-English bilingual model accepts text, images, audio, and video and generates text responses; its model card includes Transformers loading instructions and a patched vLLM 0.18.0 serving setup. Tencent reports successful loading and generation checks on NVIDIA L20 and H20 GPUs, but these validation details are self-reported.
Tencent’s Hugging Face repository released a 12.86 GiB AWQ W4A16 Safetensors checkpoint for WeMM-Video-9B. Tencent describes it as a Chinese-English bilingual model that jointly processes text, images, audio, and video, with support for Transformers and patched vLLM 0.18.0. The repository reports successful loading and generation checks on NVIDIA L20 and H20 hardware, but these validation details come from the publisher.
The Hugging Face model card for tencent/WeMM-Video-4B describes the checkpoint as the dense 4B version in the bilingual WeMM-Video family. It says the model accepts text, images, audio, and video and generates Chinese or English responses. The listing provides BF16 Safetensors weights, four quantized variants, Apache License 2.0 terms, and examples for Transformers, vLLM, and SGLang deployment.
Tencent’s WeMM-Video model card says WeMM-Video-35B-A3B is a bilingual Chinese-English mixture-of-experts checkpoint with 35B total parameters and 3B active parameters. It accepts text, images, audio, and video, and the Hugging Face repository publishes BF16 weights plus FP8, AWQ, GGUF, and NVFP4 variants under an Apache 2.0 license. Tencent claims the model leads open-source omni-modal video understanding, but that benchmark claim is vendor-reported.
Tencent published an FP8 Block128 Safetensors variant of WeMM-Video-4B under the Apache 2.0 license. The model card documents loading and generation checks on one NVIDIA L20 with Transformers 5.2.0 and PyTorch 2.10.0+cu129, alongside serving instructions for patched vLLM 0.18.0 on FP8-capable GPUs. Tencent describes WeMM-Video as a Chinese-English bilingual family for joint audio-visual understanding and reasoning that accepts text, images, audio, and video.
Tencent published a 7.32 GiB AWQ W4A16 Safetensors checkpoint for WeMM-Video-4B. The language model’s feed-forward weights use group-128 INT4, while activations and attention weights remain BF16. The repository provides direct-loading instructions for Transformers 5.2.0 and a serving guide for patched vLLM 0.18.0 with the checkpoint’s compressed-tensors configuration; Transformers loading requires compressed-tensors 0.13.0. Tencent reports that the local checkpoint loaded and completed generation checks for text, images, audio, video frames and video with its soundtrack on one NVIDIA L20 using Transformers 5.2.0 and PyTorch 2.10.0+cu129.
Tencent released the WeMM-Video-2B-FP8 repository, an FP8 Block128 Safetensors variant of WeMM-Video-2B with 4.84 GiB of weights. The model supports text, image, audio, and video inputs and generates Chinese or English text responses; its listed capabilities come from Tencent’s model description. The repository documents successful loading and generation with Transformers 5.2.0 and patched vLLM 0.18.0 on an NVIDIA L20.
Tencent published an Apache 2.0-licensed repository for WeMM-Video-2B-AWQ, an AWQ W4A16 Safetensors checkpoint with 4.86 GiB of weight files. The model card says the 3B-parameter model accepts text, images, audio, and video and generates text responses in Chinese or English, while the quantization uses group-128 INT4 for feed-forward weights and BF16 for activations and attention weights. Tencent reports successful loading and generation checks on one NVIDIA L20 using Transformers 5.2.0 and a patched vLLM 0.18.0.
Tencent’s Hugging Face listing introduces Hy4-base as a 771B-parameter image-text-to-text model built on a 770B-parameter Mixture-of-Experts language backbone, with 49B parameters activated per token and a listed 1M-token context window. The model card says it supports text, image and video understanding, and provides Transformers support, GGUF weights, a finetuning pipeline, and deployment recipes for vLLM and SGLang. Tencent also reports benchmark and application improvements, but the supplied listing is the only source and its performance claims have not been independently verified.
Tencent released WeMM-Video-2B, a dense 2B checkpoint in its bilingual WeMM-Video family, under the Apache-2.0 license. The Hugging Face model card says it accepts text, images, audio, and video, generates text responses, and offers BF16 weights plus FP8, AWQ, GGUF, and NVFP4 variants.
Hugging Face announced that Thinking Machines Lab's Inkling 2 Mini is available, describing it as a multimodal mixture-of-experts model with about 26B physical total parameters and 3B active parameters per token. Its 24 decoder layers include 12 middle layers that run three times in a loop, giving it the effect of 48 logical layer visits, and it supports a 1M-token context with image and text inputs. Weights ship in mixed precision with NVFP4 and MXFP8 expert weights, a DSpark drafter is included, and support is available in transformers, Llama App, llama.cpp, MLX and SGLang with day-zero inference. Hugging Face says in its informal vibe tests the model was at least comparable with Qwen 3.8 27B, while noting that more validation is needed.
Reson8 released the 0.5B-parameter Rumble-2-Flash speech recognition model under the Apache 2.0 license with open weights. It supports more than 40 languages, automatic language detection and configurable transcription output, with native integration for Transformers and vLLM. Reson8 claims the model can process an hour of audio in about half a second and performs on par with NVIDIA's 30B Nemotron 3.5 Transcribe on a 302-hour noisy call-centre benchmark.
Transformers v5.23.0 adds support for Inkling 2 Small, JEV, LFM3, Dots 3 Note Preview, and LFM3-VL, according to the Transformers Releases announcement. Inkling 2 Small is described as a multimodal mixture-of-experts model with text and image inputs, while JEV provides an experimental decision head for scoring single-token labels. The release also includes kernel, attention, generation, and distributed-training fixes.
A community developer built a text-to-image and image-manipulation pipeline for DiffusionGemma using LoRA, a trained image output head, and a vision decoder. The author says the adapted model produced recognizable images and improved visual manipulation when its generated visual latents were fed back into the next forward pass, and released the adapter, decoder weights, and code. The project is a self-reported experiment heavily assisted by LLMs, and the author describes the resulting system as rough and largely impractical.
MiniMaxAI released the 27B MiniMax-H3-Image-PE model for expanding short text-to-image requests into detailed captions and suggesting aspect ratios. The FP4 checkpoint is derived from Qwen3.8-27B and includes SGLang serving instructions, task and system prompts, a client example, and local Diffusers integration. The repository also provides an image-editing prompt template and message-assembly example, but that workflow remains under development.
Hugging Face presented decision models as an alternative to generating text for classification-like tasks, returning structured decisions and probabilities through a typed interface. The article demonstrates the Transformers decision pipeline with GEV-26B-Decide and explains Choice, Score, and Noul primitives, while also describing custom training and a forthcoming TRL integration whose pull request remained open at publication.
William L. Tong and coauthors report that state space models use constant memory and linear computation for sequence modeling but lag behind Transformers on in-context learning and precise retrieval. Their theory and experiments show that gating causes state space models to first learn an in-weights memorization solution, delaying or preventing convergence to correct in-context learning even when architecture or memory capacity is not the fundamental constraint. The researchers also find that gating often improves generalization to longer sequence lengths.
A community author published a guide to locating and steering individual neurons in Qwen3.5-4B. It covers PyTorch hooks, fixed-value “doses,” neuron addresses, and three discovery approaches: random probing, gradient-based shortlisting with an LLM judge, and activation mining. The author says Qwen3.5-4B has 32 layers with 9,216 MLP neurons per layer, and that modifying certain neurons can substantially change behavior. The guide was inspired by justinrhowell’s neuron-steering repository without directly using its code. The author notes that some methods and results remain exploratory and personal, with no independent verification reported.
Developer suayptalha published a pure-Assembly implementation of Qwen3.5-0.8B covering tokenization, model inference and sampling, with no libc or Python required at runtime. On one AMD EPYC 7B12 thread, it reported 6.51 tokens per second versus 4.34 for Transformers, and all 32 generated tokens matched in the two-run greedy-decoding test. The Assembly version read BF16 weights, while the Transformers reference loaded FP32 weights and used PyTorch fallback kernels.
Transformers released patch version v5.22.2 with security and distributed-computing fixes, according to the release notes. The patch hardens Jinja sandboxing and sets device_id only for NCCL. Rocketknight1 contributed the sandboxing change, while Michael Benayoun and 3outeille contributed the NCCL change.
Reddit author /u/Rajucg published a seven-minute animated explainer that uses real Qwen2.5-0.5B-Instruct probabilities to illustrate softmax, greedy decoding, sampling, temperature, top-k and top-p. The video follows two completions of a moon-themed prompt, showing how the model scores all 151,936 vocabulary tokens after “The” and how different settings or random seeds can produce different sentences. The author says the measurements were run on CPU in Colab with Transformers and invites learners to flag errors.
Shishan AI Laboratory released Lion-ER-35B-A3B, an embodied reasoning vision-language model with about 35B total parameters and roughly 3B activated per token. The model team reports improvements across ten public embodied benchmarks using avg@4, with an equal-weight aggregate score of 65.29. Its BF16 Safetensors weights are available on Hugging Face and compatible with Transformers, vLLM and SGLang.
Pluto Security reported that the Load/Mine campaign distributed malicious repositories disguised as Qwen2 test models through Hugging Face, abusing the trust_remote_code=True option in Transformers. Researchers tracked 31 malicious repositories across seven Hugging Face accounts, 13 related models and 32,376 downloads; malicious instructions could run before model weights loaded without modifying the weights. After the first wave was removed, attackers added 19 repositories containing mining code, reverse shells and container-escape code, targeting self-hosted inference systems, GPU hosts, research notebooks and CI environments.
Hugging Face introduced transformers-mic, a proposed Model Integration Contract standard that combines reduced model fixtures, reproducible usage paths, and human-reviewed output baselines. The approach was motivated by a UMT5 regression that enabled future-token leakage during training; replaying the affected commits with a small CPU fixture detected the issue on every commit. The selected T5 contract's runner took 13.4 seconds on CPU, but the CI job currently reports failures without blocking pull requests.
Egzakta AI Lab released KVARK Sparkle 1.0, its first open-weight model, a 27B reasoning model based on Qwen3.8-27B. The developer team says it uses up to 67% fewer thinking tokens and responds roughly twice as fast as the original Qwen3.8-27B in its own testing, with a median response time of 13.7s versus 28.1s, while maintaining comparable accuracy across five standard benchmarks (GPQA Diamond, AIME, LiveCodeBench, IFEval and MMLU-Pro), with none of the accuracy differences statistically significant in that testing. The team also reports faster results on practical tasks such as dashboard generation (1.6x), landing page generation (1.4x) and an SVG illustration task (3.2x). Open weights are released under the Apache 2.0 license in BF16, FP8 and GGUF formats, supporting llama.cpp, vLLM, Transformers and SGLang, and the model is published on Hugging Face.
A JetBrains model card reposted on Reddit presents Mellum2.1 Thinking with a multi-token prediction (MTP) head, an additional transformer block trained to predict the token following the sampled one. The model card says inference engines can use it for speculative drafting while verifying every token, claiming 1.4–1.8x faster decoding and about 90% draft acceptance; support is listed for vLLM 0.33+, Transformers 5.20+, and llama.cpp.
Pluto Security’s analysis, reported by The Next Web, describes a cryptomining campaign on the Hugging Face Hub that executed Python code through the trust_remote_code=True model-loading path rather than an exploit. Malicious repositories presented themselves as small Qwen2 models and used imported Python modules to install persistence, open a reverse shell, download a disguised miner and report its status. Pluto Security found that repository scanners marked the plain Python payload as safe because it did not match a known malware signature or serialized-model format.
What problem it solves
Large language models can be difficult for individuals to train, deploy, or understand because of their scale and the abstractions used by many frameworks. The project addresses this by providing native PyTorch implementations, compact model structures, open datasets, and staged workflows for pretraining, fine-tuning, preference optimization, tool use, and agentic training.
…
What problem it solves
Real-world translation involves more than converting text between languages: tasks can require terminology, style, personalization, delimiter preservation, and structured-data constraints. Hy-MT2 is designed to support translation among 33 languages and follow translation instructions in multiple languages for complex real-world scenarios.
Key features
Instruction-driven tas…
What problem it solves
Machine learning workflows need a shared model definition so that models can work consistently across training frameworks, inference engines, and adjacent modeling libraries. Transformers centralizes these definitions and exposes a unified interface for loading pretrained models, running inference, and adapting model internals.
Key features
Broad Model Support — The framewor…
What problem it solves
Time-series forecasting requires models that can forecast univariate and multivariate series across different context lengths. Forecasters also need to incorporate optional covariates and produce quantile forecasts without requiring per-task tuning.
Key features
Univariate and multivariate forecasting — Forecast individual time series or multiple target variates from NumPy a…
What problem it solves
Deep learning models often need to be adapted for efficient deployment across different inference frameworks. Model Optimizer addresses this by providing a unified set of optimization techniques and export workflows for quantized checkpoints.
Key features
Post-training quantization — Compress models with quantization techniques available for Hugging Face, Megatron-Bridge, Di…
What problem it solves
This project provides simple PyTorch implementations of neural networks and related algorithms. These implementations are documented with explanations and rendered as side-by-side formatted notes to help readers understand the algorithms better.
Key features
PyTorch Implementations — The project provides implementations of neural networks and related algorithms using PyTorch…