qwen3_5-assembly
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Developer Runs Qwen3.5-0.8B Inference in Pure Assembly
Developer suayptalha published a pure-Assembly implementation of Qwen3.5-0.8B covering tokenization, model inference and sampling, with no libc or Python required at runtime. On one AMD EPYC 7B12 thread, it reported 6.51 tokens per second versus 4.34 for Transformers, and all 32 generated tokens matched in the two-run greedy-decoding test. The Assembly version read BF16 weights, while the Transformers reference loaded FP32 weights and used PyTorch fallback kernels.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my qwen3_5-assembly experienceAsk about qwen3_5-assembly
Nobody has shared their experience with qwen3_5-assembly yet.