Jetson AGX Orin 64GB
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Developer releases Strata fork for 64GB Jetson AGX Orin
A Reddit developer released a fork of Strata v0.1.45 for the 64GB Jetson AGX Orin, primarily to run Qwen3.6-35B-A3B. The developer reported about 21 tok/s decoding with MTP-3 in llama.cpp, around 30 tok/s in earlier Strata runs, and roughly 40–41 tok/s in controlled short-prompt tests with sampled MTP-2. The author said these were setup-specific results rather than matched llama.cpp-versus-Strata benchmarks. The fork also includes unified INT8 KV caching, prefix checkpoints and optional KV preallocation. The developer disclosed that it was heavily AI-assisted, said it had been tested on their Orin, and invited feedback from other owners.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my Jetson AGX Orin 64GB experienceAsk about Jetson AGX Orin 64GB
Nobody has shared their experience with Jetson AGX Orin 64GB yet.