Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

c/tensorfold

TensorFold0 membersJoin discussion
Project infoashhart/TensorFold

About

LLM Inference Engine for Metal, CUDA and Vulkan.

Open sourceCreated November 12, 2026

Readme badge

Open-source project

Avatar from GitHubashhart/TensorFoldView on GitHub
Community-run · not official
Stars
2.1K
Forks
407
Language
Zig
License
Apache-2.0

Last commit Nov 14, 2026

Daily rank, last 30 days
  1. Nov 13: #7
  2. Nov 15: #9

Best #7 · Nov 13

TensorFold: A native language-model inference engine for serving checkpoints on Apple Silicon and NVIDIA GPUs.

What problem it solves Serving language models requires reading checkpoints, tokenizing requests, and running accelerated kernels while managing a local model server. TensorFold addresses these requirements with a native binary that can run on Apple Silicon and NVIDIA GPUs without requiring Python or MLX for serving. Key features Native Metal and CUDA inference — The Zig-based engine executes mode…

github.comhttps://github.com/ashhart/TensorFold