自托管开放权重模型何时比API更便宜?
OpenRouter Blog 的测算显示,GPU租赁成本通常只有在流量足以维持较高利用率时,才会低于API费用。按2026年10月8日的价格,DeepSeek V4.1 Flash部署在四张租用H200上时,相较最便宜的零数据保留端点始终无法达到盈亏平衡;Qwen3.8 27B部署在一张租用RTX 3090上时,约在6%至12%负载下达到平衡。估算未计入工程时间和峰值备用容量,因此属于下限,而API价格也可能快速变化。
这项分析为开发者提供了比较开放权重模型自托管与API服务的实用方法,同时表明利用率、令牌组合、供应商定价和硬件吞吐量都会影响更划算的选择。
Self-Hosted LLM vs API: When Does Self-Hosting Pay Off
OpenRouter ·11/12/2026


If you pay an API bill for an open-weight model, you may wonder whether your own GPU would cost less. GPU rent is charged every hour, busy or idle, while an API charges only for the tokens you use.
A self-hosted LLM costs less only when your traffic keeps the GPU busy enough of the time. At October 8, 2026 prices, a 27B model on one rented RTX 3090 breaks even at about 12% load, while a large mixture-of-experts model on rented H200s never beats the cheapest zero-data-retention (ZDR) API endpoint.
#OpenRouter#DeepSeek V4.1 Flash#Qwen3.8 27B#NVIDIA H200#NVIDIA B200#NVIDIA RTX 3090#InferenceX