Tom's Hardware发布LLM术语入门指南
Tom's Hardware发布了一份LLM术语入门指南,介绍模型、权重、词元、量化、上下文窗口、KV缓存、推理和投机解码等概念。文章聚焦聊天、编程和智能体机器人常用的文本LLM,并以NVIDIA RTX Spark等本地模型硬件作为背景。
这份指南为理解本地LLM部署及推理硬件报道中的常用术语提供了集中参考。
As hardware for running local AI models continues to move to the forefront, such as Nvidia's RTX Spark, a new set of acronyms, definitions, and terminology is popping up. Given the pace of releases, we've put together a list of AI's new nomenclature to familiarize you with new concepts and pieces of terminology that you'll likely see in Tom's Hardware Premium articles.
This primer should get you started on the world of AI and be handy the next time news on the topic comes around, and possibly when you're downloading some models to try out and tweak for yourself. For the context of this article, we're going to stick with notions related to text LLMs, or in common parlance, chat, programming, and most agentic bots.
Model
This is probably the easiest one: a model is the LLM itself (a Large Language Model), computed from training sets of mostly text data on the scale of terabytes to petabytes. That training information comes from the internet, books, video and audio transcripts, and other sources.
The model is roughly analogous to a set of highly advanced layers of statistical analysis of relationships between tokens — words or parts of words, computer code, punctuation, and other symbols. The tokens themselves aren't part of the model, but they are packaged along with it. An AI model generates tokens in its outputs.