一位用户的本地 AI 工具探索历程
在 r/LocalLLaMA 帖子中,/u/revennest 回顾了自己从 Ollama、LM Studio 和 Msty 转向 Oobabooga Text Generation-WebUI,随后尝试 KoboldCPP、Llamafile、llama.cpp、Open WebUI 与 SearXNG 的过程。作者称 Oobabooga 的易用性和深度定制能力让自己坚持使用本地 AI,并报告在 i5-6400T 迷你电脑上以约每秒 1 个 token 运行 Llama 3.1 8B。帖子还涵盖 Forge、ComfyUI、Unsloth Studio 和 audio.cpp 等后续尝试,但这些内容属于个人经历,而非系统性对比测试。
这份 firsthand 记录呈现了易用性、提示词处理和定制能力如何影响一名用户探索本地 AI 文本、图像与音频工具的过程。
Here is my timeline
Text Generation
Ollamabut quite have bad experience with it.LM studiowhich still feel half-bake at that time.Mstywhich easy to use like plug and play but not much I could do custom (or I just don't know at that time).Oobabooga Text Generation-Webuithis is the one that make me stick to AI, easy to use and deep custom; I like its function feature that take prompt as method/processed then input value in other prompt and then it just output an outcome, no chat history.
I run 1 - 4 with my mini pc with i5 6400T, 24GB DDR4 with onboard gpu... Llama 3.1 8B generate so slow at that time like 1 tok/s but I really enjoy using it with that very limited and the roleplay start from here, just my mini pc and Oobabooga Text Generation-Webui.
Also some missing thing I forgot at that time, I even mess around with windows WSL then docker for Open WebUI and SearXNG.
I finally can help but want it more so arise old gen pc, at that time DDR3 and thing relate to it is very cheap so I brought Xeon E3-1270 V2 with a Chinese mainboard and 32 GB DDR3 while I cancel the sell order of my GTX 1080 Ti.
#Ollama#LM Studio#Msty#Oobabooga Text Generation-WebUI#KoboldCPP#Llamafile#llama.cpp#Open WebUI#SearXNG#Llama 3.1 8B#Forge#ComfyUI