Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Pumpkin open-sources a graphical manager for llama.cpp

AI summary

Developer u/gbolgurov published Pumpkin on GitHub as an open-source graphical manager that detects hardware, selects a compatible llama.cpp build and quantization, and finds models installed through LM Studio or Ollama. The developer says Pumpkin can reach a running model in about five minutes and adds chat, web search, tools, MCP servers, Claude-style skills, document questions and the Pumpkin Code coding agent. Image and short-video generation require a separate stable-diffusion.cpp installation, while phone support is claimed but not properly tested.

In-depth insight

Pumpkin packages llama.cpp setup, local-model discovery and agent features into a graphical interface aimed at users who may not be comfortable with terminal tools.

As the title says, my girlfriend needed a local model for privacy reasons, but her terminal skills are... nonexistent, so I made an all-in-one graphical manager for llama.cpp that gets you up and running in around 5 minutes. In my humble opinion, it turned out rather well, so I put it on GitHub, and I think it will help some of you who are either just staring out and haven't touched a terminal before or want an all-in-one manager for all your models with extra capabilities. Pumpkin looks at your hardware, downloads the right llama.cpp build and picks a quant that fits your GPU and RAM, so you go from install to a running model in a few clicks. It finds models you already have from LM Studio and Ollama, and gives you a chat with web search, tools, MCP servers, Claude-style skills and connectors for GitHub, Notion, Git, Postgres and more. Pumpkin Code is a coding agent that works in a folder you point it to and can ask before changing files or running commands. You can ask questions about your own documents, and attach pictures even to models that can't see (a small vision model describes them first). It also makes pictures and short videos through stable-diffusion.cpp (extra install), and works from your phone. It's a very early release and most of my testing is on Ubuntu and Mac. Windows and Android work, but I haven't tried them properly because I lack the hardware, so that's where I expect the rough edges. I'd really like to hear what breaks. You can find the project here: GitHub: https://github.com/geobellingham/pumpkin Disclamer: It’s open source and I am not trying to make money off of this. Posting this because I truly believe this will be useful so some of you :). submitted by /u/gbolgurov [link] [comments]

#Pumpkin#llama.cpp#LM Studio#Ollama#Pumpkin Code#stable-diffusion.cpp#MCP servers

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.