LocalLLaMA user asks how to restrict model web searches
A LocalLLaMA user asked how local-model applications can limit liability from unrestricted web searches performed through a user's internet connection. They suggested network tools such as OpenSnitch and uMatrix as possible mitigations and sought local apps that can whitelist domains or URLs, while saying Unsloth did not appear to support such controls.
The post highlights a practical security question for local AI applications: restricting where models with web-search access can send users.
It's well known that models can easily be manipulated into using its web search tool to look up anything using the user's internet connection. Doesn't this pose serious real-life risk for the user when the content is illegal to access? The risk is especially high for people living in jurisdictions with creative takes on the concept of justice.
This issue is impossible to solve cleanly but it can be mitigated (e.g. opensnitch, umatrix, ...etc).
How do you handle this issue? What tools do you using if any? Are there any local apps you use that allow you to whitelist entire domains or URLs?
I use unsloth and it doesn't seem to support this.
submitted by /u/-samka [link] [comments]