Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

LocalLLaMA user asks how to restrict model web searches

AI summary

A LocalLLaMA user asked how local-model applications can limit liability from unrestricted web searches performed through a user's internet connection. They suggested network tools such as OpenSnitch and uMatrix as possible mitigations and sought local apps that can whitelist domains or URLs, while saying Unsloth did not appear to support such controls.

In-depth insight

The post highlights a practical security question for local AI applications: restricting where models with web-search access can send users.

It's well known that models can easily be manipulated into using its web search tool to look up anything using the user's internet connection. Doesn't this pose serious real-life risk for the user when the content is illegal to access? The risk is especially high for people living in jurisdictions with creative takes on the concept of justice.

This issue is impossible to solve cleanly but it can be mitigated (e.g. opensnitch, umatrix, ...etc).

How do you handle this issue? What tools do you using if any? Are there any local apps you use that allow you to whitelist entire domains or URLs?

I use unsloth and it doesn't seem to support this.

submitted by /u/-samka [link] [comments]

#Unsloth#OpenSnitch#uMatrix

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.