Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Reddit user plans local AI server with 24GB RTX 3090

AI summary

A Reddit user said they bought an EVGA RTX 3090 FTW3 with 24GB of memory for $1,100 to expand local AI workloads beyond the 12GB capacity of an RTX 4070. They plan to install it in a headless Ubuntu Server 26.04 LTS system that serves Ling-3.0-tiny, Omnivoice, Parakeet, coding inference, and other home-lab services over a LAN. The post asks for advice on long-context coding models, on-demand model swapping, and managing the FTW3's Linux power and thermal settings without EVGA Precision X1. The seller's claims about low use and no mining or AI workloads were not independently verified.

In-depth insight

The proposed build provides a concrete example of moving local AI inference from a 12GB gaming GPU to a separate server with 24GB of VRAM, while seeking solutions for model serving and hardware management.

Hey all,

I just picked up an EVGA RTX 3090 FTW3 (24GB) for $1,100 from a friend who is switching to an RTX 5070 Ti for pure gaming. It has low hours on it: no mining, no AI compute, just casual desktop use. He bought it for the prestige and never really pushed it.

Right now, everything local runs directly on my daily gaming rig with a single RTX 4070 (12GB):

  • LLM / assistant: Ling-3.0-tiny
  • Voice (STT/TTS): Omnivoice (Design + Cloning) plus Parakeet

12GB does not stretch far across all of that once I want a usable context window. On top of that, killing background inference pipelines every time I launch a game got old fast.

So the 3090 is going into my server box instead:

#EVGA#NVIDIA#RTX 3090 FTW3#RTX 5070 Ti#RTX 4070#Ling-3.0-tiny#Omnivoice#Parakeet#Ubuntu Server 26.04

Original · 2 min readRead the original
Group chat

No comments yet. Start the conversation.