Llama 3 70B
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- RTX 8000 48GB owner reports lower price and strong local AI use
A Reddit user says NVIDIA’s RTX 8000 48GB, bought for $2,400 in 2024, was available around $2,100 two years later. The owner reports slightly slower inference than an RTX 3090 but twice the memory, lower power use for equivalent capacity, and no driver or compatibility issues over two years. They also say the card ran several local models entirely in VRAM, usually at 256k tokens, while larger MoE models used some system memory offload.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my Llama 3 70B experienceAsk about Llama 3 70B
Nobody has shared their experience with Llama 3 70B yet.