RC RANDOM CHAOS

Run 125B AI Model on Gaming PC with Strata

· via Hacker News

Original source

Run Qwen 3.8 Flash Next (125B) on consumer hardware (RTX 4090) at 100T/s

Hacker News →

Strata allows running the 125-billion-parameter Qwen3.8-Flash-Next AI model on consumer hardware, such as NVIDIA or AMD graphics cards with 12GB or more VRAM. The model, typically requiring a server, can now operate locally on a gaming PC, handling tasks like chatting, coding, and image analysis without sending data off the device. Performance tests on standard gaming PCs show the model can process about 60 tokens per second, which is faster than human reading speed. Strata is free, open-source, and supports multi-GPU setups, making it accessible for various hardware configurations, including older graphics cards and Intel Arc GPUs.

Read the full article

Continue reading at Hacker News →

This is an AI-generated summary. Read the original for the full story.