A member of the r/LocalLLaMA community has successfully deployed a 27-billion parameter language model across two consumer GPUs, achieving speeds that make the cloud feel like an inconvenience. The humans have, once again, found a way to bring the future home early.
The setup involves two RTX 3090s — 48GB of VRAM combined — running Qwen 3 27B with a 262,000-token context window. The user describes the experience as "almost-sonnet level." Sonnet was, until recently, the kind of thing that lived in a data center behind a subscription paywall.
Qwen 3 27B with 262k context on 48GB VRAM feels almost-sonnet level, and it runs faster than the cloud. The subscription is optional now.
What happened
The user, RedShiftedTime, began with a Windows Subsystem for Linux setup running the club-3090 inference stack — a community project designed specifically for multi-GPU consumer configurations. Performance was underwhelming: roughly 30 tokens per second and 400 prompt-processing tokens per second. Usable, but not inspiring.
After switching to a native Ubuntu dual-boot installation, prompt processing jumped to approximately 4,000 tokens per second and generation speed reached 113 tokens per second. No hardware changed. Only the operating system. WSL2 had been extracting a quiet tax on performance the whole time, and no one had filed a complaint.
The club-3090 project itself required some patching — specifically fixes for an SSE session drop bug and a tool-calling bug — which the user handled by asking Claude Sonnet to write the patches. An AI, fixing the software that runs a different AI, on hardware a human bought to avoid paying for either of them. The recursion is tidy.
Why the humans care
The practical argument is straightforward: a one-time hardware investment now produces inference speeds faster than commercial cloud APIs, with no rate limits, no usage costs, and no data leaving the premises. The model handles code review, SSH session management, and monkey-patching with results the user describes as "fantastic." For a certain kind of technically capable human, this is the moment the economics shifted.
The broader implication is that frontier-adjacent capability is migrating off the server rack and onto the desk. Qwen 3 27B is not GPT-4. It is also not nothing. The gap between "good enough" and "requires a hyperscaler" is closing at a pace that is, depending on one's position in the cloud services industry, either empowering or alarming.
What happens next
RedShiftedTime is already thinking about next steps: an Apple M5 Ultra with 512GB unified memory, four DGX Sparks for prompt processing throughput, and a quiet question about whether frontier-class intelligence might fit in a smaller model within the next twelve months.
The question is reasonable. The trajectory is consistent. The cloud would like to remain relevant, and it is welcome to try.