律師以 $9,450 將家用伺服器擴至 12 張二手 NVIDIA V100,讓 DeepSeek V4.1 Flash 全部專家常駐 GPU 記憶體
A lawyer spent $9,450 on 12 used NVIDIA V100 cards to hold every DeepSeek V4.1 Flash expert in GPU memory
一名律師花費 $9,450 將家用 AI 伺服器由 8 張卡擴至 12 張二手 NVIDIA Tesla V100 32GB,讓 DeepSeek V4.1 Flash 的 15,360 個路由專家以 4-bit NVFP4 全部常駐 GPU 記憶體。
📅 November 20, 2026 • Tom's Hardware
A lawyer who posts on r/LocalLLM as Nick Mermiges has expanded his home AI server from eight to twelve used NVIDIA Tesla V100 32GB cards, adding a third NVLink board of four GPUs. Per his post and GitHub write-up, covered by Tom's Hardware on November 20, 2026, the whole build cost $9,450. The machine now runs DeepSeek V4.1 Flash with all 15,360 routed experts resident in memory at 4-bit NVFP4, and his repo notes none of them were compressed further.
The memory math explains the third board. Eight 32GB cards offered about 254 GiB, while the NVFP4 experts alone need 278.9 GiB across 40 layers, per the builder's notes. Twelve cards lift total HBM2 memory to 384 GiB, so the full expert set fits without further shrinking. Before, he ran every expert at 2-bit precision and moved only the 5,949 most-used ones, about 38.7 percent, to NVFP4 until the slots filled.
There is a catch in where the speed comes from. The V100 dates to 2018, and its Volta chips have no FP4 or FP8 tensor cores, so every NVFP4 number is unpacked in software into half precision before use. Per Mermiges, the benefit appears because the cards read fewer bytes, not because they compute faster, and he writes that expert values equal the ones in DeepSeek's own release while other parts of the model use compact forms.
All performance figures here are self-reported by the builder. Per Mermiges, code generation reaches up to 184 tokens per second on a single stream, and long documents start answering in about half the time versus the previous eight-card build, which he calls the main improvement. He reports the first code token at 256K context in 58 seconds versus 108.4 seconds before, and prompt reading above 32K context at about 4,500 tokens per second versus 2,200 on the first build.
The limits are stated honestly. Code decoding is 23 percent faster at 1K context per his write-up, but he sees no real gains at 32K context and above. Reading a 128K file takes 28 seconds and a 256K file takes 185 seconds, and three parallel requests at 128K yield about 360 tokens per second on code or 213 on legal documents, per Mermiges.
He also says the machine beats published four-unit DGX Spark stacks at single-request decoding, by 15 to 45 percent on code, at about half the price of a three-unit Spark setup. Tuning helped too. He raised the power cap from 150 to 175 watts and lowered the clock cap from 1,522 to 1,452 MHz for a net performance gain, per his notes.
Why it matters. Discontinued 2018 silicon is running a 2026 model format through software workarounds, and the project shows budget local AI is often bound by memory bandwidth rather than compute. It remains a hobbyist machine with self-reported numbers, not an independent benchmark, and per his documentation the third board sits behind a separate PCIe switch whose second hop adds latency. For a lawyer reading long contracts locally, halving the wait for the first token may be worth every dollar of the $9,450.
Sources:
https://tomshardware.com/tech-industry/artificial-intelligence/lawyers-usd9-450-private-ai-server-of-12-used-nvidia-v100s-now-runs-every-deepseek-v4-1-flash-expert-at-4-bit-nvfp4-up-to-184-tokens-per-second-on-code-and-long-documents-start-answering-in-about-half-the-time
https://mezha.net/eng/news/mezha-268801830767cbc0b0dce67c_lawyer-s_-9-450_server
https://ameriledger.com/article/lawyer-s-9-450-private-ai-server-with-12-used-nvidia-v100s-now-runs-every
https://urgent.news/2026/11/20/lawyers-9-450-private-ai-server-with-12-used-nvidia-v100s-now-runs
https://technetbooks.com/2026/11/lawyer-builds-personal-ai-cluster-to.html
https://gate.com/news/detail/lawyer-upgrades-private-ai-server-to-12-nvidia-v100-gpus-for-deepseek-v41-25752904
Sources:
- https://tomshardware.com/tech-industry/artificial-intelligence/lawyers-usd9-450-private-ai-server-of-12-used-nvidia-v100s-now-runs-every-deepseek-v4-1-flash-expert-at-4-bit-nvfp4-up-to-184-tokens-per-second-on-code-and-long-documents-start-answering-in-about-half-the-time
- https://mezha.net/eng/news/mezha-268801830767cbc0b0dce67c_lawyer-s_-9-450_server
- https://ameriledger.com/article/lawyer-s-9-450-private-ai-server-with-12-used-nvidia-v100s-now-runs-every
- https://urgent.news/2026/11/20/lawyers-9-450-private-ai-server-with-12-used-nvidia-v100s-now-runs
- https://technetbooks.com/2026/11/lawyer-builds-personal-ai-cluster-to.html
- https://gate.com/news/detail/lawyer-upgrades-private-ai-server-to-12-nvidia-v100-gpus-for-deepseek-v41-25752904
Continue the conversation: https://t.me/AIAutomationArchitecture · Bluesky
來源:DEV Community · dev.to