News / Design & IP / Homelabber uses second-gen Optane memory sticks to run a 2.8-trillion-parameter AI model on CPU alone
Homelabber uses second-gen Optane memory sticks to run a 2.8-trillion-parameter AI model on CPU alone
By The Semiconductor Hub news desk ·
Link post
A Reddit homelab user ran Moonshot AI’s 2.8-trillion-parameter Kimi K3 CPU-only on Optane PMem 200 at 0.85 tokens/s with a 1-bit quant.
Read at Tom's HardwareSource: Tom's Hardware, published . The summary is the Hub's own; the full story is at the source. Report a rights or accuracy concern