【帖子标题】：You can now run a 90M conversational LLM on the Sony PSP (hardware from 2004). Doesn’t get more local than this. 【帖子标题】：你现在可以在索尼PSP（2004年的硬件）上运行9000万参数的对话式大语言模型了。再没有比这更本地的了。
【帖子正文】： Github link: 【帖子正文】： Github链接：
https://github.com/thatblend/LLMPSP https://github.com/thatblend/LLMPSP
I wanted to see what the PSP can theoretically handle and I got my answer - a 90M model is about the max it can do without atrocious inference speeds. It’s running around 0.5 - 0.6 tokens per second, which is very slow, but it’s useable. Maybe 1-3 minutes for a reply. 我想测试PSP的理论性能极限，结果发现9000万参数模型已是它能流畅运行的极限——再大会导致推理速度暴跌。目前每秒约处理0.5-0.6个token，虽然极慢但勉强可用。生成回复可能需要1-3分钟。
The model is actually fairly impressive for 90M parameters, it’s not really useful in any real metric, but it can generate crappy poems, short stories, write non-functional code and sometimes it gets things right if you ask it what company makes macbooks, what is an LLM etc, while other times it just hallucinates a crazy answer. Fun. 这个9000万参数的模型表现其实令人惊喜，虽然实际应用价值有限，但能生成打油诗、小故事、无法运行的代码。当你问”谁生产MacBook”或”什么是LLM”时偶尔能答对，但有时也会胡言乱语给出疯狂答案。有趣。