New best story on Hacker News: Llama.cpp 30B runs with only 6GB of RAM now

Llama.cpp 30B runs with only 6GB of RAM now
504 by msoad | 140 comments on Hacker News.


Comments

Popular posts from this blog

New best story on Hacker News: Tell HN: Triplebyte reverses, emails apology

New best story on Hacker News: Launch HN: OutSail (YC W23) – Wingsails to reduce cargo ship fuel consumption