New best story on Hacker News: Groq runs Mixtral 8x7B-32k with 500 T/s

Groq runs Mixtral 8x7B-32k with 500 T/s
527 by tin7in | 358 comments on Hacker News.


Comments

Post a Comment

Popular posts from this blog

New best story on Hacker News: Tell HN: Announcing tomhow as a public moderator

Tell HN: Announcing tomhow as a public moderator 1014 by dang | 320 comments on Hacker News. Hi all, Tom Howard is going public as HN moderator today. He has been doing HN moderation work for years already and knows the site and its practices inside-out, so the only new thing you'll see is mod comments from Tom showing up in the threads the way mine do. I'm not going anywhere, so you'll have two of us to put up with going forward :) I've known Tom since he was sctb's and my batchmate back in YC W09. Many of you know him as the kind and thoughtful community member tomhoward ( https://ift.tt/BzxpPRr ). He's still kind and thoughtful, but he's going to post as tomhow from now on ( https://ift.tt/J6TrcLU ), the same way I switched to dang when I went through this rite of passage years ago. Below is a bit from Tom about himself. Please join me in welcoming him to this new status which he was crazy enough to say yes to! --- YC and HN have been a huge part of my...
Read more