New best story on Hacker News: Llama.cpp 30B runs with only 6GB of RAM now

Llama.cpp 30B runs with only 6GB of RAM now
504 by msoad | 140 comments on Hacker News.


Comments

Post a Comment

Popular posts from this blog

New best story on Hacker News: Tell HN: Triplebyte reverses, emails apology

Tell HN: Triplebyte reverses, emails apology 610 by trianx | 387 comments on Hacker News. This just landed in my inbox. The discussion on hackernews ( https://ift.tt/3c2KiNO ) surely helped Triplebyte understand that it was a mistake to create public profiles of their users by default: Email by Triplebyte CEO, Ammon: --- Hi xxxxx, There’s no other way to put this--I screwed up badly. On Friday evening, I sent an email to you about a new feature called public Triplebyte profiles. We failed to think through the effects of this feature on our community, and made the profiles default public with an option to opt out. Many of you were rightfully angry. I am truly sorry. As CEO, this is my fault. I made this decision. Effective immediately, we are canceling this feature. You came to us with the goal of landing a great software engineering job. As part of that, you entrusted us with your personal, sensitive information, including both the fact that you are job searching as well as the resu...
Read more

New best story on Hacker News: Show HN: Calculator for US individual income tax, from 1970-present

Show HN: Calculator for US individual income tax, from 1970-present 466 by tmm1 | 146 comments on Hacker News. I wanted to share a simple web app I created recently, which lets you estimate income taxes owed in the US: https://taxsim.app All the calculations occur directly in the browser, and are powered by a Fortran program that has been converted to WASM using emscripten. This calculator was originally developed in the 1970s [1] by the non-profit National Bureau of Economic Research. NBER has been maintaining this F77 codebase for the last 50 years, and uses it primarily for academic research on tax policy. The Fortran source code itself is over 1MB of text, because it codifies both federal and all 50 states' tax laws for each of the last 62 years. I first learned about NBER TAXSIM [2] a few months ago via an interesting paper they published "Automatic Tax Filing: Simulating a Pre-Populated Form 1040" [3]. The Fortran code itself is not open-source, but is available ...
Read more

New best story on Hacker News: Show HN: I'm building an open-source Amazon

Show HN: I'm building an open-source Amazon 666 by theturtletalks | 190 comments on Hacker News. A couple of years ago, I had an interesting idea. What if there was a marketplace where all the underlying tech was open-source? The order management system, the storefront, customer support, etc. The marketplace would simply connect to the seller’s infra instead of locking them in. If, for some reason, the seller is removed from the marketplace, their software stays with them and they can continue accepting orders directly. This model can be used to disrupt any marketplace from AirBNB to UberEats: building tech for home renters and restaurants and later, leveraging that to build a competing marketplace. In 2019, I started building the first piece, Openship, an order management system that lets you source orders and fulfill them from anywhere. Now that that’s in stable release, next up is Openfront (an e-commerce platform for storefronts) and Opensupport (ticketing software for custo...
Read more