Sharing a preview into a work I've been doing for a while, to get feedback. Still work in progress ourmodels.cc --> A database of sorts for open weight/local models, hardware, and other stuff, in a way I haven't seen elsewhere yet If you remember my earlier theoretical throughput limits work, I had created a calculator to show what throughput a certain @huggingface model can reach on e.g. DGX Spark You can now select your own hardware (e.g. DGX Spark), and then the website shows you the theoretical limits for each model you see I have improved the UX on that website, and combined it with a knowledge graph of tweets from this site, so that you can see all the commentary, benchmarks etc. about that model in one place! If you are the publisher or an enthusiast of a model, you will be able to go there and see what feedback people have posted about, it in one place It extracts topics as well, so you can see all llama.cpp related posts for example All from a curated set of creators (curated by me, that is) It currently has posts from the last 5-10 days, but I will work to expand that to months, based on the feedback I get here Let me know what you think! Whether you would like to see a certain feature! (fyi, every number you see on this website is a theoretical upper bound, not a submitted benchmark) Site: ourmodels.cc

Then it will show while visiting a model page, what decode tok/s to expect from that model. Here it is 28 tok/s for antirez/ds4