Entries for September 23, 2026

That old macbook with 8gb unified memory or windows gaming laptop of yours can now be your fully local and private AI server Customer data. Client emails. Health records that you cannot just paste into chatgpt Now you can give them to your local AI however you like! Connect the laptop to your tailscale network Download Bonsai 2 27b and its llama.cpp build (might take some days/weeks for official llama.cpp to support it) Launch llama.cpp with 16k context and concurrency=1 Launch pi, login as llama.cpp and input the ip address and port of the server on your tailscale network Enjoy completely legal, risk-free, sovereign AI at 8-10 tok/s or maybe even higher (depends on your machine, if it has a small gpu or not) Tutorial on this coming very soon!

Don't sleep on this model everyone, this is SOTA for <= 16GB memory for inference (which is a LOT of people, old M series macbooks, gaming laptops and such)