Post
-
Turn an old laptop into a private local AI server
That old macbook with 8gb unified memory or windows gaming laptop of yours can now be your fully local and private AI server Customer data. Client emails. Health records that you cannot just paste into chatgpt Now you can give them to your local AI however you like! Connect the laptop to your tailscale network Download Bonsai 2 27b and its llama.cpp build (might take some days/weeks for official llama.cpp to support it) Launch llama.cpp with 16k context and concurrency=1 Launch pi, login as llama.cpp and input the ip address and port of the server on your tailscale network Enjoy completely legal, risk-free, sovereign AI at 8-10 tok/s or maybe even higher (depends on your machine, if it has a small gpu or not) Tutorial on this coming very soon!