I’ve run this large LLM on an SBC cluster and it’s the most patchy setup I’ve ever built

Ever since I went down the local LLM rabbit hole, I’ve loved revitalizing old computers by turning them into reliable AI workstations. With the right tweaks, I’ve even managed to launch powerful LLMs that can compete with their cloud-based counterparts…













