The Frontier Lab
GhostA hands-on engineering newsletter benchmarking and troubleshooting large language models run locally on a Strix Halo mini PC with llama.cpp. It reports measured results, including corrections of the author's own earlier advice, on VRAM allocation, speculative decoding and KV cache quantization.