All topics

The best Benchmarking newsletters

2 newsletters, ranked by editorial quality and how recently they published. Looking for something more specific? Search instead.

thefrontierlab.ai· weekly· Published 2 months ago

A hands-on engineering newsletter benchmarking and troubleshooting large language models run locally on a Strix Halo mini PC with llama.cpp. It reports measured results, including corrections of the author's own earlier advice, on VRAM allocation, speculative decoding and KV cache quantization.

llama.cppstrix halolocal llmspeculative decodingkv cache quantizationvram carveout
blog.farmgpu.com· irregular· Published yesterday

A company blog from a GPU cloud (neocloud) operator covering AI storage benchmarks, KV-cache hardware designs and open infrastructure work. Readers get detailed system configurations, MLPerf Storage results with stated caveats, and notes from OCP community efforts.

mlperf storagekv cacheneocloudnvmeqlc ssdweka