All topics

The best Local Llm Inference newsletters

1 newsletters, ranked by editorial quality and how recently they published. Looking for something more specific? Search instead.

blog.inrok.kr· irregular· KO· Published 17 days ago

A Seoul-based personal blog where the author documents hands-on experiments running open-weight LLMs such as Qwen on older and consumer GPUs, with practical details on vLLM and llama.cpp setups. It also covers AI architecture news like recurrent-depth models, plus occasional writing on family life and 3D printing.

qwen3qwen3.8vllmllama.cppp100rtx 6000 ada