Back

Thonk From First Principles

Substack
thonking.ai· irregular· Inactive for over a year

A technical newsletter on machine learning systems, covering GPU performance, PyTorch internals and kernel-level behavior, written by a PyTorch engineer. It also includes personal career reflections and posts on new APIs such as FlexAttention.

pytorchflexattentiongpucudamatmulcutlasscublasflashattentionml systemsperformance engineeringthinking machines
Platform
Substack
Frequency
Irregular
Latest issue
Mar 4, 2025
Language
English
Written for
ML engineers and researchers interested in systems and GPU performance
Tone
analytical
Tracked since
Oct 24, 2026

Website: https://www.thonking.ai