Blog

Long-form essays on optimizer-induced spectral scaling laws, capacity-aware LLM design, and related topics.

• Architecture Creates Capacity, Optimizers Realize It June 26, 2026 · ~24 min read

  Why LLM scaling laws should account for realized capacity, not just loss curves and parameter counts

  scaling-laws optimization representation-learning llm-pretraining spectral-geometry
  Read the full essay →