Support Tokens, Stability Margins, and a New Foundation for Robust LLMs
Reading causal self-attention as a probabilistic model surfaces a barrier constraint, a stability margin analogous to an SVM's, and the support tokens that sit on it. The training change is one log-barrier penalty added to cross-entropy.
Feb 25, 2026