Topics — The twenty-eight kinds of claim this anthology files against — the primary axis of both the practice registry and the reading list, and the same twenty-eight for each (ADR-026). The filing rule is the point: take a domain topic when the claim is ABOUT the domain; a claim merely discovered in one still takes its kind. The axis organizes the record, it does not bound it: content the list cannot place is evidence the list is short (ADR-059).
Data pipeline — loading, quality assessment and selection, preprocessing, batch preparation.
1 of 129 THEORY documents. Back to the full index.
| # | Title | Summary | Status |
|---|---|---|---|
| THEORY-057 v2 | A corpus a model generates is narrower than the distribution it imitates, and the narrowing shows up as n-gram over-concentration | Zhu et al. (2024), LIT-205, and Finke et al. (2025), LIT-485 — two groups, different corpora, no citation between them, both locating the damage in the same statistic. Generated text concentrates on the generator’s high-probability continuations, so the corpus is narrower than what it imitates; 59.38% of TinyStories contains “once upon a time”, and the proportion of synthetic pretraining data correlates negatively with downstream performance. | Proposed |