Topics — The twenty-eight kinds of claim this anthology files against — the primary axis of both the practice registry and the reading list, and the same twenty-eight for each (ADR-026). The filing rule is the point: take a domain topic when the claim is ABOUT the domain; a claim merely discovered in one still takes its kind. The axis organizes the record, it does not bound it: content the list cannot place is evidence the list is short (ADR-059).
Distributed optimization — parallelism and sharding, communication, memory management, checkpointing.
1 of 129 THEORY documents. Back to the full index.
| # | Title | Summary | Status |
|---|---|---|---|
| THEORY-014 | The outer optimizer is what buys the inner step count | Three papers in this record prescribe how many steps a worker takes between synchronisations, and they differ by a factor of thirty: LIT-362 says 16 to 32, LIT-373 says 12 to 48, LIT-212 says 500. They are not disagreeing about the same quantity. The two with small intervals average parameters and stop there; the one with a large interval runs Nesterov momentum over the accumulated deltas, and its own ablation reports that plain averaging at that interval performs poorly. The interval is not a constant to transfer. It is bought, and the outer optimizer is what pays for it. | Proposed |