Yuyang Shi, Valentin De Bortoli, George Deligiannidis and Arnaud Doucet (2022), UAI 2022, PMLR 180 — ARXIV-2202.13460

Key takeaways

  • The construction. Conditional simulation, sampling p(x|y_obs) when only (X, Y) can be simulated, cannot use a bridge to the posterior directly, since the posterior cannot be sampled. The paper poses instead the bridge between the joint p(x, y) and p_ref(x|y)p(y), with y frozen along the path, and proves it is the average over y of the per- observation bridges (Proposition 1). Iterative proportional fitting then splits into conditional forward and backward chains in x, trainable with De Bortoli et al.’s Diffusion SB losses with y as an extra input (Proposition 2, Algorithm 1).
  • Refining the score model. The first IPF iteration is the conditional score-based model (CSGM); later ones correct its bias. The data-end error of the n-th iterate is at most 2/n times the KL from the initial noising process to the bridge (Proposition 3), which argues for a y-dependent forward process.
  • Informed references. The reverse process can start from an approximation to the posterior: an upsampled low-resolution image, an EnKF Gaussian, or a pre-trained SRFlow model, which a short bridge (N = 10) then refines (FID 30.92 to 15.00 on CelebA 8× super-resolution, at a small cost in PSNR).
  • Evidence. Sharper 2D posteriors than a monotone GAN; BOD posterior moments closer to MCMC than MGAN or inverse transport on most statistics; better image metrics than CSGM at equal small N in most but not all cells (Table 2); Lorenz-63 filtering at N = 20 where CSGM diverges, with the advantage gone at N = 100.
  • Limits the authors state: the minimal step count is unknown in practice, atypical observations are poorly served by amortization, and each filtering step solves a new bridge.

Standing in the record

Filed on 2026-10-09 at the owner’s request, as one of the works in the reference list of the owner’s working manuscript (October 2026) that the record did not yet hold. See the curation entry of that day. It is a machine-learning paper an anthology topic could hold (generative-modeling, analysis-and-evaluation), so it carries the anthology-candidate flag (ADR-005); it is here because the owner asked for the manuscript’s references to be filed in this record.