arxiv:2607.18198

Three-Body Scattering for Generative Modeling

Published on Jul 20

· Submitted by

Authors:

Abstract

Modern generative models typically rely on an adversarial critic, a prescribed noise-to-data path, or an autoregressive factorization. Instead, we show that a proper distributional energy can induce sample-level motion and provide direct regression supervision for a one-step generator. Three-Body Scattering Modeling (TBSM) for generation turns the energy distance into a constant-size per-projectile interaction: each projectile is attracted toward one real source and repelled from one independently generated source. Conditioned on the projectile and its condition, its expectation equals the 2-Wasserstein gradient-flow velocity of frac12D_E^2(P_θ,Q). A batch of B frozen-target events yields O(B) sample-level losses, each using one reference for its condition instead of the minibatch-wide all-pairs field used by methods such as Drifting Models. Tracking this conditional expectation online can reduce field noise. Using scattering in frozen image features, TBSM trains one-step generators on ImageNet-256, achieving FID{}=2.23 with pixel-space PixelDiT-XL and FID{}=1.63 with latent-space DiT-XL at NFE{}=1. We provide a design map relating diffusion-related supervision, Drift-like dynamics, and GAN-like objectives. These results establish tracked scattering as a route to high-dimensional one-step generation. Code: https://github.com/sp12138/TBSM.

View arXiv page View PDF GitHub 39 Add to collection

Community

sp12138sp

Paper submitter 1 day ago

We introduce Three-Body Scattering Modeling (TBSM), a new framework for one-step generative modeling that learns a transport field from the generated distribution toward the real data distribution.

Unlike GANs that rely on adversarial discrimination, diffusion models that follow predefined denoising trajectories, or distillation methods that require teacher models, TBSM learns a tracked scattering field to estimate how generated samples should move toward real samples. The learned tracker directly provides optimization guidance for the generator, enabling stable training of one-step and few-step generative models.

TBSM achieves strong performance on challenging image generation benchmarks. On ImageNet-256, TBSM-trained one-step generators achieve competitive generation quality with NFE=1, including FID 2.23 with pixel-space PixelDiT-XL and FID 1.63 with latent-space DiT-XL. Beyond standard image generation, TBSM demonstrates stable training of large-scale text-to-image models with up to 20B parameters, achieving one-step and few-step generation without additional auxiliary losses.

Beyond a new training algorithm, TBSM provides a new perspective for understanding the relationships among several major generative paradigms. By viewing generation through the lens of distributional transport fields, TBSM reveals connections among GANs, diffusion models, and drifting-based approaches.

Here we provide:

🎨 One-step generation visualizations from TBSM-trained models
🗺️ A design map illustrating the connections among existing generative modeling paradigms
🎬 An introduction video explaining the TBSM framework

We hope TBSM offers a simple and scalable perspective toward efficient generative modeling.