Enfold: Folding World Model Imagination into Predictive Representations for Ultra-Efficient Embodied Control
Abstract
World generative models are typically used through what they produce: a rendered future, a video-conditioned action, or latent context computed by a costly generative branch. We argue that their more reusable asset is the computation that constructs a future. As a generator transforms a corrupted future into a coherent trajectory, its intermediate states organize appearance, spatial layout, and interaction across levels of abstraction. Can this future-generative computation be internalized in a representation inferred from the present alone? We present Enfold, which transfers this computation into a representation predicted from the current visual context and language instruction. During training, multi-level states exposed as the generator processes the observed future supervise a current-only encoder. The learned representation is fed back to condition future generation and is read by task heads without allowing task gradients to reshape the encoder. At deployment, action prediction no longer executes the generator. Across LIBERO, RoboTwin2.0, and real-robot tasks, Enfold supports strong control while reducing action latency by 3.7times relative to Fast--WAM, Enfold-Flash reaches 10.1times. Representation analyses show that it suppresses nuisance variation and preferentially captures changes that emerge over longer horizons. When the current scene is altered by human intervention, both the generated continuation and the executed actions adapt, which is inconsistent with fixed trajectory replay. These results recast a world generator as a source of predictive control representations: its future need not be materialized at every step if its internal structure can be enfolded into the present.
Community
🚀 Enfold: Folding World Model Imagination into Predictive Representations for Ultra-Efficient Embodied Control
Do world models really need to generate a future at every control step?
Enfold explores a different idea: the most reusable asset of a world generator may not be the future it produces, but the computation that constructs that future.
During training, Enfold transfers multi-level future-generative states into a predictive representation inferred from the current observation and instruction alone. At deployment, action prediction no longer runs the world generator.
Highlights:
• 97.8% on LIBERO
• 92.02% on RoboTwin2.0
• 49 ms action latency with Enfold-Flash
• Up to 10.1× lower latency than generation-based world-action modeling
• Real-robot experiments with OOD scenes and human perturbations
The broader question we hope to explore:
Can imagination be internalized into representation rather than repeatedly materialized at inference?
Paper: arXiv:2607.26657
Code: github.com/zwl666666/enfold
Project: zwl666666.github.io/enfold
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies (2026)
- SG-WAM: Self-Guided World Modeling in Geometry-Aware Policy Space (2026)
- LiLa-WAM: Lightweight Latent Reasoning World-Action Model for Robotic Manipulation (2026)
- Learning 4D Geometric Priors for Inference-Efficient World Action Models (2026)
- DreamWAM: Beyond RGB Future Prediction for World Action Models (2026)
- EDAR: Learning Environment-Dependent Action Representations for Robotic Manipulation (2026)
- ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing? (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2607.26657 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper