Structure from the proxy, appearance from the first frame
A proxy sequence carries the layout, object classes and motion of a scene, at any level of detail. A reference first frame supplies its appearance. Each chapter below changes one input and holds the others fixed. Every clip on this page is model output, shown with the proxy that drove it.
01
Camera control
Each pair opens on one first frame of one scene, then the proxy flies two different routes: a dive down a glass tower, a dolly zoom on a bridge, a chase out of a tunnel, a drone beside a rocket launch. The video takes whichever route its proxy flies.
Fixed: first frame, scene Varies: camera route
02
World dynamics
The camera holds its path and the proxy changes what happens in the world. At an intersection, the cross traffic moves on one signal plan and the pedestrians cross on the other. At a bascule bridge, the two leaves lift and a cargo ship passes through, or the bridge stays shut and the traffic keeps flowing. The video follows each version of the proxy.
Fixed: first frame, camera Varies: motion in the scene
03
Proxy correspondence
Every element in the proxy lands at the same place in the video: the pillars, the temple and the figure through a dolly zoom, the colonnades and the statue of a sunken street as the camera rises to the sea surface, the parts of a motorcycle, the lamps of a car as the camera circles behind it. Fade the proxy over the output to compare them in place.
Fixed: one proxy and first frame per scene Varies: scene
04
Any granularity
One first frame and one camera route, with four proxies at different levels of detail. Each carries a different amount of scene structure into the video.
Fixed: first frame, camera route Varies: proxy granularity
05
Game demos
The same model renders game footage from game-engine proxies: a getaway down a coastal strip that drifts into a parking garage, a supercar dropped from a cargo plane onto a desert highway, a jet threading a red-rock canyon, an anti-gravity racer through a corkscrew and up a spiral ramp. Two bullet-time shots stop the world and move only the camera: a car bursting through a showroom window, and a city folding shut over the street.
Fixed: model, proxy style Varies: game, scene, motion
06
Play it live
Infra
Real-time streaming
The video is generated chunk by chunk, and the final pipeline delivers a chunk every 930 ms, 18.0 frames per second, 1.82× the 1770 ms baseline. Each chunk takes four denoising passes of the DiT on 8 GPUs (Ulysses8). The first pass is fused with the commit of clean history and proxy condition into the KV cache, which keeps a sink and a recent window and evicts the rest. Between DiT chunks, a lightweight TAE encodes the next proxy chunk while the decoder turns the current one into RGB, and a CPU worker delivers those frames while the DiT renders the next chunk.
8 GPUs · Ulysses8 Fused pass 1 + KV commit Concurrent encode / decode Async delivery
Citation
@misc{wang2026codeworldmodel20,
title = {Code World Model 2.0: Towards Infinite Controllable Video Generation},
author = {Ruoyu Wang and Hao Zhong and Yanming Yang and Jiahao Tian and Lin Liu and Biao Gong and Guoshan Lu and Yiding Tian and Chunhua Shen and Zhenzhong Lan and Chi Zhang},
year = {2026},
eprint = {2611.22925},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2611.22925}
}