中文
相关论文

相关论文: SANA-WM: Efficient Minute-Scale World Modeling wit…

200 篇论文

We present StereoWorld, a camera-conditioned stereo world model that jointly learns appearance and binocular geometry for end-to-end stereo video generation.Unlike monocular RGB or RGBD approaches, StereoWorld operates exclusively within…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Yang-Tian Sun , Zehuan Huang , Yifan Niu , Lin Ma , Yan-Pei Cao , Yuewen Ma , Xiaojuan Qi

World models are a powerful paradigm in AI and robotics, enabling agents to reason about the future by predicting visual observations or compact latent states. The 1X World Model Challenge introduces an open-source benchmark of real-world…

Scaling generative inverse and forward rendering to real-world scenarios is bottlenecked by the limited realism and temporal coherence of existing synthetic datasets. To bridge this persistent domain gap, we introduce a large-scale, dynamic…

计算机视觉与模式识别 · 计算机科学 2026-04-03 Zheng-Hui Huang , Zhixiang Wang , Jiaming Tan , Ruihan Yu , Yidan Zhang , Bo Zheng , Yu-Lun Liu , Yung-Yu Chuang , Kaipeng Zhang

Pretrained foundation models have become an important basis for end-to-end autonomous driving. In contrast to vision-language models pretrained primarily on static image-text pairs, video generative models capture temporal dynamics and…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Chen Shi , Jinrui Xu , Shaoshuai Shi , Kehua Sheng , Bo Zhang , Li Jiang

The Terahertz band is envisioned to meet the demanding 100 Gbps data rates for 6G wireless communications. Aiming at combating the distance limitation problem with low hardware-cost, ultra-massive MIMO with hybrid beamforming is promising.…

信息论 · 计算机科学 2021-06-11 Yuhang Chen , Longfei Yan , Chong Han

We introduce Home-made Diffusion Model (HDM), an efficient yet powerful text-to-image diffusion model optimized for training (and inferring) on consumer-grade hardware. HDM achieves competitive 1024x1024 generation quality while maintaining…

计算机视觉与模式识别 · 计算机科学 2025-09-09 Shih-Ying Yeh

Despite remarkable progress in Single Image Super-Resolution (SISR), traditional models often struggle to generalize across varying scale factors, limiting their real-world applicability. To address this, we propose a plug-in Scale-Aware…

计算机视觉与模式识别 · 计算机科学 2026-01-14 Dongsik Yoon , Jongeun Kim

World models are essential for autonomous robotic planning. However, the substantial computational overhead of existing dense Transformerbased models significantly hinders real-time deployment. To address this efficiency-performance…

计算机视觉与模式识别 · 计算机科学 2026-03-06 Shicheng Yin , Kaixuan Yin , Weixing Chen , Yang Liu , Guanbin Li , Liang Lin

World-Action Models (WAM) initialized from pre-trained video generation backbones have demonstrated remarkable potential for robot policy learning. However, existing approaches face two critical bottlenecks that hinder performance and…

For the deployment of neural networks in resource-constrained environments, prior works have built lightweight architectures with convolution and attention for capturing local and global dependencies, respectively. Recently, the state space…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Sanghyeok Lee , Joonmyung Choi , Hyunwoo J. Kim

Generative driving world models rely on compact latent state representations that must be efficiently transmitted and synchronized across distributed compute and connected vehicles. We study network-efficient streaming of a discrete world…

机器人学 · 计算机科学 2026-05-12 Shatadal Mishra , Ahmadreza Moradipari , Nejib Ammar

World Action Models (WAMs) have emerged as a promising paradigm for robot control by modeling physical dynamics. Current WAMs generally follow two paradigms: the "Imagine-then-Execute" approach, which uses video prediction to infer actions…

机器人学 · 计算机科学 2026-05-12 Qiuxuan Feng , Jiale Yu , Jiaming Liu , Yueru Jia , Zhuangzhe Wu , Hao Chen , Zezhong Qian , Shuo Gu , Peng Jia , Siwei Ma , Shanghang Zhang

Efficient modeling of long sequences of high-order data requires a more efficient architecture than Transformer. In this paper, we investigate two key aspects of extending linear recurrent models, especially those originally designed for…

机器学习 · 计算机科学 2025-08-19 Yibo Zhong

Two factors have proven to be very important to the performance of semantic segmentation models: global context and multi-level semantics. However, generating features that capture both factors always leads to high computational complexity,…

计算机视觉与模式识别 · 计算机科学 2021-03-11 Qi Song , Kangfu Mei , Rui Huang

World models aim to understand, remember, and predict dynamic visual environments, yet a unified benchmark for evaluating their fundamental abilities remains lacking. To address this gap, we introduce MIND, the first open-domain closed-loop…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Yixuan Ye , Xuanyu Lu , Yuxin Jiang , Yuchao Gu , Rui Zhao , Qiwei Liang , Jiachun Pan , Fengda Zhang , Weijia Wu , Alex Jinpeng Wang

We introduce SlowFast-LLaVA-1.5 (abbreviated as SF-LLaVA-1.5), a family of video large language models (LLMs) offering a token-efficient solution for long-form video understanding. We incorporate the two-stream SlowFast mechanism into a…

计算机视觉与模式识别 · 计算机科学 2025-03-28 Mingze Xu , Mingfei Gao , Shiyu Li , Jiasen Lu , Zhe Gan , Zhengfeng Lai , Meng Cao , Kai Kang , Yinfei Yang , Afshin Dehghan

Action-conditioned video prediction models (often referred to as world models) have shown strong potential for robotics applications, but existing approaches are often slow and struggle to capture physically consistent interactions over…

World models have become central to autonomous driving, where accurate scene understanding and future prediction are crucial for safe control. Recent work has explored using vision-language models (VLMs) for planning, yet existing…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Zhexiao Xiong , Xin Ye , Burhan Yaman , Sheng Cheng , Yiren Lu , Jingru Luo , Nathan Jacobs , Liu Ren

State-of-the-art transformer-based large multimodal models (LMMs) struggle to handle hour-long video inputs due to the quadratic complexity of the causal self-attention operations, leading to high computational costs during training and…

计算机视觉与模式识别 · 计算机科学 2025-07-17 Weiming Ren , Wentao Ma , Huan Yang , Cong Wei , Ge Zhang , Wenhu Chen

Despite impressive progress in video generation, existing models remain limited to surface-level plausibility, lacking a coherent and unified understanding of the world. Prior approaches typically incorporate only a single form of…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Boming Tan , Xiangdong Zhang , Ning Liao , Yuqing Zhang , Shaofeng Zhang , Xue Yang , Qi Fan , Yanyong Zhang