English
Related papers

Related papers: WISA: World Simulator Assistant for Physics-Aware …

200 papers

Recent breakthroughs in Vision-Language (V&L) joint research have achieved remarkable results in various text-driven tasks. High-quality Text-to-video (T2V), a task that has been long considered mission-impossible, was proven feasible with…

Artificial Intelligence · Computer Science 2022-11-28 Yuxing Qiu , Feng Gao , Minchen Li , Govind Thattai , Yin Yang , Chenfanfu Jiang

Text-to-Image (T2I) models are capable of generating high-quality artistic creations and visual content. However, existing research and evaluation standards predominantly focus on image realism and shallow text-image alignment, lacking a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Yuwei Niu , Munan Ning , Mengren Zheng , Weiyang Jin , Bin Lin , Peng Jin , Jiaqi Liao , Chaoran Feng , Kunpeng Ning , Bin Zhu , Li Yuan

While generative video models have achieved remarkable visual fidelity, their capacity to internalize and reason over implicit world rules remains a critical yet under-explored frontier. To bridge this gap, we present RISE-Video, a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Mingxin Liu , Shuran Ma , Shibei Meng , Xiangyu Zhao , Zicheng Zhang , Shaofeng Zhang , Zhihang Zhong , Peixian Chen , Haoyu Cao , Xing Sun , Haodong Duan , Xue Yang

Recent advancements in text-to-video (T2V) diffusion models have enabled high-fidelity and realistic video synthesis. However, current T2V models often struggle to generate physically plausible content due to their limited inherent ability…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Xiangdong Zhang , Jiaqi Liao , Shaofeng Zhang , Fanqing Meng , Xiangpeng Wan , Junchi Yan , Yu Cheng

Driven by the growing capacity and training scale, Text-to-Video (T2V) generation models have recently achieved substantial progress in video quality, length, and instruction-following capability. However, whether these models can…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Zeqing Wang , Keze Wang , Lei Zhang

Generative AI models, particularly Text-to-Video (T2V) systems, offer a promising avenue for transforming science education by automating the creation of engaging and intuitive visual explanations. In this work, we take a first step toward…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Megha Mariam K. M , Aditya Arun , Zakaria Laskar , C. V. Jawahar

Video-based spatial cognition is vital for robotics and embodied AI but challenges current Vision-Language Models (VLMs). This paper makes two key contributions. First, we introduce ViCA (Visuospatial Cognitive Assistant)-322K, a diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Qi Feng

Text-to-video (T2V) models like Sora have made significant strides in visualizing complex prompts, which is increasingly viewed as a promising path towards constructing the universal world simulator. Cognitive psychologists believe that the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Fanqing Meng , Jiaqi Liao , Xinyu Tan , Wenqi Shao , Quanfeng Lu , Kaipeng Zhang , Yu Cheng , Dianqi Li , Yu Qiao , Ping Luo

Text-to-video generative models have made significant strides in recent years, producing high-quality videos that excel in both aesthetic appeal and accurate instruction following, and have become central to digital art creation and user…

Machine Learning · Computer Science 2025-05-02 Xuyang Guo , Jiayan Huo , Zhenmei Shi , Zhao Song , Jiahao Zhang , Jiale Zhao

Autonomous driving requires robust perception models trained on high-quality, large-scale multi-view driving videos for tasks like 3D object detection, segmentation and trajectory prediction. While world models provide a cost-effective…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Zhuoran Yang , Xi Guo , Chenjing Ding , Chiyu Wang , Wei Wu

Interactive world models that simulate object dynamics are crucial for robotics, VR, and AR. However, it remains a significant challenge to learn physics-consistent dynamics models from limited real-world video data, especially for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Yu Yang , Zhilu Zhang , Xiang Zhang , Yihan Zeng , Hui Li , Wangmeng Zuo

Recent advances in Video-to-Audio (V2A) generation have achieved impressive perceptual quality and temporal synchronization, yet most models remain appearance-driven, capturing visual-acoustic correlations without considering the physical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Oh Hyun-Bin , Yuhta Takida , Toshimitsu Uesaka , Tae-Hyun Oh , Yuki Mitsufuji

This is a short technical report describing the winning entry of the PhysicsIQ Challenge, presented at the Perception Test Workshop at ICCV 2025. State-of-the-art video generative models exhibit severely limited physical understanding, and…

We introduce [Cosmos-Predict2.5], the latest generation of the Cosmos World Foundation Models for Physical AI. Built on a flow-based architecture, [Cosmos-Predict2.5] unifies Text2World, Image2World, and Video2World generation in a single…

Text-to-video (T2V) models have shown remarkable performance in generating visually reasonable scenes, while their capability to leverage world knowledge for ensuring semantic consistency and factual accuracy remains largely understudied.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Yubin Chen , Xuyang Guo , Zhenmei Shi , Zhao Song , Jiahao Zhang

Modern video diffusion models excel at appearance synthesis but still struggle with physical consistency: objects drift, collisions lack realistic rebound, and material responses seldom match their underlying properties. We present PhyCo, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Sriram Narayanan , Ziyu Jiang , Srinivasa Narasimhan , Manmohan Chandraker

Training AI agents to proactively assist humans in daily activities, from routine household tasks to urgent safety situations, requires large-scale visual data. However, capturing such scenarios in the real world is often difficult, costly,…

Computation and Language · Computer Science 2026-05-12 Yu-Hsiang Liu , Yu-Chien Tang , An-Zi Yen

Despite thousands of researchers, engineers, and artists actively working on improving text-to-image generation models, systems often fail to produce images that accurately align with the text inputs. We introduce TIFA (Text-to-Image…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Yushi Hu , Benlin Liu , Jungo Kasai , Yizhong Wang , Mari Ostendorf , Ranjay Krishna , Noah A Smith

Video generative models pre-trained on large-scale internet datasets have achieved remarkable success, excelling at producing realistic synthetic videos. However, they often generate clips based on static prompts (e.g., text or images),…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Haoran He , Yang Zhang , Liang Lin , Zhongwen Xu , Ling Pan

Video generation models have shown strong potential as world models for autonomous driving simulation. However, existing approaches are primarily trained on real-world driving datasets, which mostly contain natural and safe driving…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Jiawei Zhou , Zhenxin Zhu , Lingyi Du , Linye Lyu , Lijun Zhou , Zhanqian Wu , Hongcheng Luo , Zhuotao Tian , Bing Wang , Guang Chen , Hangjun Ye , Haiyang Sun , Yu Li
‹ Prev 1 2 3 10 Next ›