English
Related papers

Related papers: Bootstrapping Physics-Grounded Video Generation th…

200 papers

Modern video diffusion models excel at appearance synthesis but still struggle with physical consistency: objects drift, collisions lack realistic rebound, and material responses seldom match their underlying properties. We present PhyCo, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Sriram Narayanan , Ziyu Jiang , Srinivasa Narasimhan , Manmohan Chandraker

Recent multimodal large language models (MLLMs) have advanced video understanding, yet most still "think about videos" ie once a video is encoded, reasoning unfolds entirely in text, treating visual input as a static context. This passive…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Hanoona Rasheed , Mohammed Zumri , Muhammad Maaz , Ming-Hsuan Yang , Fahad Shahbaz Khan , Salman Khan

Recent advances in AI-generated content (AIGC) have led to the emergence of powerful text-to-video generation models. Despite these successes, evaluating the quality of AIGC-generated videos remains challenging due to limited…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Xuanyu Zhang , Weiqi Li , Shijie Zhao , Junlin Li , Li Zhang , Jian Zhang

Recently, Multimodal Large Language Models (MLLMs) have demonstrated significant potential in complex visual tasks through the integration of Chain-of-Thought (CoT) reasoning. However, in Video Question Answering, extended thinking…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Xiaokun Sun , Yubo Wang , Haoyu Cao , Linli Xu

Multimodal large language models (LLMs) have made rapid progress in visual understanding, yet their extension from images to videos often reduces to a naive concatenation of frame tokens. In this work, we investigate what video finetuning…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Ruiqi Yang , Tian Yun , Zihan Wang , Ellie Pavlick

Modern video generative models produce visually impressive results, yet frequently violate basic physical principles. We propose Proprio, a training-free framework that enables a frozen video generator to assess and improve the physical…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Mariam Hassan , Kaouther Messaoud , Wuyang Li , Alexandre Alahi

Reinforcement fine-tuning (RFT) has shown great promise in achieving humanlevel reasoning capabilities of Large Language Models (LLMs), and has recently been extended to MLLMs. Nevertheless, reasoning about videos, which is a fundamental…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Qi Wang , Yanrui Yu , Ye Yuan , Rui Mao , Tianfei Zhou

Image Quality Assessment (IQA) models are increasingly deployed as perceptual critics to guide generative models and image restoration. This role demands not only accurate scores but also actionable, localized feedback. However, current…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Xudong Li , Jiaxi Tan , Ziyin Zhou , Yan Zhong , Zihao Huang , Jingyuan Zheng , Yan Zhang , Xiawu Zheng , Rongrong Ji

Despite recent progress in video generation, producing videos that adhere to physical laws remains a significant challenge. Traditional diffusion-based methods struggle to extrapolate to unseen physical conditions (eg, velocity) due to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Wang Lin , Liyu Jia , Wentao Hu , Kaihang Pan , Zhongqi Yue , Wei Zhao , Jingyuan Chen , Fei Wu , Hanwang Zhang

In recent years, video question answering based on multimodal large language models (MLLM) has garnered considerable attention, due to the benefits from the substantial advancements in LLMs. However, these models have a notable deficiency…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Jinglei Zhang , Yuanfan Guo , Rolandos Alexandros Potamias , Jiankang Deng , Hang Xu , Chao Ma

This is a short technical report describing the winning entry of the PhysicsIQ Challenge, presented at the Perception Test Workshop at ICCV 2025. State-of-the-art video generative models exhibit severely limited physical understanding, and…

Physical principles are fundamental to realistic visual simulation, but remain a significant oversight in transformer-based video generation. This gap highlights a critical limitation in rendering rigid body motion, a core tenet of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Qiyuan Zhang , Biao Gong , Shuai Tan , Zheng Zhang , Yujun Shen , Xing Zhu , Yuyuan Li , Kelu Yao , Chunhua Shen , Changqing Zou

Currently, high-quality, synchronized audio is synthesized from video and optional text inputs using various multi-modal joint learning frameworks. However, the precise alignment between the visual and generated audio domains remains far…

Sound · Computer Science 2025-03-31 Yunming Liang , Zihao Chen , Chaofan Ding , Xinhan Di

Modern video generators still struggle with complex physical dynamics, often falling short of physical realism. Existing approaches address this using external verifiers or additional training on augmented data, which is computationally…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Sangwon Jang , Taekyung Ki , Jaehyeong Jo , Saining Xie , Jaehong Yoon , Sung Ju Hwang

Recent advancements in video generation have witnessed significant progress, especially with the rapid advancement of diffusion models. Despite this, their deficiencies in physical cognition have gradually received widespread attention -…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Minghui Lin , Xiang Wang , Yishan Wang , Shu Wang , Fengqi Dai , Pengxiang Ding , Cunxiang Wang , Zhengrong Zuo , Nong Sang , Siteng Huang , Donglin Wang

Recent diffusion-based video generation models can synthesize visually plausible videos, yet they often struggle to satisfy physical constraints. A key reason is that most existing approaches remain single-stage: they entangle high-level…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Yibo Zhao , Hengjia Li , Xiaofei He , Boxi Wu

State-of-the-art text-to-video (T2V) generators frequently violate physical laws despite high visual quality. We show this stems from insufficient physical constraints in prompts rather than model limitations: manually adding physics…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Shang Wu , Chenwei Xu , Zhuofan Xia , Weijian Li , Lie Lu , Pranav Maneriker , Fan Du , Manling Li , Han Liu

Chain-of-thought (CoT) reasoning has been highly successful in solving complex tasks in natural language processing, and recent multimodal large language models (MLLMs) have extended this paradigm to video reasoning. However, these models…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Yiwu Zhong , Zi-Yuan Hu , Yin Li , Liwei Wang

Modern foundational Multimodal Large Language Models (MLLMs) and video world models have advanced significantly in mathematical, common-sense, and visual reasoning, but their grasp of the underlying physics remains underexplored. Existing…

Video Question Answering (VideoQA) is a challenging task that requires understanding complex visual and temporal relationships within videos to answer questions accurately. In this work, we introduce \textbf{ReasVQA} (Reasoning-enhanced…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Jianxin Liang , Xiaojun Meng , Huishuai Zhang , Yueqian Wang , Jiansheng Wei , Dongyan Zhao
‹ Prev 1 2 3 10 Next ›