English
Related papers

Related papers: ImagerySearch: Adaptive Test-Time Search for Video…

200 papers

Recent advancements in text-to-image diffusion models have yielded impressive results in generating realistic and diverse images. However, these models still struggle with complex prompts, such as those that involve numeracy and spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Long Lian , Boyi Li , Adam Yala , Trevor Darrell

Creativity is a fundamental aspect of intelligence, involving the ability to generate novel and appropriate solutions across diverse contexts. While Large Language Models (LLMs) have been extensively evaluated for their creative…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Xinyu Fang , Zhijian Chen , Kai Lan , Lixin Ma , Shengyuan Ding , Yingji Liang , Xiangyu Zhao , Farong Wen , Zicheng Zhang , Guofeng Zhang , Haodong Duan , Kai Chen , Dahua Lin

Commercial video generation systems such as Seedance2.0 and Veo3.1 have rapidly improved, strengthening the view that video generators may be evolving into "world simulators." Yet the community still lacks a benchmark that directly tests…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Keming Wu , Yijing Cui , Wenhan Xue , Qijie Wang , Xuan Luo , Zhiyuan Feng , Zuhao Yang , Sudong Wang , Sicong Jiang , Haowei Zhu , Zihan Wang , Ping Nie , Wenhu Chen , Bin Wang

State-of-the-art text-to-video (T2V) generators frequently violate physical laws despite high visual quality. We show this stems from insufficient physical constraints in prompts rather than model limitations: manually adding physics…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Shang Wu , Chenwei Xu , Zhuofan Xia , Weijian Li , Lie Lu , Pranav Maneriker , Fan Du , Manling Li , Han Liu

Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning and tool use. However, the fundamental cognitive faculties essential for problem solving, including perception, reasoning, and memory, remain the stable…

Artificial Intelligence · Computer Science 2026-05-12 Xiaozhe Li , Jixuan Chen , Xinyu Fang , Shengyuan Ding , Haodong Duan , Qingwen Liu , Kai Chen

Video captioning aims to automatically generate natural language sentences that can describe the visual contents of a given video. Existing generative models like encoder-decoder frameworks cannot explicitly explore the object-level…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Yang Bai , Junyan Wang , Yang Long , Bingzhang Hu , Yang Song , Maurice Pagnucco , Yu Guan

The evolution of prompt learning methodologies has driven exploration of deeper prompt designs to enhance model performance. However, current deep text prompting approaches suffer from two critical limitations: Over-reliance on constrastive…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Qiqi Zhan , Shiwei Li , Qingjie Liu , Yunhong Wang

Recent advances in text-to-image (T2I) generation have achieved impressive results, yet existing models often struggle with simple or underspecified prompts, leading to suboptimal image-text alignment, aesthetics, and quality. We propose a…

Computation and Language · Computer Science 2025-10-16 Ruibo Chen , Jiacheng Pan , Heng Huang , Zhenheng Yang

Recent advances in multimodal large language models (MLLMs) have led to impressive progress across various benchmarks. However, their capability in understanding infrared images remains unexplored. To address this gap, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Tao Zhang , Yuyang Hong , Yang Xia , Kun Ding , Zeyu Zhang , Ying Wang , Shiming Xiang , Chunhong Pan

Text-to-image diffusion models, while proficient at generating high-fidelity images, often suffer from limited output diversity, hindering their application in exploratory and ideation tasks. Existing prompt optimization techniques…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Alex Inch , Passawis Chaiyapattanaporn , Yuchen Zhu , Yuan Lu , Ting-Wen Ko , Davide Paglieri

Humans inhabit a physical 4D world where geometric structure and semantic content evolve over time, constituting a dynamic 4D reality (spatial with temporal dimension). While current Multimodal Large Language Models (MLLMs) excel in static…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Yuzhi Huang , Kairun Wen , Rongxin Gao , Dongxuan Liu , Yibin Lou , Jie Wu , Jing Xu , Jian Zhang , Zheng Yang , Yunlong Lin , Chenxin Li , Panwang Pan , Junbin Lu , Jingyan Jiang , Xinghao Ding , Yue Huang , Zhi Wang

Attaining a high degree of user controllability in visual generation often requires intricate, fine-grained inputs like layouts. However, such inputs impose a substantial burden on users when compared to simple text inputs. To address the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Weixi Feng , Wanrong Zhu , Tsu-jui Fu , Varun Jampani , Arjun Akula , Xuehai He , Sugato Basu , Xin Eric Wang , William Yang Wang

Layout-guided text-to-image models offer greater control over the generation process by explicitly conditioning image synthesis on the spatial arrangement of elements. As a result, their adoption has increased in many computer vision…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Elena Izzo , Luca Parolari , Davide Vezzaro , Lamberto Ballan

Video generation models have significantly advanced embodied intelligence, unlocking new possibilities for generating diverse robot data that capture perception, reasoning, and action in the physical world. However, synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Yufan Deng , Zilin Pan , Hongyu Zhang , Xiaojie Li , Ruoqing Hu , Yufei Ding , Yiming Zou , Yan Zeng , Daquan Zhou

Image search stands as a pivotal task in multimedia and computer vision, finding applications across diverse domains, ranging from internet search to medical diagnostics. Conventional image search systems operate by accepting textual or…

Multimedia · Computer Science 2024-04-30 Hongyi Zhu , Jia-Hong Huang , Stevan Rudinac , Evangelos Kanoulas

Controllable video generation aims to synthesize video content that aligns precisely with user-provided conditions, such as text descriptions and initial images. However, a significant challenge persists in this domain: existing models…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Peng Hu , Yu Gu , Liang Luo , Fuji Ren

Video Models have achieved remarkable success in high-fidelity video generation with coherent motion dynamics. Analogous to the development from text generation to text-based reasoning in language modeling, the development of video models…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Cheng Yang , Haiyuan Wan , Yiran Peng , Xin Cheng , Zhaoyang Yu , Jiayi Zhang , Junchi Yu , Xinlei Yu , Xiawu Zheng , Dongzhan Zhou , Chenglin Wu

We present VRBench, the first long narrative video benchmark crafted for evaluating large models' multi-step reasoning capabilities, addressing limitations in existing evaluations that overlook temporal reasoning and procedural validity. It…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jiashuo Yu , Yue Wu , Meng Chu , Zhifei Ren , Zizheng Huang , Pei Chu , Ruijie Zhang , Yinan He , Qirui Li , Songze Li , Zhenxiang Li , Zhongying Tu , Conghui He , Yu Qiao , Yali Wang , Yi Wang , Limin Wang

With the proliferation of images in online content, language-guided image retrieval (LGIR) has emerged as a research hotspot over the past decade, encompassing a variety of subtasks with diverse input forms. While the development of large…

Information Retrieval · Computer Science 2025-03-14 Pengfei Luo , Jingbo Zhou , Tong Xu , Yuan Xia , Linli Xu , Enhong Chen

Reasoning over sequences of images remains a challenge for multimodal large language models (MLLMs). While recent models incorporate multi-image data during pre-training, they still struggle to recognize sequential structures, often…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Danae Sánchez Villegas , Ingo Ziegler , Desmond Elliott