English
Related papers

Related papers: IVEBench: Modern Benchmark Suite for Instruction-G…

200 papers

Evaluation of text generation to date has primarily focused on content created sequentially, rather than improvements on a piece of text. Writing, however, is naturally an iterative and incremental process that requires expertise in…

Computation and Language · Computer Science 2022-09-28 Jane Dwivedi-Yu , Timo Schick , Zhengbao Jiang , Maria Lomeli , Patrick Lewis , Gautier Izacard , Edouard Grave , Sebastian Riedel , Fabio Petroni

Understanding multi-image, multi-turn scenarios is a critical yet underexplored capability for Large Vision-Language Models (LVLMs). Existing benchmarks predominantly focus on static or horizontal comparisons -- e.g., spotting visual…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Wenbo Lyu , Yingjun Du , Jinglin Zhao , Xianton Zhen , Ling Shao

Recently, Large Vision-Language Models (LVLMs) have made significant strides across diverse multimodal tasks and benchmarks. This paper reveals a largely under-explored problem from existing video-involved LVLMs - language bias, where…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Yiming Yang , Yangyang Guo , Hui Lu , Yan Wang

Podcast script generation requires LLMs to synthesize structured, context-grounded dialogue from diverse inputs, yet systematic evaluation resources for this task remain limited. To bridge this gap, we introduce PodBench, a benchmark…

Computation and Language · Computer Science 2026-01-22 Chenning Xu , Mao Zheng , Mingyu Zheng , Mingyang Song

As Large Language Models (LLMs) evolve in natural language processing (NLP), their ability to stably follow instructions in long-context inputs has become critical for real-world applications. However, existing benchmarks seldom focus on…

Computation and Language · Computer Science 2025-07-25 Xiaodong Wu , Minhao Wang , Yichen Liu , Xiaoming Shi , He Yan , Xiangju Lu , Junmin Zhu , Wei Zhang

Recent advancements in diffusion models have significantly facilitated text-guided video editing. However, there is a relative scarcity of research on image-guided video editing, a method that empowers users to edit videos by merely…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Zhi-Lin Huang , Yixuan Liu , Chujun Qin , Zhongdao Wang , Dong Zhou , Dong Li , Emad Barsoum

Despite the significant advancements of Large Vision-Language Models (LVLMs) on established benchmarks, there remains a notable gap in suitable evaluation regarding their applicability in the emerging domain of long-context streaming video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zhenyu Yang , Yuhang Hu , Zemin Du , Dizhan Xue , Shengsheng Qian , Jiahong Wu , Fan Yang , Weiming Dong , Changsheng Xu

Video editing increasingly demands the ability to incorporate specific real-world instances into existing footage, yet current approaches fundamentally fail to capture the unique visual characteristics of particular subjects and ensure…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Shaobin Zhuang , Zhipeng Huang , Binxin Yang , Ying Zhang , Fangyikang Wang , Canmiao Fu , Chong Sun , Zheng-Jun Zha , Chen Li , Yali Wang

The rapid advancement of video generation has rendered existing evaluation systems inadequate for assessing state-of-the-art models, primarily due to simple prompts that cannot showcase the model's capabilities, fixed evaluation operators…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Yuhang Yang , Ke Fan , Shangkun Sun , Hongxiang Li , Ailing Zeng , FeiLin Han , Wei Zhai , Wei Liu , Yang Cao , Zheng-Jun Zha

Recent advances in text-driven image editing have been significant, yet the task of accurately evaluating these edited images continues to pose a considerable challenge. Different from the assessment of text-driven image generation,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Bowen Qu , Shangkun Sun , Xiaoyu Liang , Wei Gao

Recent advances in video generation have outpaced progress in video editing, which remains constrained by several limiting factors, namely: (a) the task's dependency on supervision severely limits generality, (b) an unnecessary artificial…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Harold Haodong Chen , Harry Yang , Ser-Nam Lim

Understanding long-form videos, such as movies and TV episodes ranging from tens of minutes to two hours, remains a significant challenge for multi-modal models. Existing benchmarks often fail to test the full range of cognitive skills…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Kirolos Ataallah , Eslam Abdelrahman , Mahmoud Ahmed , Chenhui Gou , Khushbu Pahwa , Jian Ding , Mohamed Elhoseiny

Recent advances in video generation models demonstrate their potential as world simulators, but they often struggle with videos deviating from physical laws, a key concern overlooked by most text-to-video benchmarks. We introduce a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Yongfan Chen , Xiuwen Zhu , Tianyu Li

The instruction hierarchy, which establishes a priority order from system messages to user messages, conversation history, and tool outputs, is essential for ensuring consistent and safe behavior in language models (LMs). Despite its…

Despite the effectiveness of vision-language supervised fine-tuning in enhancing the performance of Vision Large Language Models (VLLMs). However, existing visual instruction tuning datasets include the following limitations: (1)…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yangzhou Liu , Yue Cao , Zhangwei Gao , Weiyun Wang , Zhe Chen , Wenhai Wang , Hao Tian , Lewei Lu , Xizhou Zhu , Tong Lu , Yu Qiao , Jifeng Dai

Image editing has achieved remarkable progress recently. Modern editing models could already follow complex instructions to manipulate the original content. However, beyond completing the editing instructions, the accompanying physical…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Yuandong Pu , Le Zhuo , Songhao Han , Jinbo Xing , Kaiwen Zhu , Shuo Cao , Bin Fu , Si Liu , Hongsheng Li , Yu Qiao , Wenlong Zhang , Xi Chen , Yihao Liu

We introduce a new benchmark designed to advance the development of general-purpose, large-scale vision-language models for remote sensing images. Although several vision-language datasets in remote sensing have been proposed to pursue this…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Xiang Li , Jian Ding , Mohamed Elhoseiny

Instruction-following benchmarks remain predominantly English-centric, leaving a critical evaluation gap for the hundreds of millions of Indic language speakers. We introduce IndicIFEval, a benchmark evaluating constrained generation of…

Computation and Language · Computer Science 2026-02-26 Thanmay Jayakumar , Mohammed Safi Ur Rahman Khan , Raj Dabre , Ratish Puduppully , Anoop Kunchukuttan

While large language models (LLMs) can solve PhD-level reasoning problems over long context inputs, they still struggle with a seemingly simpler task: following explicit length instructions-e.g., write a 10,000-word novel. Additionally,…

Computation and Language · Computer Science 2025-06-12 Wei Zhang , Zhenhong Zhou , Kun Wang , Junfeng Fang , Yuanhe Zhang , Rui Wang , Ge Zhang , Xavier Li , Li Sun , Lingjuan Lyu , Yang Liu , Sen Su

Learning multimodal representations involves integrating information from multiple heterogeneous sources of data. It is a challenging yet crucial area with numerous real-world applications in multimedia, affective computing, robotics,…