English
Related papers

Related papers: DirectorBench: Diagnosing Long-Form Video Generati…

200 papers

Recent advances in video generation have produced models capable of synthesizing stunning visual content from simple text prompts. However, these models struggle to generate long-form, coherent narratives from high-level concepts like…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Chenyu Mu , Xin He , Qu Yang , Wanshun Chen , Jiadi Yao , Huang Liu , Zihao Yi , Bo Zhao , Xingyu Chen , Ruotian Ma , Fanghua Ye , Erkun Yang , Cheng Deng , Zhaopeng Tu , Xiaolong Li , Linus

Podcast script generation requires LLMs to synthesize structured, context-grounded dialogue from diverse inputs, yet systematic evaluation resources for this task remain limited. To bridge this gap, we introduce PodBench, a benchmark…

Computation and Language · Computer Science 2026-01-22 Chenning Xu , Mao Zheng , Mingyu Zheng , Mingyang Song

Long-form video understanding presents significant challenges due to extensive temporal-spatial complexity and the difficulty of question answering under such extended contexts. While Large Language Models (LLMs) have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Xiaoyi Zhang , Zhaoyang Jia , Zongyu Guo , Jiahao Li , Bin Li , Houqiang Li , Yan Lu

Video generation has witnessed remarkable progress with the advent of deep generative models, particularly diffusion models. While existing methods excel in generating high-quality videos from text prompts or single images, personalized…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Yufan Deng , Xun Guo , Yizhi Wang , Jacob Zhiyuan Fang , Angtian Wang , Shenghai Yuan , Yiding Yang , Bo Liu , Haibin Huang , Chongyang Ma

Customized text-to-video generation aims to generate text-guided videos with user-given subjects, which has gained increasing attention. However, existing works are primarily limited to single-subject oriented text-to-video generation,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Hong Chen , Xin Wang , Guanning Zeng , Yipeng Zhang , Yuwei Zhou , Feilin Han , Yaofei Wu , Wenwu Zhu

Real-world video editing demands not only expert knowledge of cinematic techniques but also multimodal reasoning to select, align, and combine footage into coherent narratives. While recent Large Multimodal Models (LMMs) have shown…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Andong Deng , Dawei Du , Zhenfang Chen , Wen Zhong , Fan Chen , Guang Chen , Chia-Wen Kuo , Longyin Wen , Chen Chen , Sijie Zhu

Text-driven video editing has recently experienced rapid development. Despite this, evaluating edited videos remains a considerable challenge. Current metrics tend to fail to align with human perceptions, and effective quantitative metrics…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Shangkun Sun , Xiaoyu Liang , Songlin Fan , Wenxu Gao , Wei Gao

The efficacy of video generation models heavily depends on the quality of their training datasets. Most previous video generation models are trained on short video clips, while recently there has been increasing interest in training long…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Tianwei Xiong , Yuqing Wang , Daquan Zhou , Zhijie Lin , Jiashi Feng , Xihui Liu

Thanks to recent advancements in scalable deep architectures and large-scale pretraining, text-to-video generation has achieved unprecedented capabilities in producing high-fidelity, instruction-following content across a wide range of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Xuyang Guo , Jiayan Huo , Zhenmei Shi , Zhao Song , Jiahao Zhang , Jiale Zhao

The narrative quality of a video fundamentally determines its perceptual value. Although existing video generation methods can produce visually appealing content, they predominantly rely on sparse conditioning signals such as text prompts…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Zhida Zhang , Jie Ma , Zhan Peng , Haoxue Wu , Yang Han , Jun Liang , Jie Cao , Jing Li

Traditional benchmarks for large language models (LLMs) typically rely on static evaluations through storytelling or opinion expression, which fail to capture the dynamic requirements of real-time information processing in contemporary…

Machine Learning · Computer Science 2025-06-27 Jingyao Li , Hao Sun , Zile Qiao , Yong Jiang , Pengjun Xie , Fei Huang , Hong Xu , Jiaya Jia

In recent years, vision language models (VLMs) have made significant advancements in video understanding. However, a crucial capability - fine-grained motion comprehension - remains under-explored in current benchmarks. To address this gap,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Wenyi Hong , Yean Cheng , Zhuoyi Yang , Weihan Wang , Lefan Wang , Xiaotao Gu , Shiyu Huang , Yuxiao Dong , Jie Tang

LLM agents are increasingly deployed as executable systems that use tools, modify workspaces, and produce concrete artifacts. In such workflows, performance depends not only on the base model, but also on the harness: the system layer that…

Artificial Intelligence · Computer Science 2026-05-28 Yilun Yao , Xinyu Tan , Chao-Hsuan Liu , Yaoming Li , Zhengyang Wang , Wenhan Yu , Zhewen Tan , Yuxuan Tian , Guangxiang Zhao , Lin Sun , Xiangzheng Zhang , Tong Yang

Large Language Models (LLMs) have reshaped user profiling, yet current evaluations mainly focus on static data snapshots. This paradigm overlooks the reality of personalized systems, where User-Generated Content (UGC) arrives continuously…

Computation and Language · Computer Science 2026-05-27 Sizhe Wang , Feiyu Duan , Juelin Wang , Liwen Zhang , Zhongyu Wei

Generating images conditioned on multiple visual references is critical for real-world applications such as multi-subject composition, narrative illustration, and novel view synthesis, yet current models suffer from severe performance…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Zhekai Chen , Yuqing Wang , Manyuan Zhang , Xihui Liu

Generation of images containing multiple humans, performing complex actions, while preserving their facial identities, is a significant challenge. A major factor contributing to this is the lack of a dedicated benchmark. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Shubhankar Borse , Seokeon Choi , Sunghyun Park , Jeongho Kim , Shreya Kadambi , Risheek Garrepalli , Sungrack Yun , Munawar Hayat , Fatih Porikli

Text-to-video generation has been dominated by diffusion-based or autoregressive models. These novel models provide plausible versatility, but are criticized for improper physical motion, shading and illumination, camera motion, and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Liu He , Yizhi Song , Hejun Huang , Pinxin Liu , Yunlong Tang , Daniel Aliaga , Xin Zhou

Generative models can now produce photorealistic imagery, yet they still struggle with the long, multi-goal prompts that professional designers issue. To expose this gap and better evaluate models' performance in real-world settings, we…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Meng Chu , Senqiao Yang , Haoxuan Che , Suiyun Zhang , Xichen Zhang , Shaozuo Yu , Haokun Gui , Zhefan Rao , Dandan Tu , Rui Liu , Jiaya Jia

Generative diffusion models are developing rapidly and attracting increasing attention due to their wide range of applications. Image-to-Video (I2V) generation has become a major focus in the field of video synthesis. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Ailing Zhang , Lina Lei , Dehong Kong , Zhixin Wang , Jiaqi Xu , Fenglong Song , Chun-Le Guo , Chang Liu , Fan Li , Jie Chen

Despite the significant progress that has been made in video generative models, existing state-of-the-art methods can only produce videos lasting 5-16 seconds, often labeled "long-form videos". Furthermore, videos exceeding 16 seconds…