中文
相关论文

相关论文: Score2Instruct: Scaling Up Video Quality-Centric I…

200 篇论文

The development of AI-Generated Video (AIGV) technology has been remarkable in recent years, significantly transforming the paradigm of video content production. However, AIGVs still suffer from noticeable visual quality defects, such as…

计算机视觉与模式识别 · 计算机科学 2025-06-13 Zelu Qi , Ping Shi , Chaoyang Zhang , Shuqi Wang , Fei Zhao , Da Pan , Zefeng Ying

While Video Large Language Models (Video-LLMs) have shown significant potential in multimodal understanding and reasoning tasks, how to efficiently select the most informative frames from videos remains a critical challenge. Existing…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Shihao Wang , Guo Chen , De-an Huang , Zhiqi Li , Minghan Li , Guilin Liu , Jose M. Alvarez , Lei Zhang , Zhiding Yu

Instruction tuning has become a foundation for unlocking the capabilities of large-scale pretrained models and improving their performance on complex tasks. Thus, the construction of high-quality instruction datasets is crucial for…

人工智能 · 计算机科学 2026-02-12 Li Du , Hanyu Zhao , Yiming Ju , Tengfei Pan

Instructional video generation is an emerging task that aims to synthesize coherent demonstrations of procedural activities from textual descriptions. Such capability has broad implications for content creation, education, and human-AI…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Cheeun Hong , German Barquero , Fadime Sener , Markos Georgopoulos , Edgar Schönfeld , Stefan Popov , Yuming Du , Oscar Mañas , Albert Pumarola

Recent advances in AI-generated content (AIGC) have led to the emergence of powerful text-to-video generation models. Despite these successes, evaluating the quality of AIGC-generated videos remains challenging due to limited…

计算机视觉与模式识别 · 计算机科学 2025-06-24 Xuanyu Zhang , Weiqi Li , Shijie Zhao , Junlin Li , Li Zhang , Jian Zhang

Instruction tuning is a pivotal technique for aligning large language models (LLMs) with human intentions, safety constraints, and domain-specific requirements. This survey provides a comprehensive overview of the full pipeline,…

计算与语言 · 计算机科学 2025-11-20 Xudong Han , Junjie Yang , Tianyang Wang , Ziqian Bi , Xinyuan Song , Junfeng Hao , Junhao Song

Universal video understanding requires modeling fine-grained visual and audio information over time in diverse real-world scenarios. However, the performance of existing models is primarily constrained by video-instruction data that…

计算机视觉与模式识别 · 计算机科学 2026-02-16 Yunheng Li , Hengrui Zhang , Meng-Hao Guo , Wenzhao Gao , Shaoyong Jia , Shaohui Jiao , Qibin Hou , Ming-Ming Cheng

Video large language models have achieved remarkable performance in tasks such as video question answering, however, their temporal understanding remains suboptimal. To address this limitation, we curate a dedicated instruction fine-tuning…

计算机视觉与模式识别 · 计算机科学 2025-08-08 Yunxiao Wang , Meng Liu , Wenqi Liu , Xuemeng Song , Bin Wen , Fan Yang , Tingting Gao , Di Zhang , Guorui Zhou , Liqiang Nie

Training multimodal large language models (MLLMs) for video understanding requires large-scale annotated data spanning diverse tasks such as object counting, question answering, and segmentation. However, collecting and annotating…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Tanzila Rahman , Renjie Liao , Leonid Sigal

Instruction tuning is critical for adapting large language models (LLMs) to downstream tasks, and recent studies have demonstrated that small amounts of human-curated data can outperform larger datasets, challenging traditional data scaling…

计算与语言 · 计算机科学 2025-03-07 Jinlong Pang , Jiaheng Wei , Ankit Parag Shah , Zhaowei Zhu , Yaxuan Wang , Chen Qian , Yang Liu , Yujia Bao , Wei Wei

The vision and language generative models have been overgrown in recent years. For video generation, various open-sourced models and public-available services have been developed to generate high-quality videos. However, these methods often…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Yaofang Liu , Xiaodong Cun , Xuebo Liu , Xintao Wang , Yong Zhang , Haoxin Chen , Yang Liu , Tieyong Zeng , Raymond Chan , Ying Shan

Learners' use of video controls in educational videos provides implicit signals of cognitive processing and instructional design quality, yet the lack of scalable and explainable predictive models limits instructors' ability to anticipate…

人工智能 · 计算机科学 2026-04-07 Dominik Glandorf , Fares Fawzi , Tanja Käser

With the rise of multimodal applications, instruction data has become critical for training multimodal language models capable of understanding complex image-based queries. Existing practices rely on powerful but costly large language…

计算机视觉与模式识别 · 计算机科学 2024-12-31 Jieyu Zhang , Le Xue , Linxin Song , Jun Wang , Weikai Huang , Manli Shu , An Yan , Zixian Ma , Juan Carlos Niebles , Silvio Savarese , Caiming Xiong , Zeyuan Chen , Ranjay Krishna , Ran Xu

Data quality and diversity are key to the construction of effective instruction-tuning datasets. % With the increasing availability of open-source instruction-tuning datasets, it is advantageous to automatically select high-quality and…

计算与语言 · 计算机科学 2025-04-21 Yicheng Chen , Yining Li , Kai Hu , Zerun Ma , Haochen Ye , Kai Chen

Generative diffusion models are developing rapidly and attracting increasing attention due to their wide range of applications. Image-to-Video (I2V) generation has become a major focus in the field of video synthesis. However, existing…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Ailing Zhang , Lina Lei , Dehong Kong , Zhixin Wang , Jiaqi Xu , Fenglong Song , Chun-Le Guo , Chang Liu , Fan Li , Jie Chen

Instruction tuning is crucial for optimizing Large Language Models (LLMs), yet mainstream data selection methods heavily rely on LLMs as instruction quality scorers, leading to high computational costs and reduced data diversity. To address…

机器学习 · 计算机科学 2025-03-04 Hongyi Cai , Yuqian Fu , Hongming Fu , Bo Zhao

High-quality training triplets (instruction, original image, edited image) are essential for instruction-based image editing. Predominant training datasets (e.g., InsPix2Pix) are created using text-to-image generative models (e.g., Stable…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Xin Gu , Ming Li , Libo Zhang , Fan Chen , Longyin Wen , Tiejian Luo , Sijie Zhu

The burgeoning field of Artificial Intelligence Generated Content (AIGC) is witnessing rapid advancements, particularly in video generation. This paper introduces AIGCBench, a pioneering comprehensive and scalable benchmark designed to…

计算机视觉与模式识别 · 计算机科学 2024-01-24 Fanda Fan , Chunjie Luo , Wanling Gao , Jianfeng Zhan

Recent advances in video generation have enabled high-fidelity video synthesis from user provided prompts. However, existing models and benchmarks fail to capture the complexity and requirements of professional video generation. Towards…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Agneet Chatterjee , Rahim Entezari , Maksym Zhuravinskyi , Maksim Lapin , Reshinth Adithyan , Amit Raj , Chitta Baral , Yezhou Yang , Varun Jampani

While recent generative models advance pixel-space video synthesis, they remain limited in producing professional educational videos, which demand disciplinary knowledge, precise visual structures, and coherent transitions, limiting their…

计算机视觉与模式识别 · 计算机科学 2025-10-02 Yanzhe Chen , Kevin Qinghong Lin , Mike Zheng Shou