中文
相关论文

相关论文: Long-CODE: Isolating Pure Long-Context as an Ortho…

200 篇论文

We tackle the long video generation problem, i.e.~generating videos beyond the output length of video generation models. Due to the computation resource constraints, video generation models can only generate video clips that are relatively…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Hsin-Ping Huang , Yu-Chuan Su , Ming-Hsuan Yang

Learning visual feature representations for video analysis is a daunting task that requires a large amount of training samples and a proper generalization framework. Many of the current state of the art methods for video captioning and…

机器学习 · 计算机科学 2018-09-20 Oliver Nina , Washington Garcia , Scott Clouse , Alper Yilmaz

Generative models have demonstrated remarkable capability in synthesizing high-quality text, images, and videos. For video generation, contemporary text-to-video models exhibit impressive capabilities, crafting visually stunning videos.…

Recent advancements in the field of natural language generation have facilitated the use of large language models to assess the quality of generated text. Although these models have shown promising results in tasks such as machine…

人工智能 · 计算机科学 2024-01-23 Terry Yue Zhuo

The advent of large vision-language models (LVLMs) has spurred research into their applications in multi-modal contexts, particularly in video understanding. Traditional VideoQA benchmarks, despite providing quantitative metrics, often fail…

计算机视觉与模式识别 · 计算机科学 2024-10-31 Xinyu Fang , Kangrui Mao , Haodong Duan , Xiangyu Zhao , Yining Li , Dahua Lin , Kai Chen

Audio-visual generation is rapidly advancing from short clips to minute-long content, while existing evaluation protocols remain largely confined to short-form settings. Existing benchmarks primarily focus on 5--10 second text-conditioned…

Large Language Models (LLMs) struggle with long-context code due to window limitations. Existing textual code compression methods mitigate this via selective filtering but often disrupt dependency closure, causing semantic fragmentation. To…

软件工程 · 计算机科学 2026-02-03 Jianping Zhong , Guochang Li , Chen Zhi , Junxiao Han , Zhen Qin , Xinkui Zhao , Nan Wang , Shuiguang Deng , Jianwei Yin

With the rapid development of foundation video generation technologies, long video generation models have exhibited promising research potential thanks to expanded content creation space. Recent studies reveal that the goal of long video…

计算机视觉与模式识别 · 计算机科学 2026-03-09 X. Feng , H. Yu , M. Wu , S. Hu , J. Chen , C. Zhu , J. Wu , X. Chu , K. Huang

As model context lengths continue to grow, concerns about whether models effectively use the full context length have persisted. While several carefully designed long-context evaluations have recently been released, these evaluations tend…

计算与语言 · 计算机科学 2025-11-05 Amanda Bertsch , Adithya Pratapa , Teruko Mitamura , Graham Neubig , Matthew R. Gormley

The emergence of large language models (LLMs) has significantly influenced numerous fields, including healthcare, by enhancing the capabilities of automated systems to process and generate human-like text. However, despite their…

信息检索 · 计算机科学 2025-04-23 Mohit Gupta , Akiko Aizawa , Rajiv Ratn Shah

Long-form video generation is rapidly moving from short, single-scene synthesis toward minute-long, multi-shot creation with narrative structure, cinematic control, audio, and cross-modal synchronization. However, evaluating such videos…

计算与语言 · 计算机科学 2026-05-29 Jiamin Chen , Qianben Chen , Jiawen Zhang , Yidi Wu , Yuchen Li , Xiaokun Zhang , Wangchunshu Zhou , Chen Ma

Large Multimodal Models (LMMs) have demonstrated impressive performance in short video understanding tasks but face great challenges when applied to long video understanding. In contrast, Large Language Models (LLMs) exhibit outstanding…

计算机视觉与模式识别 · 计算机科学 2024-10-03 Hongchen Wei , Zhenzhong Chen

Long-context modeling has drawn more and more attention in the area of Large Language Models (LLMs). Continual training with long-context data becomes the de-facto method to equip LLMs with the ability to process long inputs. However, it…

计算与语言 · 计算机科学 2025-10-14 Jianghao Chen , Junhong Wu , Yangyifan Xu , Jiajun Zhang

Over the years, performance evaluation has become essential in computer vision, enabling tangible progress in many sub-fields. While talking-head video generation has become an emerging research topic, existing evaluations on this topic…

计算机视觉与模式识别 · 计算机科学 2020-05-08 Lele Chen , Guofeng Cui , Ziyi Kou , Haitian Zheng , Chenliang Xu

Current advanced long-context language models offer great potential for real-world software engineering applications. However, progress in this critical domain remains hampered by a fundamental limitation: the absence of a rigorous…

软件工程 · 计算机科学 2025-03-07 Jia Li , Xuyuan Guo , Lei Li , Kechi Zhang , Ge Li , Jia Li , Zhengwei Tao , Fang Liu , Chongyang Tao , Yuqi Zhu , Zhi Jin

Large Multimodal Models (LMMs) have demonstrated exceptional performance in video captioning tasks, particularly for short videos. However, as the length of the video increases, generating long, detailed captions becomes a significant…

计算机视觉与模式识别 · 计算机科学 2025-03-04 Hongchen Wei , Zhihong Tan , Yaosi Hu , Chang Wen Chen , Zhenzhong Chen

The ability to integrate context, including perceptual and temporal cues, plays a pivotal role in grounding the meaning of a linguistic utterance. In order to measure to what extent current vision-and-language models master this ability, we…

计算机视觉与模式识别 · 计算机科学 2022-11-21 Benno Krojer , Vaibhav Adlakha , Vibhav Vineet , Yash Goyal , Edoardo Ponti , Siva Reddy

Recent visual-text compression (VTC) methods, typified by DeepSeek-OCR, report impressive high token compression ratios for long-context modeling tasks by leveraging text-to-image rendering. However, existing evaluation protocols heavily…

计算机视觉与模式识别 · 计算机科学 2026-03-13 Yonghan Gao , Zehong Chen , Lijian Xu , Jingzhi Chen , Jingwei Guan , Xingyu Zeng

Video description is the automatic generation of natural language sentences that describe the contents of a given video. It has applications in human-robot interaction, helping the visually impaired and video subtitling. The past few years…

计算机视觉与模式识别 · 计算机科学 2020-03-04 Nayyer Aafaq , Ajmal Mian , Wei Liu , Syed Zulqarnain Gilani , Mubarak Shah

Recent approaches to real-time long video generation typically employ streaming tuning strategies, attempting to train a long-context student using a short-context (memoryless) teacher. In these frameworks, the student performs long…

计算机视觉与模式识别 · 计算机科学 2026-02-06 Shuo Chen , Cong Wei , Sun Sun , Ping Nie , Kai Zhou , Ge Zhang , Ming-Hsuan Yang , Wenhu Chen