中文
相关论文

相关论文: Factorized Learning for Temporally Grounded Video-…

200 篇论文

The current success of modern visual reasoning systems is arguably attributed to cross-modality attention mechanisms. However, in deliberative reasoning such as in VQA, attention is unconstrained at each step, and thus may serve as a…

计算机视觉与模式识别 · 计算机科学 2022-05-26 Thao Minh Le , Vuong Le , Sunil Gupta , Svetha Venkatesh , Truyen Tran

Multimodal Large Language Models (MLLMs) have achieved remarkable progress in vision-language tasks yet remain limited in long video understanding due to the limited context window. Consequently, prevailing approaches tend to rely on…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Yang Ding , Yizhen Zhang , Xin Lai , Ruihang Chu , Yujiu Yang

Large Vision-Language Models (LVLMs) or multimodal large language models represent a significant advancement in artificial intelligence, enabling systems to understand and generate content across both visual and textual modalities. While…

机器学习 · 计算机科学 2025-09-09 Thanh Thi Nguyen , Campbell Wilson , Janis Dalins

Video reasoning requires models to locate and track question-relevant evidence across frames. While reinforcement learning (RL) with verifiable rewards improves accuracy, it still struggles to achieve reliable spatio-temporal grounding…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Daeun Lee , Shoubin Yu , Yue Zhang , Mohit Bansal

Large Vision-Language Models (LVLMs) face a fundamental dilemma in video reasoning: they are caught between the prohibitive computational costs of verbose reasoning and the hallucination risks of efficient, ungrounded approaches. To resolve…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Yanxiang Huang , Guohua Gao , Zhaoyang Wei , Jianyuan Ni

Time series forecasting underpins vital decision-making across various sectors, yet raw predictions from sophisticated models often harbor systematic errors and biases. We examine the Forecast-Then-Optimize (FTO) framework, pioneering its…

机器学习 · 计算机科学 2025-06-17 Jinhang Jiang , Nan Wu , Ben Liu , Mei Feng , Xin Ji , Karthik Srinivasan

Many video reasoning tasks require tracking motion, temporal order, and evolving visual states across frames. Existing methods built on large vision-language models (LVLMs) often address this challenge by externalizing reasoning through…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Yiming Liang , Yixiao Chen , Yiyang Zhou , Yixuan Wang , Shoubin Yu , Andong Deng , Fuxiao Liu , Qin Zhang , Chen Chen , Mohit Bansal , Huaxiu Yao

Preference optimization methods such as DPO and KTO are widely used for aligning language models, yet little is understood about what properties of preference data drive downstream reasoning gains. We ask: what aspects of a preference pair…

Aligning Large Language Models (LLMs) with human preferences is critical, yet traditional fine-tuning methods are computationally expensive and inflexible. While test-time alignment offers a promising alternative, existing approaches often…

人工智能 · 计算机科学 2026-01-16 Tiesunlong Shen , Rui Mao , Jin Wang , Heming Sun , Jian Zhang , Xuejie Zhang , Erik Cambria

Large language models (LLMs) have shown remarkable text understanding capabilities, which have been extended as Video LLMs to handle video data for comprehending visual details. However, existing Video LLMs can only provide a coarse…

计算机视觉与模式识别 · 计算机科学 2023-12-01 Bin Huang , Xin Wang , Hong Chen , Zihan Song , Wenwu Zhu

Preference-based finetuning of vision--language models (VLMs) is brittle: trivially wrong negatives inject uninformative gradients that destabilize training. We recast alignment as \textbf{learning-dynamics--aware optimization} and…

机器学习 · 计算机科学 2025-10-15 Jusheng Zhang , Kaitong Cai , Jing Yang , Keze Wang

This paper introduces a novel causal framework for multi-stage decision-making in natural language action spaces where outcomes are only observed after a sequence of actions. While recent approaches like Proximal Policy Optimization (PPO)…

计算与语言 · 计算机科学 2025-02-26 Bohan Zhang , Yixin Wang , Paramveer S. Dhillon

While Multimodal Large Language Models (MLLMs) have advanced Video Temporal Grounding (VTG), existing methods often couple output paradigms with different backbones, datasets, and training protocols. This makes it challenging to isolate the…

计算机视觉与模式识别 · 计算机科学 2026-04-13 Shengji Jin , Yuanhao Zou , Victor Zhu , Zhengping Ji , Chen Chen

While Video Large Language Models (Video-LLMs) have shown significant potential in multimodal understanding and reasoning tasks, how to efficiently select the most informative frames from videos remains a critical challenge. Existing…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Shihao Wang , Guo Chen , De-an Huang , Zhiqi Li , Minghan Li , Guilin Liu , Jose M. Alvarez , Lei Zhang , Zhiding Yu

Direct Preference Optimization (DPO) using an implicit reward model has proven to be an effective alternative to reinforcement learning from human feedback (RLHF) for fine-tuning preference aligned large language models (LLMs). However, the…

计算与语言 · 计算机科学 2024-09-30 Guoxin Chen , Minpeng Liao , Chengxi Li , Kai Fan

We present LongVPO, a novel two-stage Direct Preference Optimization framework that enables short-context vision-language models to robustly understand ultra-long videos without any long-video annotations. In Stage 1, we synthesize…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Zhenpeng Huang , Jiaqi Li , Zihan Jia , Xinhao Li , Desen Meng , Lingxue Song , Xi Chen , Liang Li , Limin Wang

Video quality assessment (VQA) aims to objectively quantify perceptual quality degradation in alignment with human visual perception. Despite recent advances, existing VQA models still suffer from two critical limitations: \textit{poor…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Linhan Cao , Wei Sun , Weixia Zhang , Xiangyang Zhu , Jun Jia , Kaiwei Zhang , Dandan Zhu , Guangtao Zhai , Xiongkuo Min

Video diffusion models have made rapid progress in perceptual realism and temporal coherence, but they remain primarily optimized for plausible generation rather than verifiable reasoning. This limitation is especially pronounced in tasks…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Tinghui Zhu , Sheng Zhang , James Y. Huang , Selena Song , Xiaofei Wen , Yuankai Li , Hoifung Poon , Muhao Chen

Existing Multimodal Large Language Models (MLLMs) suffer from significant performance degradation on the long document understanding task as document length increases. This stems from two fundamental challenges: 1) a low Signal-to-Noise…

人工智能 · 计算机科学 2026-05-12 Hao Yan , Yuliang Liu , Xingchen Liu , Yuyi Zhang , Minghui Liao , Jihao Wu , Wei Chen , Xiang Bai

Large Language Models (LLMs) are increasingly embedded in enterprise workflows, yet their performance remains highly sensitive to prompt design. Automatic Prompt Optimization (APO) seeks to mitigate this instability, but existing approaches…

人工智能 · 计算机科学 2026-02-03 Wei Chen , Yanbin Fang , Shuran Fu , Fasheng Xu , Xuan Wei