中文
相关论文

相关论文: Beyond the Last Frame: Process-aware Evaluation fo…

200 篇论文

Robotic assistance in scientific laboratories requires procedurally correct long-horizon manipulation, reliable execution under limited supervision, and robustness in low-demonstration regimes. Such conditions greatly challenge end-to-end…

机器人学 · 计算机科学 2026-02-11 Jinghan Yang , Jingyi Hou , Xinbo Yu , Wei He , Yifan Wu

Large Language Models excel at code generation yet struggle with complex programming tasks that demand sophisticated reasoning. To bridge this gap, traditional process supervision relies on learned reward models requiring costly training…

计算与语言 · 计算机科学 2025-06-09 Zhuohao Yu , Weizheng Gu , Yidong Wang , Xingru Jiang , Zhengran Zeng , Jindong Wang , Wei Ye , Shikun Zhang

Creating high-quality sound effects from videos and text prompts requires precise alignment between visual and audio domains, both semantically and temporally, along with step-by-step guidance for professional audio generation. However,…

声音 · 计算机科学 2025-03-31 Haomin Zhang , Sizhe Shan , Haoyu Wang , Zihao Chen , Xiulong Liu , Chaofan Ding , Xinhan Di

Despite recent advances in AI, the development of systems capable of executing complex, multi-step reasoning tasks involving multiple tools remains a significant challenge. Current benchmarks fall short in capturing the real-world…

计算与语言 · 计算机科学 2025-01-03 Vaskar Nath , Pranav Raja , Claire Yoon , Sean Hendryx

Learning commonsense reasoning from visual contexts and scenes in real-world is a crucial step toward advanced artificial intelligence. However, existing video reasoning benchmarks are still inadequate since they were mainly designed for…

计算机视觉与模式识别 · 计算机科学 2024-05-20 Andong Wang , Bo Wu , Sunli Chen , Zhenfang Chen , Haotian Guan , Wei-Ning Lee , Li Erran Li , Chuang Gan

Despite rapid advancements, current text-to-image (T2I) models predominantly rely on a single-step generation paradigm, which struggles with complex semantics and faces diminishing returns from parameter scaling. While recent multi-step…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Hanbo Cheng , Limin Lin , Ruo Zhang , Yicheng Pan , Jun Du

Process-supervised reward models serve as a fine-grained function that provides detailed step-wise feedback to model responses, facilitating effective selection of reasoning trajectories for complex tasks. Despite its advantages, evaluation…

计算机视觉与模式识别 · 计算机科学 2025-03-27 Haoqin Tu , Weitao Feng , Hardy Chen , Hui Liu , Xianfeng Tang , Cihang Xie

While language models have become impactful in many real-world applications, video generation remains largely confined to entertainment. Motivated by video's inherent capacity to demonstrate physical-world information that is difficult to…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Junhao Cheng , Liang Hou , Xin Tao , Jing Liao

Recent advancements in reinforcement learning with verifiable rewards (RLVR) have significantly improved the complex reasoning ability of vision-language models (VLMs). However, its outcome-level supervision is too coarse to diagnose and…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Yingqian Min , Kun Zhou , Yifan Li , Yuhuan Wu , Han Peng , Yifan Du , Wayne Xin Zhao , Min Yang , Ji-Rong Wen

The real world is dynamic, yet most image fusion methods process static frames independently, ignoring temporal correlations in videos and leading to flickering and temporal inconsistency. To address this, we propose Unified Video Fusion…

计算机视觉与模式识别 · 计算机科学 2025-10-22 Zixiang Zhao , Haowen Bai , Bingxin Ke , Yukun Cui , Lilun Deng , Yulun Zhang , Kai Zhang , Konrad Schindler

The field of predictive process monitoring focuses on case-level models to predict a single specific outcome such as a particular objective, (remaining) time, or next activity/remaining sequence. Recently, a longer-horizon, model-wide…

机器学习 · 计算机科学 2023-01-11 Johannes De Smedt , Jochen De Weerdt

In this paper, we propose a framework named OCSampler to explore a compact yet effective video representation with one short clip for efficient video recognition. Recent works prefer to formulate frame sampling as a sequential decision task…

计算机视觉与模式识别 · 计算机科学 2022-01-13 Jintao Lin , Haodong Duan , Kai Chen , Dahua Lin , Limin Wang

Enhancing the mathematical reasoning capabilities of Large Language Models (LLMs) is of great scientific and practical significance. Researchers typically employ process-supervised reward models (PRMs) to guide the reasoning process,…

计算与语言 · 计算机科学 2025-07-24 Wei Sun , Qianlong Du , Fuwei Cui , Jiajun Zhang

Video generation models have achieved remarkable progress in text-to-video tasks. These models are typically trained on text-video pairs with highly detailed and carefully crafted descriptions, while real-world user inputs during inference…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Jiale Cheng , Ruiliang Lyu , Xiaotao Gu , Xiao Liu , Jiazheng Xu , Yida Lu , Jiayan Teng , Zhuoyi Yang , Yuxiao Dong , Jie Tang , Hongning Wang , Minlie Huang

Procedural activities are fundamentally driven by object state transitions, yet existing instructional video benchmarks remain action-centric and cannot evaluate whether models reason about how objects evolve toward task completion. In this…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Wenliang Guo , Yu Kong

Step-by-step verifiers -- also known as process reward models (PRMs) -- are a key ingredient for test-time scaling. PRMs require step-level supervision, making them expensive to train. This work aims to build data-efficient PRMs as…

Reinforcement learning (RL) has recently achieved remarkable success in eliciting visual reasoning within Multimodal Large Language Models (MLLMs). However, existing approaches typically train separate models for different tasks and treat…

计算机视觉与模式识别 · 计算机科学 2026-04-29 Kaituo Feng , Manyuan Zhang , Hongyu Li , Kaixuan Fan , Shuang Chen , Yilei Jiang , Dian Zheng , Peiwen Sun , Yiyuan Zhang , Haoze Sun , Yan Feng , Peng Pei , Xunliang Cai , Xiangyu Yue

Reinforcement learning (RL) has become a promising paradigm for optimizing Retrieval-Augmented Generation (RAG) in complex reasoning tasks. However, traditional outcome-based RL approaches often suffer from reward sparsity and inefficient…

人工智能 · 计算机科学 2026-01-30 Zhao Wang , Ziliang Zhao , Zhicheng Dou

Agentic vision-language models are increasingly trained to "think with images" by calling image operations. However, we show that high final-answer accuracy often hides unfaithful visual reasoning: models may invoke tools on irrelevant…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Xinhai Hou , Shaoyuan Xu , Manan Biyani , Moyan Li , Jia Liu , Todd C. Hollon , Bryan Wang

Video reasoning, which requires multi-step deduction across frames, remains a major challenge for multimodal large language models (MLLMs). While reinforcement learning (RL)-based methods enhance reasoning capabilities, they often rely on…

计算机视觉与模式识别 · 计算机科学 2025-11-21 Kun Ouyang , Yuanxin Liu , Linli Yao , Yishuo Cai , Hao Zhou , Jie Zhou , Fandong Meng , Xu Sun