English
Related papers

Related papers: PRISM: A Benchmark for Programmatic Spatial-Tempor…

200 papers

Achieving fine-grained spatio-temporal understanding in videos remains a major challenge for current Video Large Multimodal Models (Video LMMs). Addressing this challenge requires mastering two core capabilities: video referring…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Ye Sun , Hao Zhang , Henghui Ding , Tiehua Zhang , Xingjun Ma , Yu-Gang Jiang

Self-evolving reasoning frameworks let LLMs improve their reasoning capabilities by iteratively generating and solving problems without external supervision, using verifiable rewards. Ideally, such systems are expected to explore a diverse…

Machine Learning · Computer Science 2026-03-17 Vaibhav Mishra

The drastic variation of motion in spatial and temporal dimensions makes the video prediction task extremely challenging. Existing RNN models obtain higher performance by deepening or widening the model. They obtain the multi-scale features…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Zhifeng Ma , Hao Zhang , Jie Liu

Video generation models have significantly advanced embodied intelligence, unlocking new possibilities for generating diverse robot data that capture perception, reasoning, and action in the physical world. However, synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Yufan Deng , Zilin Pan , Hongyu Zhang , Xiaojie Li , Ruoqing Hu , Yufei Ding , Yiming Zou , Yan Zeng , Daquan Zhou

Large Language Models (LLMs) have demonstrated remarkable capabilities across various domains, including software development, education, and technical assistance. Among these, software development is one of the key areas where LLMs are…

Computation and Language · Computer Science 2026-01-07 Inpyo Song , Eunji Jeon , Jangwon Lee

Recent advancements in improving the reasoning capabilities of Large Language Models have underscored the efficacy of Process Reward Models (PRMs) in addressing intermediate errors through structured feedback mechanisms. This study analyzes…

Computation and Language · Computer Science 2025-06-03 Zhengyu Chen , Yudong Wang , Teng Xiao , Ruochen Zhou , Xuesheng Yang , Wei Wang , Zhifang Sui , Jingang Wang

Humans can look at a static scene and instantly predict what happens next -- will moving this object cause a collision? We call this ability Causal Spatial Reasoning. However, current multimodal large language models (MLLMs) cannot do this,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Wenxin Ma , Chenlong Wang , Ruisheng Yuan , Hao Chen , Nanru Dai , S. Kevin Zhou , Yijun Yang , Alan Yuille , Jieneng Chen

Vision-Language Models (VLMs) have recently gained attention due to their competitive performance on multiple downstream tasks, achieved by following user-input instructions. However, VLMs still exhibit several limitations in visual…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Simone Alghisi , Gabriel Roccabruna , Massimo Rizzoli , Seyed Mahed Mousavi , Giuseppe Riccardi

We present the Multilingual Reasoning Gym, an extension of Reasoning Gym (Stojanovski et al., 2025), that procedurally generates verifiable reasoning problems across 14 languages. We translate templates for 94 tasks with native-speaker…

Computation and Language · Computer Science 2026-03-12 Konstantin Dobler , Simon Lehnerer , Federico Scozzafava , Jonathan Janke , Mohamed Ali

Video generation aims to produce temporally coherent sequences of visual frames, representing a pivotal advancement in Artificial Intelligence Generated Content (AIGC). Compared to static image generation, video generation poses unique…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Zhiyu Yin , Kehai Chen , Xuefeng Bai , Ruili Jiang , Juntao Li , Hongdong Li , Jin Liu , Yang Xiang , Jun Yu , Min Zhang

Reinforcement learning (RL) with unit test feedback has enhanced large language models' (LLMs) code generation, but relies on sparse rewards provided only after complete code evaluation, limiting learning efficiency and incremental…

Artificial Intelligence · Computer Science 2025-02-05 Ning Dai , Zheng Wu , Renjie Zheng , Ziyun Wei , Wenlei Shi , Xing Jin , Guanlin Liu , Chen Dun , Liang Huang , Lin Yan

In this work, we propose Perspective Reasoning for Integrated Synthesis and Mediation (PRISM), a multiple-perspective framework for addressing persistent challenges in AI alignment such as conflicting human values and specification gaming.…

Computers and Society · Computer Science 2025-03-10 Anthony Diamond

The advancement of open-source text-to-image (T2I) models has been hindered by the absence of large-scale, reasoning-focused datasets and comprehensive evaluation benchmarks, resulting in a performance gap compared to leading closed-source…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Rongyao Fang , Aldrich Yu , Chengqi Duan , Linjiang Huang , Shuai Bai , Yuxuan Cai , Kun Wang , Si Liu , Xihui Liu , Hongsheng Li

We introduce PRISM (Predictive Reasoning in Sequential Medicine), a transformer-based architecture designed to model the sequential progression of clinical decision-making processes. Unlike traditional approaches that rely on isolated…

Computation and Language · Computer Science 2025-06-16 Lionel Levine , John Santerre , Alex S. Young , T. Barry Levine , Francis Campion , Majid Sarrafzadeh

Accurate spatial reasoning in outdoor environments - covering geometry, object pose, and inter-object relationships - is fundamental to downstream tasks such as mapping, motion forecasting, and high-level planning in autonomous driving. We…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Xianda Guo , Ruijun Zhang , Yiqun Duan , Yuhang He , Dujun Nie , Wenke Huang , Chenming Zhang , Shuai Liu , Hao Zhao , Long Chen

Video large language models (Video-LLMs) have made strong progress in general video understanding, but their ability to maintain temporal object consistency remains underexplored. Existing benchmarks often emphasize event recognition,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Junzhe Chen , Siyuan Meng , Yuxi Chen , Man Zhao , Wenyao Gui , Xiaojie Guo

Joint vision-language models have shown great performance over a diverse set of tasks. However, little is known about their limitations, as the high dimensional space learned by these models makes it difficult to identify semantic errors.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Santiago Castro , Oana Ignat , Rada Mihalcea

Geospatial pixel reasoning aims to generate segmentation masks in remote sensing imagery directly from natural-language instructions. Most existing approaches follow a paradigm that fine-tunes multimodal large language models under…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Chengjie Jiang , Yunqi Zhou , Jiafeng Yan , Jing Li , Jiayang Li , Yue Zhou , Hongjie He , Jonathan Li

Interactive spatial layouts empower users to synthesize information and organize findings for sensemaking. While Large Language Models (LLMs) can automate narrative generation from spatial layouts, current collage-based and re-generation…

Human-Computer Interaction · Computer Science 2026-04-23 Xuxin Tang , Ibrahim Tahmid , Eric Krokos , Kirsten Whitley , Xuan Wang , Chris North

Procedural mistake detection (PMD) is a challenging problem of classifying whether a human user (observed through egocentric video) has successfully executed a task (specified by a procedural text). Despite significant recent efforts,…

Artificial Intelligence · Computer Science 2025-12-11 Shane Storks , Itamar Bar-Yossef , Yayuan Li , Zheyuan Zhang , Jason J. Corso , Joyce Chai