English
Related papers

Related papers: TRACE: Textual Reasoning for Affordance Coordinate…

200 papers

Constructing valid and informative conformal prediction regions for multi-dimensional outputs remains a fundamental challenge. While conformal prediction provides finite-sample, distribution-free coverage guarantees, its practical…

Machine Learning · Statistics 2026-05-11 Zhenhan Fang , Aixin Tan , Jian Huang

Aligned large language models (LLMs) demonstrate exceptional capabilities in task-solving, following instructions, and ensuring safety. However, the continual learning aspect of these aligned LLMs has been largely overlooked. Existing…

Computation and Language · Computer Science 2023-10-11 Xiao Wang , Yuansen Zhang , Tianze Chen , Songyang Gao , Senjie Jin , Xianjun Yang , Zhiheng Xi , Rui Zheng , Yicheng Zou , Tao Gui , Qi Zhang , Xuanjing Huang

Retrieval-Augmented Generation (RAG) delivers substantial value in knowledge-intensive applications. However, its generated responses often lack transparent reasoning paths that trace back to source evidence from retrieved documents. This…

Computation and Language · Computer Science 2026-01-30 Jingyi Ren , Yekun Xu , Xiaolong Wang , Weitao Li , Ante Wang , Weizhi Ma , Yang Liu

Reliable mathematical and scientific reasoning remains an open challenge for large vision-language models. Standard final-answer evaluation often masks reasoning errors, allowing silent failures to persist. To address this gap, we introduce…

Artificial Intelligence · Computer Science 2025-12-15 Shima Imani , Seungwhan Moon , Lambert Mathias , Lu Zhang , Babak Damavandi

Mobile robot platforms will increasingly be tasked with activities that involve grasping and manipulating objects in open world environments. Affordance understanding provides a robot with means to realise its goals and execute its tasks,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Gertjan Burghouts , Marianne Schaaphok , Michael van Bekkum , Wouter Meijer , Fieke Hillerström , Jelle van Mil

Test-time scaling improves the reasoning performance of large language models but often results in token-inefficient overthinking, where models continue reasoning beyond what is necessary for a correct answer. Existing dynamic early-exit…

Artificial Intelligence · Computer Science 2026-04-21 Jiakun Li , Xingwei He , Kefan Li , Hongzheng Chai , Hongyue Yu , Yuan Yuan

Semantic interpretability in Reinforcement Learning (RL) enables transparency and verifiability of decision-making. Achieving semantic interpretability in reinforcement learning requires (1) a feature space composed of human-understandable…

Artificial Intelligence · Computer Science 2025-11-03 Zhaoxin Li , Zhang Xi-Jia , Batuhan Altundas , Letian Chen , Rohan Paleja , Matthew Gombolay

Reinforcement learning (RL) is a promising approach for robotic manipulation, but it can suffer from low sample efficiency and requires extensive exploration of large state-action spaces. Recent methods leverage the commonsense knowledge…

Robotics · Computer Science 2026-04-15 Jelle Luijkx , Runyu Ma , Zlatan Ajanović , Jens Kober

Chain-of-thought (CoT) reasoning has enabled large language models (LLMs) to utilize additional computation through intermediate tokens to solve complex tasks. However, we posit that typical reasoning traces contain many redundant tokens,…

Computation and Language · Computer Science 2025-06-11 Tergel Munkhbat , Namgyu Ho , Seo Hyun Kim , Yongjin Yang , Yujin Kim , Se-Young Yun

Large Language Models (LLMs) demonstrate the ability to solve reasoning and mathematical problems using the Chain-of-Thought (CoT) technique. Expanding CoT length, as seen in models such as DeepSeek-R1, significantly enhances this reasoning…

Computation and Language · Computer Science 2025-07-15 Zihao Li , Xu Wang , Yuzhe Yang , Ziyu Yao , Haoyi Xiong , Mengnan Du

Robot foundation models, particularly Vision-Language-Action (VLA) models, have garnered significant attention for their ability to enhance robot policy learning, greatly improving robot's generalization and robustness. OpenAI's recent…

Inference-time scaling techniques have significantly bolstered the reasoning capabilities of large language models (LLMs) by harnessing additional computational effort at inference without retraining. Similarly, Chain-of-Thought (CoT)…

Machine Learning · Computer Science 2025-06-19 Baohao Liao , Hanze Dong , Yuhui Xu , Doyen Sahoo , Christof Monz , Junnan Li , Caiming Xiong

While Vision-Language Models (VLMs) excel in many areas, they struggle with complex spatial reasoning, which requires problem decomposition and strategic tool use. Fine-tuning smaller, more deployable models offers an efficient path to…

Machine Learning · Computer Science 2025-11-04 Gio Huh , Dhruv Sheth , Rayhan Zirvi , Frank Xiao

Vision-language models (VLMs) have recently demonstrated strong efficacy as visual assistants that can parse natural queries about the visual content and generate human-like outputs. In this work, we explore the ability of these models to…

Computation and Language · Computer Science 2024-03-21 Yangyi Chen , Karan Sikka , Michael Cogswell , Heng Ji , Ajay Divakaran

Video Temporal Grounding (VTG) is a crucial capability for video understanding models and plays a vital role in downstream tasks such as video browsing and editing. To effectively handle various tasks simultaneously and enable zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Yongxin Guo , Jingyu Liu , Mingda Li , Qingbin Liu , Xi Chen , Xiaoying Tang

Affordance information about a scene provides important clues as to what actions may be executed in pursuit of meeting a specified goal state. Thus, integrating affordance-based reasoning into symbolic action plannning pipelines would…

Robotics · Computer Science 2020-09-15 Fu-Jen Chu , Ruinian Xu , Chao Tang , Patricio A. Vela

Multimodal Object-Entity Relation Extraction (MORE) is a challenging task in information extraction research. It aims to identify relations between visual objects and textual entities, requiring complex multimodal understanding and…

Multimedia · Computer Science 2026-03-11 Xiang Yuan , Xu Chu , Xinrong Chen , Haochen Li , Zonghong Dai , Hongcheng Fan , Xiaoyue Yuan , Weiping Li , Tong Mo

Affordance grounding focuses on predicting the specific regions of objects that are associated with the actions to be performed by robots. It plays a vital role in the fields of human-robot interaction, human-object interaction, embodied…

Numerous large language model (LLM) agents have been built for different tasks like web navigation and online shopping due to LLM's wide knowledge and text-understanding ability. Among these works, many of them utilize in-context examples…

Artificial Intelligence · Computer Science 2024-03-12 Ruiwen Zhou , Yingxuan Yang , Muning Wen , Ying Wen , Wenhao Wang , Chunling Xi , Guoqiang Xu , Yong Yu , Weinan Zhang

Chain-of-thought (CoT) reasoning improves large language model performance on complex tasks, but often produces excessively long and inefficient reasoning traces. Existing methods shorten CoTs using length penalties or global entropy…

Artificial Intelligence · Computer Science 2026-04-08 Xuan Xiong , Huan Liu , Li Gu , Zhixiang Chi , Yue Qiu , Yuanhao Yu , Yang Wang