English
Related papers

Related papers: AutoPRM: Automating Procedural Supervision for Mul…

200 papers

With rapid advances in code generation, reasoning, and problem-solving, Large Language Models (LLMs) are increasingly applied in robotics. Most existing work focuses on high-level tasks such as task decomposition. A few studies have…

Robotics · Computer Science 2025-07-29 Zhongchao Zhou , Yuxi Lu , Yaonan Zhu , Yifan Zhao , Bin He , Liang He , Wenwen Yu , Yusuke Iwasawa

AI tasks encompass a wide range of domains and fields. While numerous AI models have been designed for specific tasks and applications, they often require considerable human efforts in finding the right model architecture, optimization…

Computation and Language · Computer Science 2023-05-05 Shujian Zhang , Chengyue Gong , Lemeng Wu , Xingchao Liu , Mingyuan Zhou

The evolution of autonomous driving has made remarkable advancements in recent years, evolving into a tangible reality. However, a human-centric large-scale adoption hinges on meeting a variety of multifaceted requirements. To ensure that…

Computation and Language · Computer Science 2023-12-21 Yi Yang , Qingwen Zhang , Ci Li , Daniel Simões Marta , Nazre Batool , John Folkesson

Self-Correction aims to enable large language models (LLMs) to self-verify and self-refine their initial responses without external feedback. However, LLMs often fail to effectively self-verify and generate correct feedback, further…

Computation and Language · Computer Science 2025-05-28 Xiaoshuai Song , Yanan Wu , Weixun Wang , Jiaheng Liu , Wenbo Su , Bo Zheng

Process reward models (PRMs) enhance complex reasoning in large language models (LLMs) by evaluating candidate solutions step-by-step and selecting answers based on aggregated step scores. While effective in domains such as mathematics,…

Computation and Language · Computer Science 2026-01-26 Lei Tang , Wei Zhou , Mohsen Mesgar

Under pure textual modality, Large Language Models (LLMs) have demonstrated remarkable success in complex reasoning tasks by decomposing them into simpler sub-problems. However, Multimodal Large Language Models (MLLMs) still struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Jingming Liu , Yumeng Li , Boyuan Xiao , Yichang Jian , Ziang Qin , Tianjia Shao , Yao-Xiang Ding , Kun Zhou

We present SelfPrompt, a novel prompt-tuning approach for vision-language models (VLMs) in a semi-supervised learning setup. Existing methods for tuning VLMs in semi-supervised setups struggle with the negative impact of the miscalibrated…

Computer Vision and Pattern Recognition · Computer Science 2025-01-30 Shuvendu Roy , Ali Etemad

This technical report presents our solution for the RoboSense Challenge at IROS 2025, which evaluates Vision-Language Models (VLMs) on autonomous driving scene understanding across perception, prediction, planning, and corruption detection…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Aodi Wu , Xubo Luo

Robust optimization (RO) provides a principled framework for decision-making under uncertainty, but its practical use is often limited by the need to manually reformulate uncertain optimization models into tractable deterministic…

Artificial Intelligence · Computer Science 2026-05-13 Jinbiao Chen , Shuang Jin , Guoyun Zhang , Junyu Zhang , Guanyi Wang , Hanzhang Qin

Role-playing has emerged as an effective technique for enhancing the reasoning capabilities of large language models (LLMs). However, existing methods primarily rely on prompt engineering, which often lacks stability and interpretability.…

Computation and Language · Computer Science 2025-09-30 Anyi Wang , Dong Shu , Yifan Wang , Yunpu Ma , Mengnan Du

While intelligent virtual assistants like Siri, Alexa, and Google Assistant have become ubiquitous in modern life, they still face limitations in their ability to follow multi-step instructions and accomplish complex goals articulated in…

Machine Learning · Computer Science 2023-12-13 Yanchu Guan , Dong Wang , Zhixuan Chu , Shiyu Wang , Feiyue Ni , Ruihua Song , Longfei Li , Jinjie Gu , Chenyi Zhuang

In multi-hop question answering (MHQA) tasks, Chain of Thought (CoT) improves the quality of generation by guiding large language models (LLMs) through multi-step reasoning, and Knowledge Graphs (KGs) reduce hallucinations via semantic…

Computation and Language · Computer Science 2025-12-02 Xinyi Wang , Yiping Song , Zhiliang Tian , Bo Liu , Tingjin Luo , Minlie Huang

While large language models (LLMs) have significantly advanced mathematical reasoning, Process Reward Models (PRMs) have been developed to evaluate the logical validity of reasoning steps. However, PRMs still struggle with…

Artificial Intelligence · Computer Science 2025-02-21 Jiachen Zhu , Congmin Zheng , Jianghao Lin , Kounianhua Du , Ying Wen , Yong Yu , Jun Wang , Weinan Zhang

In robotic task planning, symbolic planners using rule-based representations like PDDL are effective but struggle with long-sequential tasks in complicated environments due to exponentially increasing search space. Meanwhile, LLM-based…

Robotics · Computer Science 2025-04-01 Minseo Kwon , Yaesol Kim , Young J. Kim

Prompt Optimization has emerged as a crucial approach due to its capabilities in steering Large Language Models to solve various tasks. However, current works mainly rely on the random rewriting ability of LLMs, and the optimization process…

Computation and Language · Computer Science 2025-10-22 Tao Tao , Guanghui Zhu , Lang Guo , Hongyi Chen , Chunfeng Yuan , Yihua Huang

Large Language Models (LLMs) have shown strong promise for robotic task planning, particularly through the automatic generation of symbolic planning domains. However, prior work mainly treats generated domains as planning utilities. Such…

Robotics · Computer Science 2026-05-14 Jinbang Huang , Zhiyuan Li , Yuanzhao Hu , Zhanguang Zhang , Mark Coates , Xingyue Quan , Yingxue Zhang

Multimodal Large Language Models (MLLMs) have achieved impressive performances in mathematical reasoning, yet they remain vulnerable to visual hallucinations and logical inconsistencies that standard outcome-based supervision fails to…

Artificial Intelligence · Computer Science 2026-01-01 Peng Kuang , Xiangxiang Wang , Wentao Liu , Jian Dong , Kaidi Xu

Process Reward Models (PRMs) are crucial in complex reasoning and problem-solving tasks (e.g., LLM agents with long-horizon decision-making) by verifying the correctness of each intermediate reasoning step. In real-world scenarios, LLMs may…

Artificial Intelligence · Computer Science 2025-05-30 Xiang Li , Haiyang Yu , Xinghua Zhang , Ziyang Huang , Shizhu He , Kang Liu , Jun Zhao , Fei Huang , Yongbin Li

Recent work increasingly focuses on improving the reasoning capabilities of Multimodal Large Language Models (MLLMs). Among existing methods, Process Reward Models (PRMs) stand out for offering dense, step-wise supervision to guide…

Autoprompting is the process of automatically selecting optimized prompts for language models, which is gaining popularity due to the rapid development of prompt engineering driven by extensive research in the field of large language models…

Computation and Language · Computer Science 2025-09-09 Ernest A. Dyagin , Nikita I. Kulin , Artur R. Khairullin , Viktor N. Zhuravlev , Alena N. Sitkina