English
Related papers

Related papers: Self-Refining Vision Language Model for Robotic Fa…

200 papers

Large vision-language models (LVLMs) have shown promising performance on a variety of vision-language tasks. However, they remain susceptible to hallucinations, generating outputs misaligned with visual content or instructions. While…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Jinrui Zhang , Teng Wang , Haigang Zhang , Ping Lu , Feng Zheng

Automatically detecting and recovering from failures is an important but challenging problem for autonomous robots. Most of the recent work on learning to plan from demonstrations lacks the ability to detect and recover from errors in the…

Reinforcement Learning (RL) has shown promise in improving the reasoning abilities of Large Language Models (LLMs). However, the specific challenges of adapting RL to multimodal data and formats remain relatively unexplored. In this work,…

Machine Learning · Computer Science 2025-05-20 Zirun Guo , Minjie Hong , Tao Jin

Understanding robot behaviors and experiences through natural language is crucial for developing intelligent and transparent robotic systems. Recent advancement in large language models (LLMs) makes it possible to translate complex,…

Robotics · Computer Science 2024-11-21 Zihan Wang , Brian Liang , Varad Dhat , Zander Brumbaugh , Nick Walker , Ranjay Krishna , Maya Cakmak

Finite element discretizations of problems in computational physics often rely on adaptive mesh refinement (AMR) to preferentially resolve regions containing important features during simulation. However, these spatial refinement strategies…

Computational Engineering, Finance, and Science · Computer Science 2022-09-27 Corbin Foucart , Aaron Charous , Pierre F. J. Lermusiaux

Large Reasoning Models (LRMs) have shown impressive capabilities in multi-step reasoning tasks. However, alongside these successes, a more deceptive form of model error has emerged--Reasoning Hallucination--where logically coherent but…

Artificial Intelligence · Computer Science 2025-05-20 Zhongxiang Sun , Qipeng Wang , Haoyu Wang , Xiao Zhang , Jun Xu

Robust optimization (RO) provides a principled framework for decision-making under uncertainty, but its practical use is often limited by the need to manually reformulate uncertain optimization models into tractable deterministic…

Artificial Intelligence · Computer Science 2026-05-13 Jinbiao Chen , Shuang Jin , Guoyun Zhang , Junyu Zhang , Guanyi Wang , Hanzhang Qin

Reinforcement learning post-training has substantially improved the reasoning accuracy of vision-language models, yet the resulting policies remain poorly calibrated. Terminal correctness rewards provide no gradient that penalizes confident…

Machine Learning · Computer Science 2026-05-19 Peng Cui , Boyao Yang , Jun Zhu

In the era of Vision-Language Models (VLMs), enhancing multimodal reasoning capabilities remains a critical challenge, particularly in handling ambiguous or complex visual inputs, where initial inferences often lead to hallucinations or…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Haoyu Zhang , Yuwei Wu , Pengxiang Li , Xintong Zhang , Zhi Gao , Rui Gao , Mingyang Gao , Che Sun , Yunde Jia

Anomaly detection is vital in various industrial scenarios, including the identification of unusual patterns in production lines and the detection of manufacturing defects for quality control. Existing techniques tend to be specialized in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Xiaohao Xu , Yunkang Cao , Huaxin Zhang , Nong Sang , Xiaonan Huang

MLLMs have been successfully applied to multimodal embedding tasks, yet their generative reasoning capabilities remain underutilized. Directly incorporating chain-of-thought reasoning into embedding learning introduces two fundamental…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Yuchi Wang , Haiyang Yu , Weikang Bian , Jiefeng Long , Xiao Liang , Chao Feng , Hongsheng Li

Reasoning language models have demonstrated remarkable performance on many challenging tasks in math, science, and coding. Choosing the right reasoning model for practical deployment involves a performance and cost tradeoff at two key…

Artificial Intelligence · Computer Science 2026-03-12 Nigel Fernandez , Branislav Kveton , Ryan A. Rossi , Andrew S. Lan , Zichao Wang

Recent large reasoning models (LRMs) have made substantial progress in complex reasoning tasks, yet they often generate lengthy reasoning paths for every query, incurring unnecessary computation and latency. Existing speed-up approaches…

Computation and Language · Computer Science 2026-01-08 Zhaofeng Zhong , Wei Yuan , Tong Chen , Xiangyu Zhao , Quoc Viet Hung Nguyen , Hongzhi Yin

Pre-trained Multi-modal Large Language Models (MLLMs) provide a knowledge-rich foundation for post-training by leveraging their inherent perception and reasoning capabilities to solve complex tasks. However, the lack of an efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Yunshuang Nie , Bingqian Lin , Minzhe Niu , Kun Xiang , Jianhua Han , Guowei Huang , Xingyue Quan , Hang Xu , Bokui Chen , Xiaodan Liang

The exponential increase in software vulnerabilities has created an urgent need for automatic vulnerability repair (AVR) solutions. Recent research has formulated AVR as a sequence generation problem and has leveraged large language models…

Artificial Intelligence · Computer Science 2025-10-08 Xin-Cheng Wen , Zirui Lin , Yijun Yang , Cuiyun Gao , Deheng Ye

Large language models (LLMs) are being rapidly integrated into decision-support tools, automation workflows, and AI-enabled software systems. However, their behavior in production environments remains poorly understood, and their failure…

Artificial Intelligence · Computer Science 2025-11-27 Vaishali Vinay

Large reasoning models (LRMs) have shown remarkable progress on complex reasoning tasks. However, some questions posed to LRMs are inherently unanswerable, such as math problems lacking sufficient conditions. We find that LRMs continually…

Artificial Intelligence · Computer Science 2026-01-21 Yi Liu , Xiangyu Liu , Zequn Sun , Wei Hu

Unified multimodal models (UMMs) have emerged as a powerful paradigm for seamlessly unifying text and image understanding and generation. However, prevailing evaluations treat these abilities in isolation, such that tasks with multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yongyuan Liang , Wei Chow , Feng Li , Ziqiao Ma , Xiyao Wang , Jiageng Mao , Jiuhai Chen , Jiatao Gu , Yue Wang , Furong Huang

Formal reasoning and automated theorem proving constitute a challenging subfield of machine learning, in which machines are tasked with proving mathematical theorems using formal languages like Lean. A formal verification system can check…

Artificial Intelligence · Computer Science 2025-11-05 Azim Ospanov , Farzan Farnia , Roozbeh Yousefzadeh

Operations Research (OR) relies on expert-driven modeling-a slow and fragile process ill-suited to novel scenarios. While large language models (LLMs) can automatically translate natural language into optimization models, existing…

Computation and Language · Computer Science 2026-02-05 Yifan Shi , Jialong Shi , Jiayi Wang , Ye Fan , Jianyong Sun