English
Related papers

Related papers: SoTA with Less: MCTS-Guided Sample Selection for D…

200 papers

Despite their outstanding capabilities, large language models (LLMs) are prone to hallucination and producing factually incorrect information. This challenge has spurred efforts in attributed text generation, which prompts LLMs to generate…

Computation and Language · Computer Science 2025-06-23 Junyi Li , Hwee Tou Ng

Recent advancements in large language models (LLMs) integrating explicit reasoning, such as OpenAI's o3-mini, DeepSeek-R1, and QWQ-32B, enable smaller models to solve complex tasks by generating intermediate reasoning steps prior to…

Machine Learning · Computer Science 2025-03-25 Jaeyeon Lee , Guantong Qi , Matthew Brady Neeley , Zhandong Liu , Hyun-Hwan Jeong

NLP models today strive for supporting multiple languages and modalities, improving accessibility for diverse users. In this paper, we evaluate their multilingual, multimodal capabilities by testing on a visual reasoning task. We observe…

Computation and Language · Computer Science 2025-02-11 Yueqi Song , Simran Khanuja , Graham Neubig

Vision-language models (VLMs) have made significant strides in reasoning, yet they often struggle with complex multimodal tasks and tend to generate overly verbose outputs. A key limitation is their reliance on chain-of-thought (CoT)…

Artificial Intelligence · Computer Science 2026-02-11 Chen Li , Han Zhang , Zhantao Yang , Fangyi Chen , Zihan Wang , Anudeepsekhar Bolimera , Marios Savvides

Large language models have recently evolved from fluent text generation to advanced reasoning across diverse domains, giving rise to reasoning language models. Among these domains, mathematical reasoning serves as a representative benchmark…

Test-Time Scaling (TTS) refers to approaches that improve reasoning performance by allocating extra computation during inference, without altering the model's parameters. While existing TTS methods operate in a discrete token space by…

Computation and Language · Computer Science 2025-05-28 Yige Xu , Xu Guo , Zhiwei Zeng , Chunyan Miao

Instruction-driven image editing with unified multimodal generative models has advanced rapidly, yet their underlying visual reasoning remains limited, leading to suboptimal performance on reasoning-centric edits. Reinforcement learning…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Hengjia Li , Liming Jiang , Qing Yan , Yizhi Song , Hao Kang , Zichuan Liu , Xin Lu , Boxi Wu , Deng Cai

Sequential decision-making under cost-sensitive tasks is prohibitively daunting, especially for the problem that has a significant impact on people's daily lives, such as malaria control, treatment recommendation. The main challenge faced…

Machine Learning · Computer Science 2021-05-06 Lixin Zou , Long Xia , Linfang Hou , Xiangyu Zhao , Dawei Yin

Recent studies demonstrate that multimodal large language models (MLLMs) can proficiently evaluate visual quality through interpretable assessments. However, existing approaches typically treat quality scoring and reasoning descriptions as…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Zhuoxuan Cai , Jian Zhang , Xinbin Yuan , Peng-Tao Jiang , Wenxiang Chen , Bowen Tang , Lujian Yao , Qiyuan Wang , Jinwen Chen , Bo Li

Multimodal reasoning in vision-language models (VLMs) typically relies on a two-stage process: supervised fine-tuning (SFT) and reinforcement learning (RL). In standard SFT, all tokens contribute equally to the loss, even though reasoning…

Artificial Intelligence · Computer Science 2026-03-20 Shaked Perek , Ben Wiesel , Avihu Dekel , Nimrod Shabtay , Eli Schwartz

Chart reasoning is a critical capability for Vision Language Models (VLMs). However, the development of open-source models is severely hindered by the lack of high-quality training data. Existing datasets suffer from a dual challenge:…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Zheng Liu , Honglin Lin , Chonghan Qin , Xiaoyang Wang , Xin Gao , Yu Li , Mengzhang Cai , Yun Zhu , Zhanping Zhong , Qizhi Pei , Zhuoshi Pan , Xiaoran Shang , Bin Cui , Conghui He , Wentao Zhang , Lijun Wu

Despite recent breakthroughs in reasoning-enhanced large language models (LLMs) like DeepSeek-R1, incorporating inference-time reasoning into machine translation (MT), where human translators naturally employ structured, multi-layered…

Computation and Language · Computer Science 2025-05-27 Minggui He , Yilun Liu , Shimin Tao , Yuanchang Luo , Hongyong Zeng , Chang Su , Li Zhang , Hongxia Ma , Daimeng Wei , Weibin Meng , Hao Yang , Boxing Chen , Osamu Yoshie

The LLMSR@XLLM25 formulates a low-resource structural reasoning task that challenges LLMs to generate interpretable, step-by-step rationales with minimal labeled data. We present Less is More, the third-place winning approach in the…

Computation and Language · Computer Science 2025-05-14 Jiahao Yuan , Xingzhe Sun , Xing Yu , Jingwen Wang , Dehui Du , Zhiqing Cui , Zixiang Di

While reasoning technology like Chain of Thought (CoT) has been widely adopted in Vision Language Action (VLA) models, it demonstrates promising capabilities in end to end autonomous driving. However, recent efforts to integrate CoT…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Yuechen Luo , Fang Li , Shaoqing Xu , Zhiyi Lai , Lei Yang , Qimao Chen , Ziang Luo , Zixun Xie , Shengyin Jiang , Jiaxin Liu , Long Chen , Bing Wang , Zhi-xin Yang

With the current surge in spatial reasoning explorations, researchers have made significant progress in understanding indoor scenes, but still struggle with diverse applications such as robotics and autonomous driving. This paper aims to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Peiwen Sun , Shiqiang Lang , Dongming Wu , Yi Ding , Kaituo Feng , Huadai Liu , Zhen Ye , Rui Liu , Yun-Hui Liu , Jianan Wang , Xiangyu Yue

Large Vision-Language Models (LVLMs) excel in multimodal reasoning and have shown impressive performance on various multimodal benchmarks. However, most of these benchmarks evaluate models primarily through multiple-choice or short-answer…

Computation and Language · Computer Science 2026-02-26 Haofeng Wang , Yu Zhang

Chain-of-Thought (CoT) prompting enhances the reasoning of large language models (LLMs) by decomposing problems into sequential steps, mimicking human logic and reducing errors. However, complex tasks with vast solution spaces and vague…

Computation and Language · Computer Science 2025-12-23 Chenghao Li , Chaoning Zhang , Yi Lu , Jiaquan Zhang , Qigan Sun , Xudong Wang , Jiwei Wei , Guoqing Wang , Yang Yang , Heng Tao Shen

Multimodal large language models (MLLMs) that think with images can interactively use tools to reason about visual inputs, but current approaches often rely on a narrow set of tools with limited real-world necessity and scalability. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Zirun Guo , Minjie Hong , Feng Zhang , Kai Jia , Tao Jin

The growing disparity between the exponential scaling of computational resources and the finite growth of high-quality text data now constrains conventional scaling approaches for large language models (LLMs). To address this challenge, we…

Reasoning has long been viewed as an emergent property of large language models (LLMs). However, recent studies challenge this assumption, showing that small language models (SLMs) can also achieve competitive reasoning performance. This…

Computation and Language · Computer Science 2025-10-01 Gaurav Srivastava , Shuxiang Cao , Xuan Wang