中文
相关论文

相关论文: Small LLMs Do Not Learn a Generalizable Theory of …

200 篇论文

Reinforcement Learning with Verifiable Rewards (RLVR) has recently strengthened LLM reasoning, but its focus on final answer correctness leaves a critical gap: it does not ensure the robustness of the reasoning process itself. We adopt a…

机器学习 · 计算机科学 2026-02-10 Hyunseok Lee , Soheil Abbasloo , Jihoon Tack , Jinwoo Shin

Reinforcement Learning with Verifiable Rewards(RLVR) has demonstrated great potential in enhancing the reasoning capabilities of large language models (LLMs). However, its success has thus far been largely confined to the mathematical and…

人工智能 · 计算机科学 2026-02-05 Mengyu Zhang , Siyu Ding , Weichong Yin , Yu Sun , Hua Wu

We investigate how well large language models (LLMs) generalize across different task difficulties, a key question for effective data curation and evaluation. Existing research is mixed regarding whether training on easier or harder data…

计算与语言 · 计算机科学 2025-11-27 Yeganeh Kordi , Nihal V. Nayak , Max Zuo , Ilana Nguyen , Stephen H. Bach

Learning to rank (LTR) plays a crucial role in various Information Retrieval (IR) tasks. Although supervised LTR methods based on fine-grained relevance labels (e.g., document-level annotations) have achieved significant success, their…

信息检索 · 计算机科学 2025-08-21 Yiteng Tu , Zhichao Xu , Tao Yang , Weihang Su , Yujia Zhou , Yiqun Liu , Fen Lin , Qin Liu , Qingyao Ai

Algorithmic trading requires short-term tactical decisions consistent with long-term financial objectives. Reinforcement Learning (RL) has been applied to such problems, but adoption is limited by myopic behaviour and opaque policies. Large…

机器学习 · 计算机科学 2025-10-28 Adam Darmanin , Vince Vella

Reinforcement learning (RL) is central to improving reasoning in large language models (LLMs) but typically requires ground-truth rewards. Test-Time Reinforcement Learning (TTRL) removes this need by using majority-vote rewards, but relies…

机器学习 · 计算机科学 2025-10-06 Aleksei Arzhantsev , Otmane Sakhi , Flavian Vasile

Reinforcement learning (RL) finetuning has become a key technique for enhancing large language models (LLMs) on reasoning-intensive tasks, motivating its extension to vision-language models (VLMs). While RL-tuned VLMs improve on visual…

机器学习 · 计算机科学 2026-05-22 Rosie Zhao , Anshul Shah , Xiaoyu Zhu , Xinke Deng , Zhongyu Jiang , Yang Yang , Joerg Liebelt , Arnab Mondal

Recent advances in post-training techniques have endowed Large Language Models (LLMs) with enhanced capabilities for tackling complex, logic-intensive tasks through the generation of supplementary planning tokens. This development raises a…

计算与语言 · 计算机科学 2026-04-29 Pratham Singla , Shivank Garg , Ayush Singh , Ishan Garg , Ketan Suhaas Saichandran

Large language models (LLMs) have demonstrated strong persuasive capabilities comparable to those of humans, offering promising benefits while raising societal concerns. However, systematically evaluating the persuasive capabilities of LLMs…

人工智能 · 计算机科学 2026-03-10 Zirui Cheng , Jiaxuan You

Large language models (LLMs) are increasingly evaluated on reasoning tasks, yet their logical abilities remain contested. To address this, we study LLMs' reasoning in a well-defined fragment of logic: syllogistic reasoning. We cast the…

计算与语言 · 计算机科学 2026-01-27 Leonardo Bertolazzi , Manuel Vargas Guzmán , Raffaella Bernardi , Maciej Malicki , Jakub Szymanik

Through reinforcement learning with verifiable rewards (RLVR), large language models have achieved substantial progress in domains with easily verifiable outcomes, such as mathematics and coding. However, when applied to more complex tasks…

计算与语言 · 计算机科学 2025-10-01 Qiyao Ma , Yunsheng Shi , Hongtao Tian , Chao Wang , Weiming Chang , Ting Yao

Recent advances in large language models (LLMs) have demonstrated remarkable capabilities in reasoning and tool utilization. However, the generalization of tool-augmented reinforcement learning (RL) across diverse domains remains a…

机器学习 · 计算机科学 2026-01-08 Zhengyu Chen , Jinluan Yang , Teng Xiao , Ruochen Zhou , Luan Zhang , Xiangyu Xi , Xiaowei Shi , Wei Wang , Jinggang Wang

Autonomous vehicle navigation in complex environments such as dense and fast-moving highways and merging scenarios remains an active area of research. A key limitation of RL is its reliance on well-specified reward functions, which often…

机器学习 · 计算机科学 2025-11-18 Timur Anvar , Jeffrey Chen , Yuyan Wang , Rohan Chandra

Language has long been conceived as an essential tool for human reasoning. The breakthrough of Large Language Models (LLMs) has sparked significant research interest in leveraging these models to tackle complex reasoning tasks. Researchers…

A prominent achievement of natural language processing (NLP) is its ability to understand and generate meaningful human language. This capability relies on complex feedforward transformer block architectures pre-trained on large language…

计算与语言 · 计算机科学 2025-11-11 Ronit D. Gross , Yarden Tzach , Tal Halevi , Ella Koresh , Ido Kanter

This study explored how large language models (LLMs) perform in two areas related to art: writing critiques of artworks and reasoning about mental states (Theory of Mind, or ToM) in art-related situations. For the critique generation part,…

计算与语言 · 计算机科学 2025-09-16 Takaya Arita , Wenxian Zheng , Reiji Suzuki , Fuminori Akiba

Reinforcement learning (RL) is frequently used to increase performance in text generation tasks, including machine translation (MT), notably through the use of Minimum Risk Training (MRT) and Generative Adversarial Networks (GAN). However,…

计算与语言 · 计算机科学 2020-01-16 Leshem Choshen , Lior Fox , Zohar Aizenbud , Omri Abend

Large language models (LLMs) are increasingly tested for a "Theory of Mind" (ToM) - the ability to attribute mental states to oneself and others. Yet most evaluations stop at explicit belief attribution in classical toy stories or stylized…

计算与语言 · 计算机科学 2026-03-03 Yuling Gu , Oyvind Tafjord , Hyunwoo Kim , Jared Moore , Ronan Le Bras , Peter Clark , Yejin Choi

Despite the success of large language models (LLMs) in various natural language processing (NLP) tasks, the stored knowledge in these models may inevitably be incomplete, out-of-date, or incorrect. This motivates the need to utilize…

计算与语言 · 计算机科学 2023-01-03 Hangfeng He , Hongming Zhang , Dan Roth

Reinforcement learning with verifiable outcome rewards (RLVR) has effectively scaled up chain-of-thought (CoT) reasoning in large language models (LLMs). Yet, its efficacy in training vision-language model (VLM) agents for goal-directed…

计算机视觉与模式识别 · 计算机科学 2025-07-14 Tong Wei , Yijun Yang , Junliang Xing , Yuanchun Shi , Zongqing Lu , Deheng Ye
‹ 上一页 1 8 9 10 下一页 ›