English
Related papers

Related papers: AMARIS: A Memory-Augmented Rubric Improvement Syst…

200 papers

Curriculum learning helps language models tackle complex reasoning by gradually increasing task difficulty. However, it often fails to generate consistent step-by-step reasoning, especially in multilingual and low-resource settings where…

The open-ended generation in LLMs usually requires multi-dimensional rubrics to adequately assess quality and guide the improvement of reinforcement learning. However, a critical dilemma inherent in this training paradigm is the imbalanced…

Machine Learning · Computer Science 2026-05-27 Yu Huang , Zihua Zhao , Zhaoxin Huan , Wanli Gu , Feng Hong , Xinmu Ge , Lin Yuan , Weichang Wu , Qiang Hu , Xiaolu Zhang , Jun Zhou , Jiangchao Yao

Adaptive Mesh Refinement (AMR) enhances the Finite Element Method, an important technique for simulating complex problems in engineering, by dynamically refining mesh regions, enabling a favorable trade-off between computational speed and…

Multiagent Systems · Computer Science 2023-10-11 Niklas Freymuth , Philipp Dahlinger , Tobias Würth , Simon Reisch , Luise Kärger , Gerhard Neumann

Reward modeling is central to alignment pipelines such as RLHF, RLAIF, and PPO-based policy optimization, yet its reliability is constrained by limited and heterogeneous human preference data that are expensive to collect at scale. While…

Machine Learning · Computer Science 2026-05-26 Payel Bhattacharjee , Osvaldo Simeone , Ravi Tandon

Efficient and accurate updating of knowledge stored in Large Language Models (LLMs) is one of the most pressing research challenges today. This paper presents Larimar - a novel, brain-inspired architecture for enhancing LLMs with a…

Recent progress in large language models (LLMs) has been propelled by reinforcement learning with verifiable rewards (RLVR) and test-time scaling. However, the limited output length of LLMs constrains the depth of reasoning attainable in a…

Artificial Intelligence · Computer Science 2025-11-17 Shulin Liu , Dong Du , Tao Yang , Yang Li , Boyu Qiu

Sparse rewards are a major bottleneck in multi-agent reinforcement learning (MARL), where simultaneous learning induces non-stationarity and makes reward design especially delicate. Reward shaping can accelerate learning, but in the…

Multiagent Systems · Computer Science 2026-05-25 Elie Abboud , Oren Gal

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a prevailing paradigm for enhancing reasoning in Multimodal Large Language Models (MLLMs). However, relying solely on outcome supervision risks reward hacking, where…

Computation and Language · Computer Science 2026-03-04 Yukun Chen , Jiaming Li , Longze Chen , Ze Gong , Jingpeng Li , Zhen Qin , Hengyu Chang , Ancheng Xu , Zhihao Yang , Hamid Alinejad-Rokny , Qiang Qu , Bo Zheng , Min Yang

Recently, rubrics have been used to guide LLM judges in capturing subjective, nuanced, multi-dimensional human preferences, and have been extended from evaluation to reward signals for reinforcement fine-tuning (RFT). However, rubric…

Reinforcement Learning (RL) has emerged as a mainstream paradigm for training Mobile GUI Agents, yet it struggles with the temporal credit assignment problem inherent in long-horizon tasks. A primary challenge lies in the trade-off between…

Reward models (RMs) play a critical role in aligning language models through the process of reinforcement learning from human feedback. RMs are trained to predict a score reflecting human preference, which requires significant time and cost…

Computation and Language · Computer Science 2024-10-21 Zihuiwen Ye , Fraser Greenlee-Scott , Max Bartolo , Phil Blunsom , Jon Ander Campos , Matthias Gallé

Medical imaging has revolutionized diagnosis, yet unnecessary procedures are rising, exposing patients to radiation and stress, limiting equitable access, and straining healthcare systems. The American College of Radiology Appropriateness…

Quantitative Methods · Quantitative Biology 2025-10-08 Anni Tziakouri , Filippo Menolascina

Scientific discoveries must be communicated clearly to realize their full potential. Without effective communication, even the most groundbreaking findings risk being overlooked or misunderstood. The primary way scientists communicate their…

Large Language Models (LLMs) are increasingly used for clinical decision support, where hallucinations and unsafe suggestions may pose direct risks to patient safety. These risks are hard to assess: subtle clinical errors are often missed…

Computation and Language · Computer Science 2026-05-14 Yinzhu Chen , Abdine Maiga , Hossein A. Rahmani , Emine Yilmaz

Graphical user interface (GUI) agents are rapidly progressing toward autonomous interaction and reliable task execution across diverse applications. However, two central challenges remain unresolved: automating the evaluation of agent…

Reinforcement Learning (RL) has significantly advanced Large Language Models (LLMs) in verifiable domains, but aligning models for open-ended generation remains profoundly challenging due to the lack of definitive rewards. Current…

Computation and Language · Computer Science 2026-05-29 Xin Guan , Xiaomeng Hu , Shen Huang , Zhenyi Wang , Bo Zhang , Zijian Li , Pengjun Xie , Bo Liu , Jiuxin Cao

Objective. Clinical AI documentation systems require evaluation methodologies that are clinically valid, economically viable, and sensitive to iterative changes. Methods requiring expert review per scoring instance are too slow and…

Artificial Intelligence · Computer Science 2026-04-28 Aaryan Shah , Andrew Hines , Alexia Downs , Denis Bajet , Paulius Mui , Fabiano Araujo , Laura Offutt , Aida Rutledge , Elizabeth Jimenez

While Reinforcement Learning with Verifiable Rewards (RLVR) is effective for deterministically checkable tasks, many vision-language tasks are partially verifiable, demanding multi-criteria supervision (e.g., perceptual details, reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Ya-Qi Yu , Hao Wang , Fangyu Hong , Xiangyang Qu , Gaojie Wu , Qiaoyu Luo , Nuo Xu , Huixin Wang , Wuheng Xu , Yongxin Liao , Zihao Chen , Haonan Li , Ziming Li , Dezhi Peng , Minghui Liao , Jihao Wu , Haoyu Ren , Dandan Tu

Open-ended generation tasks require outputs to satisfy diverse and often implicit task-specific evaluation rubrics. The sheer number of relevant rubrics leads to prohibitively high verification costs and incomplete assessments of a…

Machine Learning · Computer Science 2025-11-04 Mian Wu , Gavin Zhang , Sewon Min , Sergey Levine , Aviral Kumar

Large Reasoning Models (LRMs) face two fundamental limitations: excessive token consumption when overanalyzing simple information processing tasks, and inability to access up-to-date knowledge beyond their training data. We introduce MARS…

Artificial Intelligence · Computer Science 2026-02-03 Guoxin Chen , Zile Qiao , Wenqing Wang , Donglei Yu , Xuanzhong Chen , Hao Sun , Minpeng Liao , Kai Fan , Yong Jiang , Penguin Xie , Wayne Xin Zhao , Ruihua Song , Fei Huang