English
Related papers

Related papers: AdaRubric: Task-Adaptive Rubrics for Reliable LLM …

200 papers

Reinforcement learning (RL) is pivotal for enhancing the reasoning capabilities of diffusion large language models (dLLMs). However, existing dLLM policy optimization methods suffer from two critical reliability bottlenecks: (1) reward…

Computation and Language · Computer Science 2026-05-14 Leyi Pan , Shuchang Tao , Yunpeng Zhai , Zheyu Fu , Liancheng Fang , Minghua He , Lingzhe Zhang , Zhaoyang Liu , Bolin Ding , Aiwei Liu , Lijie Wen

The evaluation of large language models (LLMs) has predominantly relied on static datasets, which offer limited scalability and fail to capture the evolving reasoning capabilities of recent models. To overcome these limitations, we propose…

Computation and Language · Computer Science 2026-03-02 Seungdong Yoa , Sanghyu Yoon , Suhee Yoon , Dongmin Kim , Ye Seul Sim , Junhyun Lee , Woohyung Lim

Reinforcement learning has substantially improved the performance of LLM agents on tasks with verifiable outcomes, but it still struggles on open-ended agent tasks with vast solution spaces (e.g., complex travel planning). Due to the…

Large language models (LLMs) are increasingly being deployed in cost and latency-sensitive settings. While chain-of-thought improves reasoning, it can waste tokens on simple requests. We study selective thinking for tool-using LLMs and…

Large language models (LLMs) are increasingly integrated into recommender systems, motivating recent interest in agentic and reasoning-based recommendation. However, most existing approaches still rely on fixed workflows, applying the same…

Information Retrieval · Computer Science 2026-02-12 Fuchun Li , Qian Li , Xingyu Gao , Bocheng Pan , Yang Wu , Jun Zhang , Huan Yu , Jie Jiang , Jinsheng Xiao , Hailong Shi

LLMs are increasingly deployed in autonomous laboratories, under the assumption that their domain priors and reasoning over iterative feedback let them converge on good designs in fewer iterations than feedback-only baselines. Current…

Machine Learning · Computer Science 2026-05-18 Marilyn Zhang , Tianfeng Chen , Fabián Barzuna , Ankita Rathod , Mark E. Whiting

Reinforcement Learning with Verifiable Rewards (RLVR) has proven effective for complex reasoning tasks with clear correctness signals such as math and coding. However, extending it to real-world reasoning tasks is challenging, as evaluation…

Machine Learning · Computer Science 2025-10-06 Anisha Gunjal , Anthony Wang , Elaine Lau , Vaskar Nath , Yunzhong He , Bing Liu , Sean Hendryx

Currently, most reinforcement learning tasks focus on domains like mathematics and programming, where verification is relatively straightforward. However, in subjective tasks such as role-playing, alignment techniques struggle to make…

Code generation with large language models (LLMs) is highly sensitive to token selection during decoding, particularly at uncertain decision points that influence program logic. While standard strategies such as greedy decoding treat all…

Software Engineering · Computer Science 2026-04-27 Kaifeng He , Mingwei Liu , Chong Wang , Zike Li , Yanlin Wang , Xin Peng , Zibin Zheng

Recent advances in test-time alignment methods, such as Best-of-N sampling, offer a simple and effective way to steer language models (LMs) toward preferred behaviors using reward models (RM). However, these approaches can be…

Computation and Language · Computer Science 2026-03-16 Vinod Raman , Hilal Asi , Satyen Kale

While Large Language Models (LLMs) excel at algorithmic code generation, they struggle with front-end development, where correctness is judged on rendered pixels and interaction. We present ReLook, an agentic, vision-grounded reinforcement…

Machine Learning · Computer Science 2025-10-14 Yuhang Li , Chenchen Zhang , Ruilin Lv , Ao Liu , Ken Deng , Yuanxing Zhang , Jiaheng Liu , Wiggin Zhou , Bo Zhou

We introduce Agent Process Reward Models (AgentPRM), a simple and scalable framework for training LLM agents to continually improve through interactions. AgentPRM follows a lightweight actor-critic paradigm, using Monte Carlo rollouts to…

Machine Learning · Computer Science 2025-02-17 Sanjiban Choudhury

Reinforcement learning with verifiable rewards has made post-training highly effective when correctness can be checked automatically. However, many important model behaviors require satisfying several qualitative criteria at once.…

Artificial Intelligence · Computer Science 2026-05-20 Utkarsh Tyagi , Xingang Guo , MohammadHossein Rezaei , Daniel George , Anas Mahmoud , Jackson Lee , Bing Liu , Yunzhong He

Deep Research Systems (DRS) aim to help users search the web, synthesize information, and deliver comprehensive investigative reports. However, how to rigorously evaluate these systems remains under-explored. Existing deep-research…

Computation and Language · Computer Science 2026-02-02 Ruizhe Li , Mingxuan Du , Benfeng Xu , Chiwei Zhu , Xiaorui Wang , Zhendong Mao

Predictive modeling over relational databases (RDBs) powers applications, yet remains challenging due to capturing both cross-table dependencies and complex feature interactions. Relational Deep Learning (RDL) methods automate feature…

Machine Learning · Computer Science 2026-02-27 Zhikai Chen , Han Xie , Jian Zhang , Jiliang Tang , Xiang Song , Huzefa Rangwala

Optimizing LLM-based agentic workflows is challenging for scaling AI capabilities. Current methods rely on coarse, end-to-end evaluation signals and lack fine-grained signals on where to refine, often resulting in inefficient or low-impact…

Artificial Intelligence · Computer Science 2026-02-03 Zihan Ma , Zhikai Zhao , Chuanbo Hua , Federico Berto , Jinkyoo Park

Modelling and exploiting teammates' policies in cooperative multi-agent systems have long been an interest and also a big challenge for the reinforcement learning (RL) community. The interest lies in the fact that if the agent knows the…

Machine Learning · Computer Science 2018-11-20 Hangyu Mao , Zhengchao Zhang , Zhen Xiao , Zhibo Gong

While Reinforcement Learning with Verifiable Rewards (RLVR) is effective for deterministically checkable tasks, many vision-language tasks are partially verifiable, demanding multi-criteria supervision (e.g., perceptual details, reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Ya-Qi Yu , Hao Wang , Fangyu Hong , Xiangyang Qu , Gaojie Wu , Qiaoyu Luo , Nuo Xu , Huixin Wang , Wuheng Xu , Yongxin Liao , Zihao Chen , Haonan Li , Ziming Li , Dezhi Peng , Minghui Liao , Jihao Wu , Haoyu Ren , Dandan Tu

Recent advances in image synthesis have been propelled by powerful generative models, such as Masked Generative Transformers (MaskGIT), autoregressive models, diffusion models, and rectified flow models. A common principle behind their…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Zanlin Ni , Yulin Wang , Yeguo Hua , Renping Zhou , Jiayi Guo , Jun Song , Bo Zheng , Gao Huang

Multi-agent architectures built on large language models (LLMs) have demonstrated the potential to realize swarm intelligence through well-crafted collaboration. However, the substantial burden of manual orchestration inherently raises an…

Artificial Intelligence · Computer Science 2026-02-10 Rui Li , Zeyu Zhang , Xiaohe Bo , Quanyu Dai , Chaozhuo Li , Feng Wen , Xu Chen