English
Related papers

Related papers: SSR-Zero: Simple Self-Rewarding Reinforcement Lear…

200 papers

Meta learning has been widely used to exploit rich-resource source tasks to improve the performance of low-resource target tasks. Unfortunately, most existing meta learning approaches treat different source tasks equally, ignoring the…

Computation and Language · Computer Science 2025-04-14 Yu Fu , Jie He , Yifan Yang , Qun Liu , Deyi Xiong

Multimodal Large Language Models (MLLMs) have shown strong performance in document image tasks, especially Optical Character Recognition (OCR). However, they struggle with Document Image Machine Translation (DIMT), which requires handling…

Computation and Language · Computer Science 2025-07-14 Yupu Liang , Yaping Zhang , Zhiyang Zhang , Zhiyuan Chen , Yang Zhao , Lu Xiang , Chengqing Zong , Yu Zhou

Table reasoning (TR) requires structured reasoning over semi-structured tabular data and remains challenging, particularly for small language models (SLMs, e.g., LLaMA-8B) due to their limited capacity compared to large LMs (LLMs, e.g.,…

Machine Learning · Computer Science 2025-06-09 Rihui Jin , Zheyu Xin , Xing Xie , Zuoyi Li , Guilin Qi , Yongrui Chen , Xinbang Dai , Tongtong Wu , Gholamreza Haffari

Large Language Models (LLMs) have made substantial strides in structured tasks through Reinforcement Learning (RL), demonstrating proficiency in mathematical reasoning and code generation. However, applying RL in broader domains like…

Computation and Language · Computer Science 2025-02-10 Hao Sun , Yunyi Shen , Jean-Francois Ton , Mihaela van der Schaar

Perfect machine translation (MT) would render cross-lingual transfer (XLT) by means of multilingual language models (mLMs) superfluous. Given, on the one hand, the large body of work on improving XLT with mLMs and, on the other hand, recent…

Computation and Language · Computer Science 2024-07-11 Benedikt Ebing , Goran Glavaš

Large language models (LLMs) have exhibited remarkable performance in various natural language processing tasks. Techniques like instruction tuning have effectively enhanced the proficiency of LLMs in the downstream task of machine…

Computation and Language · Computer Science 2024-06-13 Yutong Wang , Jiali Zeng , Xuebo Liu , Fandong Meng , Jie Zhou , Min Zhang

Equipping large language models (LLMs) with complex, interleaved reasoning and tool-use capabilities has become a key focus in agentic AI research, especially with recent advances in reasoning-oriented (``thinking'') models. Such…

Artificial Intelligence · Computer Science 2025-09-10 Xuan-Phi Nguyen , Shrey Pandit , Revanth Gangi Reddy , Austin Xu , Silvio Savarese , Caiming Xiong , Shafiq Joty

Techniques that learn improved representations via offline data or self-supervised objectives have shown impressive results in traditional reinforcement learning (RL). Nevertheless, it is unclear how improved representation learning can…

Computation and Language · Computer Science 2024-10-25 Vaskar Nath , Dylan Slack , Jeff Da , Yuntao Ma , Hugh Zhang , Spencer Whitehead , Sean Hendryx

Reinforcement learning (RL) is a promising approach for aligning large language models (LLMs) knowledge with sequential decision-making tasks. However, few studies have thoroughly investigated the impact on LLM agents capabilities of…

In constrained reinforcement learning (RL), a learning agent seeks to not only optimize the overall reward but also satisfy the additional safety, diversity, or budget constraints. Consequently, existing constrained RL solutions require…

Machine Learning · Computer Science 2021-07-13 Sobhan Miryoosefi , Chi Jin

Language models often struggle to follow multi-constraint instructions that are crucial for real-world applications. Existing reinforcement learning (RL) approaches suffer from dependency on external supervision and sparse reward signals…

Computation and Language · Computer Science 2026-04-15 Qingyu Ren , Qianyu He , Powei Chang , Jie Zeng , Zeye Sun , Fei Yu , Jiaqing Liang , Yanghua Xiao

Reinforcement learning with verifiable rewards (RLVR) has improved the reasoning ability of large language models, yet training remains costly because many rollouts contribute little to optimization, considering the amount of computation…

Machine Learning · Computer Science 2026-02-20 Yan Sun , Jia Guo , Stanley Kok , Zihao Wang , Zujie Wen , Zhiqiang Zhang

We explore a method for improving the performance of large language models through self-reflection and reinforcement learning. By incentivizing the model to generate better self-reflections when it answers incorrectly, we demonstrate that a…

Computation and Language · Computer Science 2025-06-02 Shelly Bensal , Umar Jamil , Christopher Bryant , Melisa Russak , Kiran Kamble , Dmytro Mozolevskyi , Muayad Ali , Waseem AlShikh

This study evaluates the performance of Large Language Models (LLMs) on SemEval-2020 Task 4 dataset, focusing on commonsense validation and explanation. Our methodology involves evaluating multiple LLMs, including LLaMA3-70B, Gemma2-9B, and…

Computation and Language · Computer Science 2025-02-25 Rawand Alfugaha , Mohammad AL-Smadi

This paper examines the problem of adapting neural machine translation systems to new, low-resourced languages (LRLs) as effectively and rapidly as possible. We propose methods based on starting with massively multilingual "seed models",…

Computation and Language · Computer Science 2018-08-14 Graham Neubig , Junjie Hu

Recent RL methods have substantially improved the reasoning abilities of LLMs. Existing reward designs mainly follow two paradigms: (1) Reinforcement learning with verifiable rewards (RLVR) derives outcome signals from executable checks or…

Computation and Language · Computer Science 2026-05-25 Sirui Chen , Lei Xu , Yuying Zhao , Yutian Chen , Yu Wang , Beier Zhu , Hanwang Zhang , Shengjie Zhao , Chaochao Lu

Deep reinforcement learning (RL) is a powerful approach to complex decision making. However, one issue that limits its practical application is its brittleness, sometimes failing to train in the presence of small changes in the environment.…

Machine Learning · Computer Science 2025-01-27 Jung-Hoon Cho , Vindula Jayawardana , Sirui Li , Cathy Wu

Large Language Models (LLMs) are rapidly surpassing human knowledge in many domains. While improving these models traditionally relies on costly human data, recent self-rewarding mechanisms (Yuan et al., 2024) have shown that LLMs can…

Computation and Language · Computer Science 2024-07-31 Tianhao Wu , Weizhe Yuan , Olga Golovneva , Jing Xu , Yuandong Tian , Jiantao Jiao , Jason Weston , Sainbayar Sukhbaatar

Reinforcement Learning with Verifiable Rewards~(RLVR) has emerged as a powerful learn-to-reason paradigm for large reasoning models to tackle complex tasks. However, the current RLVR paradigm is still not efficient enough, as it works in a…

Computation and Language · Computer Science 2026-03-10 Junjie Zhang , Guozheng Ma , Shunyu Liu , Haoyu Wang , Jiaxing Huang , Ting-En Lin , Fei Huang , Yongbin Li , Dacheng Tao

Reinforcement learning with verifiable rewards (RLVR) has been shown to enhance the reasoning capabilities of large language models (LLMs), enabling the development of large reasoning models (LRMs). However, LRMs such as DeepSeek-R1 and…

Artificial Intelligence · Computer Science 2025-11-13 Yuhao Wang , Xiaopeng Li , Cheng Gong , Ziru Liu , Suiyun Zhang , Rui Liu , Xiangyu Zhao