English
Related papers

Related papers: Router-R1: Teaching LLMs Multi-Round Routing and A…

200 papers

In this work, we address the problem of determining reliable policies in reinforcement learning (RL), with a focus on optimization under uncertainty and the need for performance guarantees. While classical RL algorithms aim at maximizing…

Machine Learning · Computer Science 2025-10-22 Nadir Farhi

Training reasoning language models (LMs) with reinforcement learning (RL) for one-hot correctness inherently relies on the LM being able to explore and solve its task with some chance at initialization. Furthermore, a key use case of…

Machine Learning · Computer Science 2025-10-30 Edoardo Cetin , Tianyu Zhao , Yujin Tang

Reinforcement learning (RL) is a powerful machine learning technique that enables an intelligent agent to learn an optimal policy that maximizes the cumulative rewards in sequential decision making. Most of methods in the existing…

Machine Learning · Statistics 2023-01-06 Chengchun Shi , Zhengling Qi , Jianing Wang , Fan Zhou

In recent years, general-purpose large language models (LLMs) such as GPT, Gemini, Claude, and DeepSeek have advanced at an unprecedented pace. Despite these achievements, their application to finance remains challenging, due to fragmented…

As the range of applications for Large Language Models (LLMs) continues to grow, the demand for effective serving solutions becomes increasingly critical. Despite the versatility of LLMs, no single model can optimally address all tasks and…

The recent DeepSeek-R1 has showcased the emergence of reasoning capabilities in LLMs through reinforcement learning (RL) with rule-based rewards. Despite its success in language models, its application in multi-modal domains, particularly…

Artificial Intelligence · Computer Science 2025-05-27 Zhengxi Lu , Yuxiang Chai , Yaxuan Guo , Xi Yin , Liang Liu , Hao Wang , Han Xiao , Shuai Ren , Guanjing Xiong , Hongsheng Li

Despite recent breakthroughs in reasoning-enhanced large language models (LLMs) like DeepSeek-R1, incorporating inference-time reasoning into machine translation (MT), where human translators naturally employ structured, multi-layered…

Computation and Language · Computer Science 2025-05-27 Minggui He , Yilun Liu , Shimin Tao , Yuanchang Luo , Hongyong Zeng , Chang Su , Li Zhang , Hongxia Ma , Daimeng Wei , Weibin Meng , Hao Yang , Boxing Chen , Osamu Yoshie

Retrieval-Augmented Generation (RAG) systems typically rely on a single fixed retriever, despite growing evidence that no single retriever performs optimally across all query types. In this paper, we explore a query routing approach that…

Computation and Language · Computer Science 2026-04-21 To Eun Kim , Fernando Diaz

Large language models (LLMs) are increasingly accessed as remotely hosted services by edge and enterprise clients that cannot run frontier models locally. Since models vary widely in capability and price, routing queries to models that…

Machine Learning · Computer Science 2026-02-02 Baris Askin , Shivam Patel , Anupam Nayak , Andrea Vigano , Jiin Woo , Gauri Joshi , Carlee Joe-Wong

Reinforcement Learning (RL) is a general framework concerned with an agent that seeks to maximize rewards in an environment. The learning typically happens through trial and error using explorative methods, such as epsilon-greedy. There are…

Machine Learning · Computer Science 2022-10-06 Per-Arne Andersen , Morten Goodwin , Ole-Christoffer Granmo

Large Vision-Language Models (LVLMs) have recently shown great promise in advancing robotics by combining embodied reasoning with robot control. A common approach involves training on embodied reasoning tasks related to robot control using…

Robotics · Computer Science 2026-01-19 Dongyoung Kim , Sumin Park , Huiwon Jang , Jinwoo Shin , Jaehyung Kim , Younggyo Seo

Large Language Models (LLMs) exhibit potential artificial generic intelligence recently, however, their usage is costly with high response latency. Given mixed LLMs with their own strengths and weaknesses, LLM routing aims to identify the…

Computation and Language · Computer Science 2025-02-27 Xinyuan Wang , Yanchi Liu , Wei Cheng , Xujiang Zhao , Zhengzhang Chen , Wenchao Yu , Yanjie Fu , Haifeng Chen

The pursuit of general-purpose artificial intelligence depends on large language models (LLMs) that can handle both structured reasoning and open-ended generation. We present Omni-Thinker, a unified reinforcement learning (RL) framework…

Machine Learning · Computer Science 2025-09-30 Derek Li , Jiaming Zhou , Leo Maxime Brunswic , Abbas Ghaddar , Qianyi Sun , Liheng Ma , Yu Luo , Dong Li , Mark Coates , Jianye Hao , Yingxue Zhang

Compiler auto-tuning optimizes pass sequences to improve performance metrics such as Intermediate Representation (IR) instruction count. Although recent advances leveraging Large Language Models (LLMs) have shown promise in automating…

Machine Learning · Computer Science 2025-06-23 Haolin Pan , Hongyu Lin , Haoran Luo , Yang Liu , Kaichun Yao , Libo Zhang , Mingjie Xing , Yanjun Wu

Large Language Model (LLM)-based systems, i.e. interconnected elements that include an LLM as a central component, such as conversational agents, are usually designed with monolithic, static architectures that rely on a single,…

Artificial Intelligence · Computer Science 2025-07-22 Clovis Varangot-Reille , Christophe Bouvard , Antoine Gourru , Mathieu Ciancone , Marion Schaeffer , François Jacquenet

Balancing exploration and exploitation remains a key challenge in reinforcement learning (RL). State-of-the-art RL algorithms suffer from high sample complexity, particularly in the sparse reward case, where they can do no better than to…

Machine Learning · Computer Science 2020-01-22 Philippe Morere , Gilad Francis , Tom Blau , Fabio Ramos

Large Reasoning Models (LRMs) demonstrate strong performance in complex tasks but often face the challenge of overthinking, leading to substantially high inference costs. Existing approaches synthesize shorter reasoning responses for LRMs…

Computation and Language · Computer Science 2026-03-02 Hexuan Deng , Wenxiang Jiao , Xuebo Liu , Jun Rao , Min Zhang

This paper studies the evaluation of routing algorithms from the perspective of reachability routing, where the goal is to determine all paths between a sender and a receiver. Reachability routing is becoming relevant with the changing…

Networking and Internet Architecture · Computer Science 2007-05-23 Srinidhi Varadarajan , Naren Ramakrishnan

The progress of AI is bottlenecked by the quality of evaluation, making powerful LLM-as-a-Judge models a core solution. The efficacy of these judges depends on their chain-of-thought reasoning, creating a critical need for methods that can…

Computation and Language · Computer Science 2025-10-14 Chenxi Whitehouse , Tianlu Wang , Ping Yu , Xian Li , Jason Weston , Ilia Kulikov , Swarnadeep Saha

We present ChatR1, a reasoning framework based on reinforcement learning (RL) for conversational question answering (CQA). Reasoning plays an important role in CQA, where user intent evolves across dialogue turns, and utterances are often…

Computation and Language · Computer Science 2026-04-28 Simon Lupart , Mohammad Aliannejadi , Evangelos Kanoulas