English
Related papers

Related papers: Ares: Adaptive Reasoning Effort Selection for Effi…

200 papers

Large reasoning models (LRMs) achieve state-of-the-art performance by generating long chains-of-thought, but often waste computation on redundant reasoning after the correct answer has already been reached. We introduce Early-Stopping for…

Artificial Intelligence · Computer Science 2026-02-11 Junda Wang , Zhichao Yang , Dongxu Zhang , Sanjit Singh Batra , Robert E. Tillman

Single-step retrieval-augmented generation (RAG) provides an efficient way to incorporate external information for simple question answering tasks but struggles with complex questions. Agentic RAG extends this paradigm by replacing…

Computation and Language · Computer Science 2026-05-08 Yijia Zheng , Marcel Worring

Conventional recommendation systems (RSs) are typically optimized to enhance performance metrics uniformly across all training samples. This makes it hard for data-driven RSs to cater to a diverse set of users due to the varying properties…

Information Retrieval · Computer Science 2024-05-03 Kirandeep Kaur , Chirag Shah

Recent advances in Large Language Models (LLMs) and Large Reasoning Models (LRMs) have enabled agentic search systems that interleave multi-step reasoning with external tool use. However, existing frameworks largely rely on unstructured…

Information Retrieval · Computer Science 2025-12-29 Shuting Wang , Qiaolin Xia , Vich Wang , Herberttli , Bobsimons , Zhicheng Dou

Large language models (LLMs) are increasingly applied to ranking tasks in retrieval and recommendation. Although reasoning prompting can enhance ranking utility, our preliminary exploration reveals that its benefits are inconsistent and…

Information Retrieval · Computer Science 2026-01-27 Huizhong Guo , Tianjun Wei , Dongxia Wang , Yingpeng Du , Ziyan Wang , Jie Zhang , Zhu Sun

Enhancing the capability of large language models (LLMs) in reasoning has gained significant attention in recent years. Previous studies have demonstrated the effectiveness of various prompting strategies in aiding LLMs in reasoning (called…

Artificial Intelligence · Computer Science 2025-08-08 Murong Yue , Wenlin Yao , Haitao Mi , Dian Yu , Ziyu Yao , Dong Yu

Reasoning-capable large language models (LLMs) have recently been adopted as automated judges, but their benefits and costs in LLM-as-a-Judge settings remain unclear. Through controlled comparisons between reasoning and non-reasoning…

Artificial Intelligence · Computer Science 2026-05-12 Wenbo Zhang , Lijinghua Zhang , Liner Xiang , Hengrui Cai

Model ensemble is a useful approach in reinforcement learning (RL) for training effective agents. Despite wide success of RL, training effective agents remains difficult due to the multitude of factors requiring careful tuning, such as…

Machine Learning · Computer Science 2025-05-22 Yiwen Song , Qianyue Hao , Qingmin Liao , Jian Yuan , Yong Li

Multimodal large language models (MLLMs) have enabled LLM-based agents to directly interact with application user interfaces (UIs), enhancing agents' performance in complex tasks. However, these agents often suffer from high latency and low…

Artificial Intelligence · Computer Science 2025-05-20 Junting Lu , Zhiyang Zhang , Fangkai Yang , Jue Zhang , Lu Wang , Chao Du , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang , Qi Zhang

While Large Language Models (LLMs) excel in certain reasoning tasks, they struggle in multi-agent games where the final outcome depends on the joint strategies of all agents. In multi-agent games, the non-stationarity of other agents brings…

Artificial Intelligence · Computer Science 2026-05-26 Yidong He , Yutao Lai , Pengxu Yang , Jiarui Gan , Jiexin Wang , Yi Cai , Mengchen Zhao

In the realm of AI, large language models (LLMs) like GPT-4, central to the operation of AI agents, predominantly operate in the cloud, incurring high operational costs. With local-based small language models (SLMs) becoming more accurate,…

Machine Learning · Computer Science 2025-04-02 Shiyi Liu , Haiying Shen , Shuai Che , Mahdi Ghandi , Mingqin Li

The combination of LLM agents with external tools enables models to solve complex tasks beyond their knowledge base. Human-designed tools are inflexible and restricted to solutions within the scope of pre-existing tools created by experts.…

Artificial Intelligence · Computer Science 2025-11-18 Mohd Ariful Haque , Justin Williams , Sunzida Siddique , Md. Hujaifa Islam , Hasmot Ali , Kishor Datta Gupta , Roy George

Large Language Model (LLM)-driven Multi-Agent Systems (MAS) have demonstrated strong capability in complex reasoning and tool use, and heterogeneous agent pools further broaden the quality--cost trade-off space. Despite these advances,…

Artificial Intelligence · Computer Science 2026-03-16 Xudong Wang , Chaoning Zhang , Jiaquan Zhang , Chenghao Li , Qigan Sun , Sung-Ho Bae , Peng Wang , Ning Xie , Jie Zou , Yang Yang , Hengtao Shen

Reasoning-capable large language models (LLMs) achieve strong performance on complex tasks but often exhibit overthinking after distillation, generating unnecessarily long chain-of-thought (CoT) reasoning even for simple inputs and…

Computation and Language · Computer Science 2026-01-09 Feng Luo , Yu-Neng Chuang , Guanchu Wang , Hoang Anh Duy Le , Shaochen Zhong , Hongyi Liu , Jiayi Yuan , Yang Sui , Vladimir Braverman , Vipin Chaudhary , Xia Hu

While recent success of large reasoning models (LRMs) significantly advanced LLMs' reasoning capability by optimizing the final answer accuracy using reinforcement learning, they may also drastically increase the output length due to…

Artificial Intelligence · Computer Science 2025-05-29 Sohyun An , Ruochen Wang , Tianyi Zhou , Cho-Jui Hsieh

Recent advances in Large Language Models (LLMs) - particularly model scaling and test-time techniques - have greatly enhanced the reasoning capabilities of language models at the expense of higher inference costs. To lower inference costs,…

Computation and Language · Computer Science 2025-11-21 Sangmook Lee , Dohyung Kim , Hyukhun Koh , Nakyeong Yang , Kyomin Jung

We introduce the Rule Network with Selective Logical Operators (RNS), a novel neural architecture that employs \textbf{selective logical operators} to adaptively choose between AND and OR operations at each neuron during training. Unlike…

Machine Learning · Computer Science 2026-04-03 Bowen Wei , Ziwei Zhu

Entity Linking (EL) has traditionally relied on large annotated datasets and extensive model fine-tuning. While recent few-shot methods leverage large language models (LLMs) through prompting to reduce training requirements, they often…

Computation and Language · Computer Science 2025-11-20 Yajie Li , Albert Galimov , Mitra Datta Ganapaneni , Pujitha Thejaswi , De Meng , Priyanshu Kumar , Saloni Potdar

Agentic AI enables LLM to dynamically reason, plan, and interact with tools to solve complex tasks. However, agentic workflows often require many iterative reasoning steps and tool invocations, leading to significant operational expense,…

Artificial Intelligence · Computer Science 2026-02-03 Sami Abuzakuk , Anne-Marie Kermarrec , Rishi Sharma , Rasmus Moorits Veski , Martijn de Vos

This report describes ARIS (Auto-Research-in-sleep), an open-source research harness for autonomous research, including its architecture, assurance mechanisms, and early deployment experience. The performance of agent systems built on LLMs…

Software Engineering · Computer Science 2026-05-06 Ruofeng Yang , Yongcan Li , Shuai Li