中文
相关论文

相关论文: R2-Router: A New Paradigm for LLM Routing with Rea…

200 篇论文

Large Reasoning Models (LRMs) are Large Language Models (LLMs) explicitly trained to generate long-form Chain-of-Thoughts (CoTs), achieving impressive success on challenging tasks like math and programming. However, their underlying…

Imagine advanced humanoid robots, powered by multimodal large language models (MLLMs), coordinating missions across industries like warehouse logistics, manufacturing, and safety rescue. While individual robots show local autonomy,…

Existing Large Reasoning Models (LRMs) have shown the potential of reinforcement learning (RL) to enhance the complex reasoning capabilities of Large Language Models~(LLMs). While they achieve remarkable performance on challenging tasks…

人工智能 · 计算机科学 2025-03-19 Huatong Song , Jinhao Jiang , Yingqian Min , Jie Chen , Zhipeng Chen , Wayne Xin Zhao , Lei Fang , Ji-Rong Wen

Reasoning LLMs (RLMs) such as OpenAI o1, DeepSeek-R1, and Qwen3 deliver strong multi-step reasoning through chain-of-thought generation, but their large model sizes and lengthy decode-time outputs make them costly to deploy and unsuitable…

计算与语言 · 计算机科学 2025-12-03 Ziyan Wang , Enmao Diao , Qi Le , Pu Wang , Guanchu Wang , Minwoo Lee , Shu-ping Yeh , Li Yang

Recent works show that assembling multiple off-the-shelf large language models (LLMs) can harness their complementary abilities. To achieve this, routing is a promising method, which learns a router to select the most suitable LLM for each…

机器学习 · 计算机科学 2024-10-01 Shuhao Chen , Weisen Jiang , Baijiong Lin , James T. Kwok , Yu Zhang

To enhance the reasoning capabilities of off-the-shelf Large Language Models (LLMs), we introduce a simple, yet general and effective prompting method, Re2, i.e., \textbf{Re}-\textbf{Re}ading the question as input. Unlike most…

计算与语言 · 计算机科学 2024-11-20 Xiaohan Xu , Chongyang Tao , Tao Shen , Can Xu , Hongbo Xu , Guodong Long , Jian-guang Lou , Shuai Ma

Detailed routing remains one of the most complex and time-consuming steps in modern physical design due to the challenges posed by shrinking feature sizes and stricter design rules. Prior detailed routers achieve state-of-the-art results by…

硬件体系结构 · 计算机科学 2025-12-04 Afsara Khan , Austin Rovinski

Recent progress in Language Models (LMs) has dramatically advanced the field of natural language processing (NLP), excelling at tasks like text generation, summarization, and question answering. However, their inference remains…

机器学习 · 计算机科学 2025-06-10 Adarsh Prasad Behera , Jaya Prakash Champati , Roberto Morabito , Sasu Tarkoma , James Gross

The innovative services empowered by the Internet of Things (IoT) require a seamless and reliable wireless infrastructure that enables communications within heterogeneous and dynamic low-power and lossy networks (LLNs). The Routing Protocol…

网络与互联网体系结构 · 计算机科学 2021-05-21 Hossam Farag , Cedomir Stefanovic

We study the reasoning behavior of large language models (LLMs) under limited computation budgets. In such settings, producing useful partial solutions quickly is often more practical than exhaustive reasoning, which incurs high inference…

While large language models (LLMs) demonstrate impressive capabilities, their reliance on parametric knowledge often leads to factual inaccuracies. Retrieval-Augmented Generation (RAG) mitigates this by leveraging external documents, yet…

计算与语言 · 计算机科学 2025-10-07 Lingnan Xu , Chong Feng , Kaiyuan Zhang , Liu Zhengyong , Wenqiang Xu , Fanqing Meng

Emerging reasoning LLMs such as OpenAI-o1 and DeepSeek-R1 have achieved strong performance on complex reasoning tasks by generating long chain-of-thought (CoT) traces. However, these long CoTs result in increased token usage, leading to…

机器学习 · 计算机科学 2025-11-18 Yuxiang Zhang , Zhengxu Yu , Weihang Pan , Zhongming Jin , Qiang Fu , Deng Cai , Binbin Lin , Jieping Ye

Recent studies have combined Large Language Models (LLMs) with Knowledge Graphs (KGs) to enhance reasoning, improving inference accuracy without additional training while mitigating hallucination. However, existing frameworks still suffer…

计算与语言 · 计算机科学 2025-11-11 Sumin Jo , Junseong Choi , Jiho Kim , Edward Choi

While Long Chain-of-Thought (CoT) reasoning significantly improves Large Language Models (LLMs) performance on complex reasoning tasks, the substantial computational and memory costs of generating long CoT sequences limit their efficiency…

人工智能 · 计算机科学 2026-02-03 Liang Zhang , Yu Zhao , Longyue Wang , Tianqi Shi , Weihua Luo , Kaifu Zhang , Jinsong Su

The deployment of large language models (LLMs) in real-world applications is increasingly limited by their high inference cost. While recent advances in dynamic token-level computation allocation attempt to improve efficiency by selectively…

计算与语言 · 计算机科学 2025-10-17 Chao Han , Yijuan Liang , Zihao Xuan , Daokuan Wu , Wei Zhang , Xiaoyu Shen

Query rewrite is essential for optimizing SQL queries to improve their execution efficiency without changing their results. Traditionally, this task has been tackled through heuristic and learning-based methods, each with its limitations in…

数据库 · 计算机科学 2025-07-23 Zhaoyan Sun , Xuanhe Zhou , Guoliang Li , Xiang Yu , Jianhua Feng , Yong Zhang

Large language models (LLMs) excel at complex tasks thanks to advances in their reasoning abilities. However, existing methods overlook the trade-off between reasoning effectiveness and efficiency, often encouraging unnecessarily long…

机器学习 · 计算机科学 2025-10-16 Jingyao Wang , Wenwen Qiang , Zeen Song , Changwen Zheng , Hui Xiong

In this paper, we introduce Rank-R1, a novel LLM-based reranker that performs reasoning over both the user query and candidate documents before performing the ranking task. Existing document reranking methods based on large language models…

信息检索 · 计算机科学 2025-03-11 Shengyao Zhuang , Xueguang Ma , Bevan Koopman , Jimmy Lin , Guido Zuccon

Efficiently acquiring external knowledge and up-to-date information is essential for effective reasoning and text generation in large language models (LLMs). Prompting advanced LLMs with reasoning capabilities to use search engines during…

计算与语言 · 计算机科学 2025-08-07 Bowen Jin , Hansi Zeng , Zhenrui Yue , Jinsung Yoon , Sercan Arik , Dong Wang , Hamed Zamani , Jiawei Han

We study the problem of optimizing Large Language Model (LLM) inference scheduling to minimize total latency. LLM inference is an online and multi-task service process and also heavily energy consuming by which a pre-trained LLM processes…

机器学习 · 计算机科学 2025-09-03 Zixi Chen , Yinyu Ye , Zijie Zhou