English
Related papers

Related papers: FoldAct: Efficient and Stable Context Folding for …

200 papers

Large Language Models (LLMs) have shown exciting performance in listwise passage ranking. Due to the limited input length, existing methods often adopt the sliding window strategy. Such a strategy, though effective, is inefficient as it…

Information Retrieval · Computer Science 2024-12-20 Wenhan Liu , Xinyu Ma , Yutao Zhu , Ziliang Zhao , Shuaiqiang Wang , Dawei Yin , Zhicheng Dou

Feature selection aims to preprocess the target dataset, find an optimal and most streamlined feature subset, and enhance the downstream machine learning task. Among filter, wrapper, and embedded-based approaches, the reinforcement learning…

Artificial Intelligence · Computer Science 2025-09-17 Weiliang Zhang , Xiaohan Huang , Yi Du , Ziyue Qiao , Qingqing Long , Zhen Meng , Yuanchun Zhou , Meng Xiao

The advancement of LLMs and their accessibility have triggered renewed interest in multi-agent reinforcement learning as robust and adaptive frameworks for dynamically changing environments. This paper introduces RL-Focal, a two-stage RL…

Computation and Language · Computer Science 2025-10-14 Selim Furkan Tekin , Fatih Ilhan , Gaowen Liu , Ramana Rao Kompella , Ling Liu

Quantization is pivotal for mitigating the significant memory and computational overhead of Large Language Models (LLMs). While emerging transformation-based methods have successfully enhanced quantization by projecting feature spaces onto…

Computation and Language · Computer Science 2026-03-06 Xiaohao Liu , Xiaobo Xia , Manyi Zhang , Ji-Fu Li , Xianzhi Yu , Fei Shen , Xiu Su , See-Kiong Ng , Tat-Seng Chua

Recent large reasoning models (LRMs) have demonstrated strong reasoning capabilities through reinforcement learning (RL). These improvements have primarily been observed within the short-context reasoning tasks. In contrast, extending LRMs…

Computation and Language · Computer Science 2025-05-28 Fanqi Wan , Weizhou Shen , Shengyi Liao , Yingcheng Shi , Chenliang Li , Ziyi Yang , Ji Zhang , Fei Huang , Jingren Zhou , Ming Yan

Long-horizon agentic search requires iteratively exploring the web over long trajectories and synthesizing information across many sources, and is the foundation for enabling powerful applications like deep research systems. In this work,…

Computation and Language · Computer Science 2025-10-23 Howard Yen , Ashwin Paranjape , Mengzhou Xia , Thejas Venkatesh , Jack Hessel , Danqi Chen , Yuhao Zhang

We consider a problem in which the trajectory of a mobile 3D sensor must be optimized so that certain objects are both found in the overall scene and covered by the point cloud, as fast as possible. This problem is called target search and…

Systems and Control · Electrical Eng. & Systems 2023-12-19 Matthias Rosynski , Alexandru Pop , Lucian Busoniu

Recent advancements in reinforcement learning have made significant impacts across various domains, yet they often struggle in complex multi-agent environments due to issues like algorithm instability, low sampling efficiency, and the…

Multiagent Systems · Computer Science 2024-08-22 Cheng Xu , Changtian Zhang , Yuchen Shi , Ran Wang , Shihong Duan , Yadong Wan , Xiaotong Zhang

Large Language Models (LLMs) can perform zero-shot learning on unseen tasks and few-shot learning on complex reasoning tasks. However, resource-limited mobile edge networks struggle to support long-context LLM serving for LLM agents during…

Networking and Internet Architecture · Computer Science 2025-01-27 Minrui Xu , Dusit Niyato , Christopher G. Brinton

Large Language Model (LLM) agents struggle with long-horizon software engineering tasks due to "Context Bloat." As interaction history grows, computational costs explode, latency increases, and reasoning capabilities degrade due to…

Artificial Intelligence · Computer Science 2026-01-13 Nikhil Verma

Large Language Model (LLM)-based agents have achieved notable success on short-horizon and highly structured tasks. However, their ability to maintain coherent decision-making over long horizons in realistic and dynamic environments remains…

Artificial Intelligence · Computer Science 2026-03-18 Linghua Zhang , Jun Wang , Jingtong Wu , Zhisong Zhang

In modern sequential decision-making systems, the construction of an optimal candidate action space is critical to efficient inference. However, existing approaches either rely on manually defined action spaces that lack scalability or…

Machine Learning · Computer Science 2025-11-12 Xueliang Zhao , Wei Wu , Jian Guan , Qintong Li , Lingpeng Kong

Processing long contexts has become a critical capability for modern large language models (LLMs). Existing works leverage agent-based divide-and-conquer methods for processing long contexts. But these methods face crucial limitations,…

Computation and Language · Computer Science 2025-09-30 Sibo Xiao , Zixin Lin , Wenyang Gao , Hui Chen , Yue Zhang

Dynamic Rank Reinforcement Learning (DR-RL) approximations rely on static rank assumptions, limiting their flexibility across diverse linguistic contexts. Our method dynamically modulates ranks based on real-time sequence dynamics,…

Machine Learning · Computer Science 2026-02-10 Caner Erden

The rapid increase in textual information means we need more efficient methods to sift through, organize, and understand it all. While retrieval-augmented generation (RAG) models excel in accessing information from large document…

Computation and Language · Computer Science 2025-03-14 Seiji Maekawa , Hayate Iso , Nikita Bhutani

Reinforcement learning (RL) algorithms find applications in inventory control, recommender systems, vehicular traffic management, cloud computing and robotics. The real-world complications of many tasks arising in these domains makes them…

Machine Learning · Computer Science 2021-06-03 Sindhu Padakandla

Recently, recurrent large language models (Recurrent LLMs) with linear computational complexity have re-emerged as efficient alternatives to self-attention-based LLMs (Self-Attention LLMs), which have quadratic complexity. However,…

Computation and Language · Computer Science 2025-07-28 Kai Liu , Zhan Su , Peijie Dong , Fengran Mo , Jianfei Gao , ShaoTing Zhang , Kai Chen

We propose Point2Act, which directly retrieves the 3D action point relevant to a contextually described task, leveraging Multimodal Large Language Models (MLLMs). Foundation models opened the possibility for generalist robots that can…

Robotics · Computer Science 2026-03-05 Sang Min Kim , Hyeongjun Heo , Junho Kim , Yonghyeon Lee , Young Min Kim

Robust Policy Search is the problem of learning policies that do not degrade in performance when subject to unseen environment model parameters. It is particularly relevant for transferring policies learned in a simulation environment to…

Machine Learning · Computer Science 2021-11-23 Sai Kiran Narayanaswami , Nandan Sudarsanam , Balaraman Ravindran

Reinforcement Learning (RL) algorithms can suffer from poor sample efficiency when rewards are delayed and sparse. We introduce a solution that enables agents to learn temporally extended actions at multiple levels of abstraction in a…

Machine Learning · Computer Science 2019-03-11 Andrew Levy , Robert Platt , Kate Saenko