English
Related papers

Related papers: KernelBlaster: Continual Cross-Task CUDA Optimizat…

200 papers

The deployment of intelligent reinforcement learning (RL) agents on resource-constrained edge devices remains a fundamental challenge due to the substantial memory, computational, and energy requirements of modern deep learning systems.…

Large transformer models, trained on diverse datasets, have demonstrated impressive few-shot performance on previously unseen tasks without requiring parameter updates. This capability has also been explored in Reinforcement Learning (RL),…

Multiagent Systems · Computer Science 2026-04-02 Tao Jiang , Zichuan Lin , Lihe Li , Yi-Chen Li , Cong Guan , Lei Yuan , Zongzhang Zhang , Yang Yu , Deheng Ye

Metasurface inverse design has become central to realizing complex optical functionality, yet translating target responses into executable, solver-compatible workflows still demands specialized expertise in computational electromagnetics…

Artificial Intelligence · Computer Science 2026-04-03 Yi Huang , Bowen Zheng , Yunxi Dong , Hong Tang , Huan Zhao , S. M. Rakibul Hasan Shawon , Hualiang Zhang

Large language models face challenges in long-context question answering, where key evidence of a query may be dispersed across millions of tokens. Existing works equip large language models with a memory buffer that is dynamically updated…

Computation and Language · Computer Science 2026-03-03 Yaorui Shi , Yuxin Chen , Siyuan Wang , Sihang Li , Hengxing Cai , Qi Gu , Xiang Wang , An Zhang

Foundation models rely on in-context learning for personalized decision making. The limited size of this context window necessitates memory compression and retrieval systems like RAG. These systems however often treat memory as large…

Artificial Intelligence · Computer Science 2026-01-29 Vishnu Sashank Dorbala , Dinesh Manocha

The development of autonomous agents for complex, long-horizon tasks is a central goal in AI. However, dominant training paradigms face a critical limitation: reinforcement learning (RL) methods that optimize solely for final task success…

Machine Learning · Computer Science 2025-07-31 Zijing Zhang , Ziyang Chen , Mingxiao Li , Zhaopeng Tu , Xiaolong Li

Latent Dirichlet Allocation(LDA) is a popular topic model. Given the fact that the input corpus of LDA algorithms consists of millions to billions of tokens, the LDA training process is very time-consuming, which may prevent the usage of…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-14 Xiaolong Xie , Yun Liang , Xiuhong Li , Wei Tan

Large language models (LLMs) excel at knowledge-intensive question answering and reasoning, yet their real-world deployment remains constrained by knowledge cutoff, hallucination, and limited interaction modalities. Augmenting LLMs with…

Computation and Language · Computer Science 2025-10-13 Daocheng Fu , Jianbiao Mei , Licheng Wen , Xuemeng Yang , Cheng Yang , Rong Wu , Tao Hu , Siqi Li , Yufan Shen , Xinyu Cai , Pinlong Cai , Botian Shi , Yong Liu , Yu Qiao

Navigating and understanding complex and unknown environments autonomously demands more than just basic perception and movement from embodied agents. Truly effective exploration requires agents to possess higher-level cognitive abilities,…

Artificial Intelligence · Computer Science 2025-09-12 Abdel Hakim Drid , Vincenzo Suriani , Daniele Nardi , Abderrezzak Debilou

Training large language models (LLMs) is often constrained by GPU memory limitations. To alleviate memory pressure, activation recomputation and data compression have been proposed as two major strategies. However, both approaches have…

Machine Learning · Computer Science 2025-08-11 Ping Chen , Zhuohong Deng , Ping Li , Shuibing He , Hongzi Zhu , Yi Zheng , Zhefeng Wang , Baoxing Huai , Minyi Guo

This paper addresses the challenges of training end-to-end autonomous driving agents using Reinforcement Learning (RL). RL agents are typically trained in a fixed set of scenarios and nominal behavior of surrounding road users in…

Robotics · Computer Science 2026-03-06 Ahmed Abouelazm , Tim Weinstein , Tim Joseph , Philip Schörner , J. Marius Zöllner

Language models (LMs) exhibit impressive performance and generalization capabilities. However, LMs struggle with the persistent challenge of catastrophic forgetting, which undermines their long-term sustainability in continual learning…

Machine Learning · Computer Science 2024-10-08 Wenyu Du , Shuang Cheng , Tongxu Luo , Zihan Qiu , Zeyu Huang , Ka Chun Cheung , Reynold Cheng , Jie Fu

Reinforcement learning (RL) has become a pivotal component of large language model (LLM) post-training, and agentic RL extends this paradigm to operate as agents through multi-turn interaction and tool use. Scaling such systems exposes two…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-08 Zheyue Tan , Mustapha Abdullahi , Tuo Shi , Huining Yuan , Zelai Xu , Chao Yu , Boxun Li , Bo Zhao

Agents powered by Large Language Models (LLMs) have recently demonstrated impressive capabilities in various tasks. Still, they face limitations in tasks requiring specific, structured knowledge, flexibility, or accountable decision-making.…

Artificial Intelligence · Computer Science 2025-04-14 Kostas Hatalis , Despina Christou , Vyshnavi Kondapalli

Achieving robust performance is crucial when applying deep reinforcement learning (RL) in safety critical systems. Some of the state of the art approaches try to address the problem with adversarial agents, but these agents often require…

Machine Learning · Computer Science 2022-02-18 Yeeho Song , Jeff Schneider

Education is one of the most promising real-world applications for Large Language Models (LLMs). However, current LLMs rely on static pre-training knowledge and lack adaptation to individual learners, while existing RAG systems fall short…

Computers and Society · Computer Science 2026-05-12 Bingxi Zhao , Jiahao Zhang , Xubin Ren , Zirui Guo , Tianzhe Chu , Yi Ma , Chao Huang

Existing Large Reasoning Models (LRMs) have shown the potential of reinforcement learning (RL) to enhance the complex reasoning capabilities of Large Language Models~(LLMs). While they achieve remarkable performance on challenging tasks…

Artificial Intelligence · Computer Science 2025-03-19 Huatong Song , Jinhao Jiang , Yingqian Min , Jie Chen , Zhipeng Chen , Wayne Xin Zhao , Lei Fang , Ji-Rong Wen

LLM discovery and optimization systems are increasingly applied across domains, implementing a common propose-evaluate-revise loop. Such optimization or discovery progresses via context conditioning on received feedback from an environment.…

Artificial Intelligence · Computer Science 2026-05-20 Dmitry Redko , Albert Fazlyev , Konstantin Sozykin , Maria Ivanova , Evgeny Burnaev , Egor Shvetsov

Code Search is a key task that many programmers often have to perform while developing solutions to problems. Current methodologies suffer from an inability to perform accurately on prompts that contain some ambiguity or ones that require…

Software Engineering · Computer Science 2024-08-22 Sarthak Jain , Aditya Dora , Ka Seng Sam , Prabhat Singh

Recent advanced LLM-powered agent systems have exhibited their remarkable capabilities in tackling complex, long-horizon tasks. Nevertheless, they still suffer from inherent limitations in resource efficiency, context management, and…