English
Related papers

Related papers: Structured Distillation for Personalized Agent Mem…

200 papers

Ad hoc dataset search requires matching underspecified natural-language queries against sparse, heterogeneous metadata records, a task where typical lexical or dense retrieval alone falls short. We reposition dataset search as a…

Information Retrieval · Computer Science 2026-04-21 Riccardo Terrenzi , Phongsakon Mark Konrad , Tim Lukas Adam , Serkan Ayvaz

Reasoning over very long inputs remains difficult for large language models (LLMs). Common workarounds either shrink the input via retrieval (risking missed evidence), enlarge the context window (straining selectivity), or stage multiple…

Personalization is one of the next milestones in advancing AI capability and alignment. We introduce PersonaMem-v2, the state-of-the-art dataset for LLM personalization that simulates 1,000 realistic user-chatbot interactions on 300+…

LLM-based coding agents rely on \emph{skills}, pre-packaged instruction sets that extend agent capabilities, yet every token of skill content injected into the context window incurs both monetary cost and attention dilution. To understand…

Software Engineering · Computer Science 2026-04-01 Yudong Gao , Zongjie Li , Yuanyuanyuan , Zimo Ji , Pingchuan Ma , Shuai Wang

Large Language Model agents excel at solving complex tasks through iterative reasoning and tool use, but typically depend on ultra-large, costly backbones. Existing distillation approaches train smaller students to imitate full teacher…

Computation and Language · Computer Science 2025-10-10 Yuanjie Lyu , Chengyu Wang , Jun Huang , Tong Xu

Transformer attention scales quadratically with sequence length O(n^2), limiting long-context use. We propose Adaptive Retention, a probabilistic, layer-wise token selection mechanism that learns which representations to keep under a strict…

Computation and Language · Computer Science 2025-10-13 S M Rafiuddin , Muntaha Nujat Khan

In order for large language models to achieve true conversational continuity and benefit from experiential learning, they need memory. While research has focused on the development of complex memory systems, it remains unclear which types…

Computation and Language · Computer Science 2025-12-09 Alessandra Terranova , Björn Ross , Alexandra Birch

Multi-agent systems must decide which agent is the most appropriate for a given task. We propose a novel architecture for recommending which LLM agent out of many should perform a task given a natural language prompt by extending the…

Machine Learning · Computer Science 2025-01-24 Joshua Park , Yongfeng Zhang

Large Language Models (LLMs) have demonstrated success across many benchmarks. However, they still exhibit limitations in long-context scenarios, primarily due to their short effective context length, quadratic computational complexity, and…

Computation and Language · Computer Science 2025-09-26 Manlai Liang , Mandi Liu , Jiangzhou Ji , Huaijun Li , Haobo Yang , Yaohan He , Jinlong Li

Conversational AI systems often struggle with maintaining coherent, contextual memory across extended interactions, limiting their ability to provide personalized and contextually relevant responses. This paper presents IMDMR (Intelligent…

Information Retrieval · Computer Science 2025-11-11 Tejas Pawar , Sarika Patil , Om Tilekar , Rushikesh Janwade , Vaibhav Helambe

This paper proposes a low algorithmic latency adaptation of the deep clustering approach to speaker-independent speech separation. It consists of three parts: a) the usage of long-short-term-memory (LSTM) networks instead of their…

Sound · Computer Science 2019-02-20 Shanshan Wang , Gaurav Naithani , Tuomas Virtanen

Existing retrieval-based methods have made significant strides in maintaining long-term conversations. However, these approaches face challenges in memory database management and accurate memory retrieval, hindering their efficacy in…

Computation and Language · Computer Science 2024-07-02 Nuo Chen , Hongguang Li , Juhua Huang , Baoyuan Wang , Jia Li

Research funding discovery remains fundamentally fragmented: researchers navigate disparate agency portals (e.g., in the United States, NSF, NIH, DARPA, Grants.gov, and many others) with heterogeneous interfaces, search capabilities, and…

Artificial Intelligence · Computer Science 2026-05-05 Zhisheng Tang , Mayank Kejriwal

Despite advances in generative large language models (LLMs), practical application of specialized conversational AI agents remains constrained by computation costs, latency requirements, and the need for precise domain-specific relevance…

Computation and Language · Computer Science 2025-12-10 Eliot Brenner , Dominic Seyler , Manjunath Hegde , Andrei Simion , Koustuv Dasgupta , Bing Xiang

Large language model agents often fail to accumulate knowledge from experience, treating each task as an independent challenge. Recent methods extract experience as flattened textual knowledge, which cannot capture procedural logic of…

Artificial Intelligence · Computer Science 2026-02-02 Libin Qiu , Zhirong Gao , Junfu Chen , Yuhang Ye , Weizhi Huang , Xiaobo Xue , Wenkai Qiu , Shuo Tang

Real-time speech-driven 3D facial animation has been attractive in academia and industry. Traditional methods mainly focus on learning a deterministic mapping from speech to animation. Recent approaches start to consider the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Peng Chen , Xiaobao Wei , Ming Lu , Hui Chen , Feng Tian

Despite significant advances in foundation models like DeepSeek-R1 and ChatGPT, their deployment in medical settings faces critical challenges including computational requirements and professional knowledge barriers. This paper presents an…

Computation and Language · Computer Science 2025-07-23 Mingda Zhang , Jianglong Qin

Large language models (LLMs) in research and development toolchains produce output that triggers attribution of agency and understanding -- a cognitive illusion that degrades verification behavior and trust calibration. No existing…

Software Engineering · Computer Science 2026-04-10 Marek Miller

Over the past year, the emergence of transfer learning with large-scale language models (LM) has led to dramatic performance improvements across a broad range of natural language understanding tasks. However, the size and memory footprint…

Computation and Language · Computer Science 2020-02-04 Luke Melas-Kyriazi , George Han , Celine Liang

Large Language Models (LLMs) have recently achieved remarkable progress by leveraging Reinforcement Learning and extended Chain-of-Thought (CoT) techniques. However, the challenge of performing efficient language reasoning--especially…

Computation and Language · Computer Science 2025-06-17 Zhong-Zhi Li , Xiao Liang , Zihao Tang , Lei Ji , Peijie Wang , Haotian Xu , Xing W , Haizhen Huang , Weiwei Deng , Yeyun Gong , Zhijiang Guo , Xiao Liu , Fei Yin , Cheng-Lin Liu