English
Related papers

Related papers: Structured Distillation for Personalized Agent Mem…

200 papers

Drug discovery frequently loses momentum when data, expertise, and tools are scattered, slowing design cycles. To shorten this loop we built a hierarchical, tool using agent framework that automates molecular optimisation. A Principal…

Machine Learning · Computer Science 2025-08-06 Atabey Ünlü , Phil Rohr , Ahmet Celebi

Multilingual self-supervised speech representation models have greatly enhanced the speech recognition performance for low-resource languages, and the compression of these huge models has also become a crucial prerequisite for their…

Computation and Language · Computer Science 2023-06-05 Haoyu Wang , Siyuan Wang , Wei-Qiang Zhang , Jinfeng Bai

Human-agent dialogues often exhibit topic continuity-a stable thematic frame that evolves through temporally adjacent exchanges-yet most large language model (LLM) agent memory systems fail to preserve it. Existing designs follow a…

Computation and Language · Computer Science 2026-01-21 Dehao Tao , Guoliang Ma , Yongfeng Huang , Minghu Jiang

Discrete speech representation learning has recently attracted increasing interest in both acoustic and semantic modeling. Existing approaches typically encode 16 kHz waveforms into discrete tokens at a rate of 25 or 50 tokens per second.…

Computation and Language · Computer Science 2025-09-03 Jialong Zuo , Guangyan Zhang , Minghui Fang , Shengpeng Ji , Xiaoqi Jiao , Jingyu Li , Yiwen Guo , Zhou Zhao

Large language model (LLM) agents deployed for multi-step tasks frequently fail in predictable ways: attempting actions with unmet preconditions, issuing redundant commands, or mishandling environment constraints. While retrieval-augmented…

Artificial Intelligence · Computer Science 2025-10-03 Humaid Ibrahim , Nikolai Rozanov , Marek Rei

Transformer-based speech self-supervised learning (SSL) models, such as HuBERT, show surprising performance in various speech processing tasks. However, huge number of parameters in speech SSL models necessitate the compression to a more…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-27 Kangwook Jang , Sungnyun Kim , Se-Young Yun , Hoirin Kim

In this paper, we propose a novel factored agent architecture designed to overcome the limitations of traditional single-agent systems in agentic AI. Our approach decomposes the agent into two specialized components: (1) a large language…

Artificial Intelligence · Computer Science 2025-04-03 Nicholas Roth , Christopher Hidey , Lucas Spangher , William F. Arnold , Chang Ye , Nick Masiewicki , Jinoo Baek , Peter Grabowski , Eugene Ie

This work investigates distillation methods for large language models (LLMs) with the goal of developing compact models that preserve high performance. Several existing approaches are reviewed, with a discussion of their respective…

Computation and Language · Computer Science 2025-11-10 Grigory Kovalev , Mikhail Tikhomirov

Although memory capabilities of AI agents are gaining increasing attention, existing solutions remain fundamentally limited. Most rely on flat, narrowly scoped memory components, constraining their ability to personalize, abstract, and…

Computation and Language · Computer Science 2025-07-11 Yu Wang , Xi Chen

Personalized search demands the ability to model users' evolving, multi-dimensional information needs; a challenge for systems constrained by static profiles or monolithic retrieval pipelines. We present SPARK (Search Personalization via…

Artificial Intelligence · Computer Science 2026-05-26 Gaurab Chhetri , Subasish Das , Tausif Islam Chowdhury

Building reliable conversational AI assistants for customer-facing industries remains challenging due to noisy conversational data, fragmented knowledge, and the requirement for accurate human hand-off - particularly in domains that depend…

Computation and Language · Computer Science 2026-02-19 Krittin Pachtrachai , Petmongkon Pornpichitsuwan , Wachiravit Modecrua , Touchapon Kraisingkorn

Online support groups for smoking cessation are economical and accessible, yet they often face challenges with low user engagement and stigma. The use of an automatic conversational agent would improve engagement by ensuring that all user…

Computation and Language · Computer Science 2025-12-22 Salar Hashemitaheri , Ian Harris

Standard LLM-based speech recognition systems typically process utterances in isolation, limiting their ability to leverage conversational context. In this work, we study whether multimodal context from prior turns improves LLM-based ASR…

Large language model (LLM)-based agents combine LLMs with external tools to automate tasks such as scheduling meetings, managing documents, or booking travel. While these integrations unlock powerful capabilities, they also create new and…

Cryptography and Security · Computer Science 2026-04-22 Jonathan Evertz , Merlin Chlosta , Lea Schönherr , Thorsten Eisenhofer

LLM agents with persistent memory store information as flat factual records, providing little context for temporal reasoning, change tracking, or cross-session aggregation. Inspired by the drawing effect [3], we introduce dual-trace memory…

Artificial Intelligence · Computer Science 2026-04-15 Benjamin Stern , Peter Nadel

Bounded-context agents fail when intermediate reasoning exceeds an effective working-memory budget. We study compressed query delegation (CQD): (i) compress a high-dimensional latent reasoning state into a low-rank tensor query, (ii)…

Computation and Language · Computer Science 2026-01-06 Faruk Alpay , Bugra Kilictas

Discrete audio representations are gaining traction in speech modeling due to their interpretability and compatibility with large language models, but are not always optimized for noisy or real-world environments. Building on existing works…

Computation and Language · Computer Science 2025-10-30 Shreyas Gopal , Ashutosh Anshul , Haoyang Li , Yue Heng Yeo , Hexin Liu , Eng Siong Chng

Pre-trained transformer models with extended context windows are notoriously expensive to run at scale, often limiting real-world deployment due to their high computational and memory requirements. In this paper, we introduce Hamming…

Machine Learning · Computer Science 2025-02-05 Mark Horton , Tergel Molom-Ochir , Peter Liu , Bhavna Gopal , Chiyue Wei , Cong Guo , Brady Taylor , Deliang Fan , Shan X. Wang , Hai Li , Yiran Chen

Dataset distillation, a training-aware data compression technique, has recently attracted increasing attention as an effective tool for mitigating costs of optimization and data storage. However, progress remains largely empirical.…

Machine Learning · Computer Science 2026-03-31 Yuri Kinoshita , Naoki Nishikawa , Taro Toyoizumi

While existing text-to-speech (TTS) models exhibit high expressiveness, fine-grained control over composite instructions remains challenging due to the structural mismatch between discrete textual intents and continuous acoustic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Bin Kang , Shaoguo Wen , Yang Fan , Shunlong Wu , Junjie Wang , Yulin Li , Junzhi Zhao , Junle Wang , Zhuotao Tian