English
Related papers

Related papers: AR Secretary Agent: Real-time Memory Augmentation …

200 papers

Note-taking is critical during speeches and discussions, serving not only for later summarization and organization but also for real-time question and opinion reminding in question-and-answer sessions or timely contributions in discussions.…

Human-Computer Interaction · Computer Science 2025-03-10 Hsin-Ruey Tsai , Shih-Kang Chiu , Bryan Wang

Assistive technology is a prerequisite for making a high-quality lecture video. It is therefore imperative to edit the lecture video after recording. In this study, we aim to reduce the cumbersome task of lecture video editing by developing…

Human-Computer Interaction · Computer Science 2021-10-13 Yuma Ito , Masato Kikuchi , Tadachika Ozono , Toramatsu Shintani

As large language models (LLMs) evolve into autonomous agents, persistent memory at the API layer is essential for enabling context-aware behavior across LLMs and multi-session interactions. Existing approaches force vendor lock-in and rely…

Machine Learning · Computer Science 2026-03-23 Luiz C. Borro , Luiz A. B. Macarini , Gordon Tindall , Michael Montero , Adam B. Struck

Large language models (LLMs) have made significant advances in the field of natural language processing, but they still face challenges such as continuous decision-making, lack of long-term memory, and limited context windows in dynamic…

Computation and Language · Computer Science 2025-04-10 Xuechen Liang , Meiling Tao , Yinghui Xia , Jianhui Wang , Kun Li , Yijin Wang , Jingsong Yang , Tianyu Shi , Yuantao Wang , Miao Zhang , Xueqian Wang

Public speaking anxiety affects many individuals, yet opportunities for real-world practice remain limited. This study explores how augmented reality (AR) can provide an accessible training environment for public speaking. Drawing from…

Human-Computer Interaction · Computer Science 2025-04-16 Mark Edison Jim , Jan Benjamin Yap , Gian Chill Laolao , Andrei Zachary Lim , Jordan Aiko Deja

Large Language Models (LLMs) are increasingly capable but often require significant guidance or extensive interaction history to perform effectively in complex, interactive environments. Existing methods may struggle with adapting to new…

Machine Learning · Computer Science 2025-06-12 Samuel Holt , Max Ruiz Luyten , Thomas Pouplin , Mihaela van der Schaar

The rapid evolution of lightweight consumer augmented reality (AR) smart glasses (a.k.a. optical see-through head-mounted displays) offers novel opportunities for learning, particularly through their unique capability to deliver multimodal…

Human-Computer Interaction · Computer Science 2025-07-22 Nuwan Janaka , Shengdong Zhao , Ashwin Ram , Ruoxin Sun , Sherisse Tan Jing Wen , Danae Li , David Hsu

This paper introduces the concept of augmented conversation, which aims to support co-located in-person conversations via embedded speech-driven on-the-fly referencing in augmented reality (AR). Today computing technologies like smartphones…

Human-Computer Interaction · Computer Science 2024-05-30 Shivesh Jadon , Mehrad Faridan , Edward Mah , Rajan Vaish , Wesley Willett , Ryo Suzuki

Advancements in the capabilities of Large Language Models (LLMs) have created a promising foundation for developing autonomous agents. With the right tools, these agents could learn to solve tasks in new environments by accumulating and…

Artificial Intelligence · Computer Science 2025-05-16 Petr Anokhin , Nikita Semenov , Artyom Sorokin , Dmitry Evseev , Andrey Kravchenko , Mikhail Burtsev , Evgeny Burnaev

Immersive virtual reality (VR) offers affordances that may reduce cognitive complexity in binary reverse engineering (RE), enabling embodied and external cognition to augment the RE process through enhancing memory, hypothesis testing, and…

Human-Computer Interaction · Computer Science 2025-08-20 Dennis Brown , Samuel Mulder

Memory-augmented LLM agents have advanced personalized recommendation, yet existing approaches universally adopt flat memory representations that conflate ephemeral signals with stable preferences, and none provides a complete lifecycle…

Computation and Language · Computer Science 2026-05-18 Xiang Shen , Yuhang Zhou , Yifan Wu , Zhuokai Zhao , Siyu Lin , Lei Huang , Qianqian Zhong , Lizhu Zhang , Benyu Zhang , Xiangjun Fan , Hong Yan

Despite the rise of digital libraries and online reading platforms, physical libraries still offer unique benefits for education and community engagement. However, due to the convenience of digital resources, physical library visits,…

Human-Computer Interaction · Computer Science 2024-08-13 Qianjie Wei , Jingling Zhang , Pengqi Wang , Xiaofu Jin , Mingming Fan

Although memory capabilities of AI agents are gaining increasing attention, existing solutions remain fundamentally limited. Most rely on flat, narrowly scoped memory components, constraining their ability to personalize, abstract, and…

Computation and Language · Computer Science 2025-07-11 Yu Wang , Xi Chen

Large Language Model (LLM) agents increasingly serve as personal assistants and workplace collaborators, where their utility depends on memory systems that extract, retrieve, and apply information across long-running conversations. However,…

Computation and Language · Computer Science 2026-05-19 Jingbo Yang , Kwei-Herng Lai , Xiaowen Wang , Shiyu Chang , Yaar Harari , Evgeniy Gabrilovich

Mental health challenges are rising globally, while traditional support services face limited availability and high costs. Large language models offer potential for conversational support, but often lack personalization, empathy, and…

Human-Computer Interaction · Computer Science 2026-04-24 Truong Le Minh Toan , Dieu Bang Mach , Tan Duy Le , Nguyen Tan Viet Tuyen

Personalized agents that interact with users over long periods must maintain persistent memory across sessions and update it as circumstances change. However, existing benchmarks predominantly frame long-term memory evaluation as fact…

Computation and Language · Computer Science 2026-04-23 Md Nayem Uddin , Kumar Shubham , Eduardo Blanco , Chitta Baral , Gengyu Wang

Recent progress on large language models (LLMs) has enabled dialogue agents to generate highly naturalistic and plausible text. However, current LLM language generation focuses on responding accurately to questions and requests with a…

Machine Learning · Computer Science 2024-11-11 Joey Hong , Jessica Lin , Anca Dragan , Sergey Levine

Large Language Models (LLMs) have made extraordinary progress in the field of Artificial Intelligence and have demonstrated remarkable capabilities across a large variety of tasks and domains. However, as we venture closer to creating…

Artificial Intelligence · Computer Science 2023-10-04 Brandon Kynoch , Hugo Latapie , Dwane van der Sluis

Large language model (LLM) agents increasingly operate in settings where a single context window is far too small to capture what has happened, what was learned, and what should not be repeated. Memory -- the ability to persist, organize,…

Artificial Intelligence · Computer Science 2026-03-10 Pengfei Du

In this work we propose the combination of large interactive displays with personal head-mounted Augmented Reality (AR) for information visualization to facilitate data exploration and analysis. Even though large displays provide more…

Human-Computer Interaction · Computer Science 2020-10-20 Patrick Reipschläger , Tamara Flemisch , Raimund Dachselt