English
Related papers

Related papers: Listening with Time: Precise Temporal Awareness fo…

200 papers

Large Language Models (LLMs) have achieved remarkable success in various NLP tasks, yet they still face significant challenges in reasoning and arithmetic. Temporal reasoning, a critical component of natural language understanding, has…

Machine Learning · Computer Science 2025-07-22 Duygu Sezen Islakoglu , Jan-Christoph Kalo

Fine-grained spatio-temporal understanding is essential for video reasoning and embodied AI. Yet, while Multimodal Large Language Models (MLLMs) master static semantics, their grasp of temporal dynamics remains brittle. We present…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Baiqi Li , Kangyi Zhao , Ce Zhang , Chancharik Mitra , Jean de Dieu Nyandwi , Gedas Bertasius

Humans excel at performing complex tasks by leveraging long-term memory across temporal and spatial experiences. In contrast, current Large Language Models (LLMs) struggle to effectively plan and act in dynamic, multi-room 3D environments.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Wenbo Hu , Yining Hong , Yanjun Wang , Leison Gao , Zibu Wei , Xingcheng Yao , Nanyun Peng , Yonatan Bitton , Idan Szpektor , Kai-Wei Chang

Recent multi-modal audio-language models (ALMs) excel at text-audio retrieval but struggle with frame-wise audio understanding. Prior works use temporal-aware labels or unsupervised training to improve frame-wise capabilities, but they…

As multimodal content continues to expand at a rapid pace, audio retrieval has emerged as a key enabling technology for media search, content organization, and intelligent assistants. However, most existing benchmarks concentrate on…

Artificial Intelligence · Computer Science 2026-05-07 Honglei Zhang , Yuting Chen , Chenpeng Hu , Siyue Zhang , Yilei Shi

Research on large language models (LLMs) has shown remarkable performance in domains such as mathematics, programming, and literary creation. However, most studies have focused on semantic memory-based question answering, neglecting LLMs'…

Computation and Language · Computer Science 2025-02-25 WenTao Liu , Ruohua Zhang , Aimin Zhou , Feng Gao , JiaLi Liu

This paper explores how large language models can leverage multi-level contextual information to predict group coordination patterns in collaborative mixed reality environments. We demonstrate that encoding individual behavioral profiles,…

Human-Computer Interaction · Computer Science 2025-11-19 Diana Romero , Xin Gao , Daniel Khalkhali , Salma Elmalaki

Large Language Models (LLMs) have recently demonstrated impressive capabilities in natural language processing due to their strong generalization and sequence modeling capabilities. However, their direct application to time series…

Computation and Language · Computer Science 2025-08-12 Yanru Sun , Emadeldeen Eldele , Zongxia Xie , Yucheng Wang , Wenzhe Niu , Qinghua Hu , Chee Keong Kwoh , Min Wu

Auscultation is a vital diagnostic tool, yet its utility is often limited by subjective interpretation. While general-purpose Audio-Language Models (ALMs) excel in general domains, they struggle with the nuances of physiological signals. We…

Leveraging Large Language Models' remarkable proficiency in text-based tasks, recent works on Multi-modal LLMs (MLLMs) extend them to other modalities like vision and audio. However, the progress in these directions has been mostly focused…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Sanjoy Chowdhury , Sayan Nag , Subhrajyoti Dasgupta , Jun Chen , Mohamed Elhoseiny , Ruohan Gao , Dinesh Manocha

We introduce CASTELLA, a human-annotated audio benchmark for the task of audio moment retrieval (AMR). Although AMR has various useful potential applications, there is still no established benchmark with real-world data. The initial study…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-30 Hokuto Munakata , Takehiro Imamura , Taichi Nishimura , Tatsuya Komatsu

As audio-first agents become increasingly common in physical AI, conversational robots, and screenless wearables, audio large language models (audio-LLMs) must integrate speaker-specific understanding to support user authorization,…

Sound · Computer Science 2026-05-15 KiHyun Nam , Jungwoo Heo , Siu Bae , Ha-Jin Yu , Joon Son Chung

Research on Large Language Models (LLMs) has recently witnessed an increasing interest in extending the models' context size to better capture dependencies within long documents. While benchmarks have been proposed to assess long-range…

Computation and Language · Computer Science 2025-01-20 Thibaut Thonet , Jos Rozen , Laurent Besacier

Large Audio-Language Models (LALMs) have shown strong performance in speech understanding, making speech a natural interface for accessing factual information. Yet they are trained on static corpora and may encode incorrect facts. Existing…

Machine Learning · Computer Science 2026-03-17 Sung Kyun Chung , Jiaheng Dong , Qiuchi Hu , Gongping Huang , Hong Jia , Ting Dang

The evolution of Large Language Models (LLMs) into autonomous agents necessitates the management of extensive, dynamic contexts. Current benchmarks, however, remain largely static, relying on passive retrieval tasks that fail to simulate…

Computation and Language · Computer Science 2026-02-02 Shicheng Fang , Yuxin Wang , Xiaoran Liu , Jiahao Lu , Chuanyuan Tan , Xinchi Chen , Yining Zheng , Xuanjing Huang , Xipeng Qiu

We propose a scalable method for constructing a temporal opinion knowledge base with large language models (LLMs) as automated annotators. Despite the demonstrated utility of time-series opinion analysis of text for downstream applications…

Computation and Language · Computer Science 2025-09-03 Gaurav Negi , Atul Kr. Ojha , Omnia Zayed , Paul Buitelaar

Temporal reasoning over tabular data presents substantial challenges for large language models (LLMs), as evidenced by recent research. In this study, we conduct a comprehensive analysis of temporal datasets to pinpoint the specific…

Computation and Language · Computer Science 2024-07-24 Irwin Deng , Kushagra Dixit , Vivek Gupta , Dan Roth

Long video summarization presents significant challenges for current multimodal large language models (MLLMs), particularly in maintaining temporal fidelity over extended durations and producing summaries that are both semantically and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Alkesh Patel , Melis Ozyildirim , Ying-Chang Cheng , Ganesh Nagarajan

Memory enables Large Language Model (LLM) agents to perceive, store, and use information from past dialogues, which is essential for personalization. However, existing methods fail to properly model the temporal dimension of memory in two…

Artificial Intelligence · Computer Science 2026-01-13 Miao Su , Yucan Guo , Zhongni Hou , Long Bai , Zixuan Li , Yufei Zhang , Guojun Yin , Wei Lin , Xiaolong Jin , Jiafeng Guo , Xueqi Cheng

An effective healthcare agent must be able to recall and reason over a patient's longitudinal medical history. However, the absence of datasets with realistic long-term dialogue timelines limits systematic evaluation. Real clinical text is…

Computation and Language · Computer Science 2026-05-20 Hebin Hu , Renke Dai , Ah-Hwee Tan , Yilin Kang