English
Related papers

Related papers: TRACE: Grounding Time Series in Context for Multim…

200 papers

Execution of concurrent programs implies frequent switching between different thread contexts. This property perplexes analyzing and reasoning about concurrent programs. Trace simplification is a technique that aims at alleviating this…

Software Engineering · Computer Science 2014-05-20 Mohamed A. El-Zawawy , Mohammad N. Alanazi

While many advances in time series models focus exclusively on numerical data, research on multimodal time series, particularly those involving contextual textual information, remains in its infancy. With recent progress in large language…

Machine Learning · Computer Science 2026-03-10 Zihao Li , Xiao Lin , Zhining Liu , Jiaru Zou , Ziwei Wu , Lecheng Zheng , Dongqi Fu , Yada Zhu , Hendrik Hamann , Hanghang Tong , Jingrui He

Recent multimodal retrieval methods have endowed text-based retrievers with multimodal capabilities by utilizing pre-training strategies for visual-text alignment. They often directly fuse the two modalities for cross-reference during the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Yeong-Joon Ju , Ho-Joong Kim , Seong-Whan Lee

Knowledge bases of real-world facts about entities and their relationships are useful resources for a variety of natural language processing tasks. However, because knowledge bases are typically incomplete, it is useful to be able to…

Computation and Language · Computer Science 2017-03-09 Dat Quoc Nguyen , Kairit Sirts , Lizhen Qu , Mark Johnson

Grounding referring expressions in images aims to locate the object instance in an image described by a referring expression. It involves a joint understanding of natural language and image content, and is essential for a range of visual…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Sibei Yang , Guanbin Li , Yizhou Yu

We present TRACE, a mesh-guided 3DGS editing framework that achieves automated, high-fidelity scene transformation. By anchoring video diffusion with explicit 3D geometry, TRACE uniquely enables fine-grained, part-level manipulatio--such as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Jiyuan Hu , Zechuan Zhang , Zongxin Yang , Yi Yang

Multi-modal time series analysis has recently emerged as a prominent research area in data mining, driven by the increasing availability of diverse data modalities, such as text, images, and structured tabular data from real-world sources.…

Multivariate time-series data are frequently observed in critical care settings and are typically characterized by sparsity (missing information) and irregular time intervals. Existing approaches for learning representations in this domain…

Machine Learning · Computer Science 2022-02-17 Sindhu Tipirneni , Chandan K. Reddy

Time series analysis has become crucial in various fields, from engineering and finance to healthcare and social sciences. Due to their multidimensional nature, time series often need to be embedded into a fixed-dimensional feature space to…

Machine Learning · Computer Science 2025-05-27 Habib Irani , Yasamin Ghahremani , Arshia Kermani , Vangelis Metsis

This paper deals with a challenging task of video scene graph generation (VidSGG), which could serve as a structured video representation for high-level understanding tasks. We present a new {\em detect-to-track} paradigm for this task by…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Yao Teng , Limin Wang , Zhifeng Li , Gangshan Wu

The growing volume of video data and the introduction of complex retrieval challenges, such as the Temporal Retrieval and Alignment of Key Events (TRAKE) task at the Ho Chi Minh City AI Challenge 2025, expose critical limitations in…

Multimedia · Computer Science 2025-12-16 Thanh-Danh Luu , Le-Vu Nguyen Dinh , Duc-Thien Tran , Duy-Bao Bui , Nam-Tien Le , Tinh-Anh Nguyen Nhu

Context-aware compression techniques have gained increasing attention as model sizes continue to grow, introducing computational bottlenecks that hinder efficient deployment. A structured encoding approach was proposed to selectively…

Computation and Language · Computer Science 2025-02-13 Barnaby Schmitt , Alistair Grosvenor , Matthias Cunningham , Clementine Walsh , Julius Pembrokeshire , Jonathan Teel

Recently, there has been growing interest in incorporating textual information into foundation models for time series forecasting. However, it remains unclear whether and under what conditions such multimodal integration consistently yields…

In this paper, we introduce Technical-Embeddings, a novel framework designed to optimize semantic retrieval in technical documentation, with applications in both hardware and software development. Our approach addresses the challenges of…

Information Retrieval · Computer Science 2025-09-05 Songjiang Lai , Tsun-Hin Cheung , Ka-Chun Fung , Kaiwen Xue , Kwan-Ho Lin , Yan-Ming Choi , Vincent Ng , Kin-Man Lam

The widespread adoption of mobile devices and data collection technologies has led to an exponential increase in trajectory data, presenting significant challenges in spatio-temporal data mining, particularly for efficient and accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Yuanshao Zhu , James Jianqiao Yu , Xiangyu Zhao , Xiao Han , Qidong Liu , Xuetao Wei , Yuxuan Liang

Multimodal time series forecasting is crucial in real-world applications, where decisions depend on both numerical data and contextual signals. The core challenge is to effectively combine temporal numerical patterns with the context…

Machine Learning · Computer Science 2026-02-04 Huu Hiep Nguyen , Minh Hoang Nguyen , Dung Nguyen , Hung Le

In this paper, we re-examine the task of cross-modal clip-sentence retrieval, where the clip is part of a longer untrimmed video. When the clip is short or visually ambiguous, knowledge of its local temporal context (i.e. surrounding video…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Adriano Fragomeni , Michael Wray , Dima Damen

Learning to compute, the ability to model the functional behavior of a circuit graph, is a fundamental challenge for graph representation learning. Yet, the dominant paradigm is architecturally mismatched for this task. This flawed…

Artificial Intelligence · Computer Science 2026-02-10 Ziyang Zheng , Jiaying Zhu , Jingyi Zhou , Qiang Xu

Open-domain long-form text generation requires generating coherent, comprehensive responses that address complex queries with both breadth and depth. This task is challenging due to the need to accurately capture diverse facets of input…

Information Retrieval · Computer Science 2024-10-22 Kashob Kumar Roy , Pritom Saha Akash , Kevin Chen-Chuan Chang , Lucian Popa

Scene text recognition (STR) is an important bridge between images and text, attracting abundant research attention. While convolutional neural networks (CNNS) have achieved remarkable progress in this task, most of the existing works need…

Computer Vision and Pattern Recognition · Computer Science 2021-11-17 Yue Tao , Zhiwei Jia , Runze Ma , Shugong Xu