English
Related papers

Related papers: VTBench: A Multimodal Framework for Time-Series Cl…

200 papers

Multivariate time series prediction has applications in a wide variety of domains and is considered to be a very challenging task, especially when the variables have correlations and exhibit complex temporal patterns, such as seasonality…

Machine Learning · Computer Science 2020-01-07 Yuya Jeremy Ong , Mu Qiao , Divyesh Jadav

Visual In-Context Learning (VICL) has emerged as a powerful paradigm, enabling models to perform novel visual tasks by learning from in-context examples. The dominant "retrieve-then-prompt" approach typically relies on selecting the single…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Wenwen Liao , Jianbo Yu , Yuansong Wang , Qingchao Jiang , Xiaofeng Yang

Multimodal recommendation has emerged as a promising solution to alleviate the cold-start and sparsity problems in collaborative filtering by incorporating rich content information, such as product images and textual descriptions. However,…

Information Retrieval · Computer Science 2025-06-03 Sibei Liu , Yuanzhe Zhang , Xiang Li , Yunbo Liu , Chengwei Feng , Hao Yang

Deep learning methods are powerful tools in classifying multivariate time series data. Despite their high performance, these methods are hard to interpret, which diminishes their applications in high-risk domains such as healthcare. In this…

Machine Learning · Computer Science 2026-05-11 Bhavesh Kalisetti , Vincent Wang , Gaurav R. Ghosal , Maryam Bijanzadeh , Reza Abbasi-Asl

As multimodal data proliferates across diverse real-world applications, leveraging heterogeneous information such as texts and timestamps for accurate time series forecasting (TSF) has become a critical challenge. While diffusion models…

Machine Learning · Computer Science 2025-12-09 Da Zhang , Bingyu Li , Zhuyuan Zhao , Junyu Gao , Feiping Nie , Xuelong Li

Multimodal medical imaging plays a pivotal role in clinical diagnosis and research, as it combines information from various imaging modalities to provide a more comprehensive understanding of the underlying pathology. Recently, deep…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Yihao Li , Mostafa El Habib Daho , Pierre-Henri Conze , Rachid Zeghlache , Hugo Le Boité , Ramin Tadayoni , Béatrice Cochener , Mathieu Lamard , Gwenolé Quellec

Astronomical surveys produce time-series data by observing stellar objects across multiple wavelength bands. Foundational transformer-based models, such as Astromer, encode each time-series as a sequence of embeddings of uniform dimensions.…

Instrumentation and Methods for Astrophysics · Physics 2025-06-16 Gabriel Chiong , Ignacio Becker , Pavlos Protopapas

Graph machine learning has made significant strides in recent years, yet the integration of visual information with graph structure and its potential for improving performance in downstream tasks remains an underexplored area. To address…

Machine Learning · Computer Science 2025-04-01 Jing Zhu , Yuhang Zhou , Shengyi Qian , Zhongmou He , Tong Zhao , Neil Shah , Danai Koutra

Recently, Target-oriented Multimodal Sentiment Classification (TMSC) has gained significant attention among scholars. However, current multimodal models have reached a performance bottleneck. To investigate the causes of this problem, we…

Computation and Language · Computer Science 2023-12-27 Junjie Ye , Jie Zhou , Junfeng Tian , Rui Wang , Qi Zhang , Tao Gui , Xuanjing Huang

Multivariate time series forecasting enables the prediction of future states by leveraging historical data, thereby facilitating decision-making processes. Each data node in a multivariate time series encompasses a sequence of multiple…

Machine Learning · Computer Science 2025-05-02 Xinlong Zhao , Liying Zhang , Tianbo Zou , Yan Zhang

Multitask learning (MTL) aims to develop a unified model that can handle a set of closely related tasks simultaneously. By optimizing the model across multiple tasks, MTL generally surpasses its non-MTL counterparts in terms of…

Machine Learning · Computer Science 2023-10-11 Chin-Chia Michael Yeh , Xin Dai , Yan Zheng , Junpeng Wang , Huiyuan Chen , Yujie Fan , Audrey Der , Zhongfang Zhuang , Liang Wang , Wei Zhang

Twisted Convolutional Networks (TCNs) are proposed as a novel deep learning architecture for classifying one-dimensional data with arbitrary feature order and minimal spatial relationships. Unlike conventional Convolutional Neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Junbo Jacob Lian , Haoran Chen , Kaichen Ouyang , Yujun Zhang , Rui Zhong , Huiling Chen

Time series classification (TSC) is the most import task in time series mining as it has several applications in medicine, meteorology, finance cyber security, and many others. With the ever increasing size of time series datasets, several…

Machine Learning · Computer Science 2023-12-12 Muhammad Marwan Muhammad Fuad

Many processes, from gene interaction in biology to computer networks to social media, can be modeled more precisely as temporal hypergraphs than by regular graphs. This is because hypergraphs generalize graphs by extending edges to connect…

Human-Computer Interaction · Computer Science 2021-05-12 Maximilian T. Fischer , Devanshu Arya , Dirk Streeb , Daniel Seebacher , Daniel A. Keim , Marcel Worring

Remote sensing scene classification (RSSC) is a critical task with diverse applications in land use and resource management. While unimodal image-based approaches show promise, they often struggle with limitations such as high intra-class…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Jinjin Cai , Kexin Meng , Baijian Yang , Gang Shao

Recently there is an increasing scholarly interest in time-varying knowledge graphs, or temporal knowledge graphs (TKG). Previous research suggests diverse approaches to TKG reasoning that uses historical information. However, less…

Machine Learning · Computer Science 2022-09-14 Jihoon Sohn , Mingyu Derek Ma , Muhao Chen

We introduce the Temporal Contrastive Transformer (TCT), a representation learning framework designed to capture contextual temporal dynamics in sequences of financial transactions. The model is trained using a self-supervised contrastive…

Machine Learning · Computer Science 2026-05-22 Danny Butvinik , Yonit Marcus , Nitzan Tal , Gabrielle Azoulay

Infrared and visible image fusion has garnered considerable attention owing to the strong complementarity of these two modalities in complex, harsh environments. While deep learning-based fusion methods have made remarkable advances in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Guihui Li , Bowei Dong , Kaizhi Dong , Jiayi Li , Haiyong Zheng

Finding effective representations for time series data is a useful but challenging task. Several works utilize self-supervised or unsupervised learning methods to address this. However, there still remains the open question of how to…

Machine Learning · Computer Science 2024-03-19 Yuansan Liu , Sudanthi Wijewickrema , Christofer Bester , Stephen O'Leary , James Bailey

Graph representation learning is a fast-growing field where one of the main objectives is to generate meaningful representations of graphs in lower-dimensional spaces. The learned embeddings have been successfully applied to perform various…

Machine Learning · Computer Science 2021-12-21 Md. Khaledur Rahman , Ariful Azad