中文
相关论文

相关论文: Multi-modal Spatio-Temporal Transformer for High-r…

200 篇论文

Space-time video super-resolution (STVSR) is the task of interpolating videos with both Low Frame Rate (LFR) and Low Resolution (LR) to produce High-Frame-Rate (HFR) and also High-Resolution (HR) counterparts. The existing methods based on…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Zhicheng Geng , Luming Liang , Tianyu Ding , Ilya Zharkov

Multispectral pedestrian detection is an important task for many around-the-clock applications, since the visible and thermal modalities can provide complementary information especially under low light conditions. Due to the presence of two…

计算机视觉与模式识别 · 计算机科学 2024-11-06 Yinghui Xing , Shuo Yang , Song Wang , Shizhou Zhang , Guoqiang Liang , Xiuwei Zhang , Yanning Zhang

This paper introduces a data-driven time embedding method for modeling long-range seasonal dependencies in spatiotemporal forecasting tasks. The proposed approach employs Dynamic Mode Decomposition (DMD) to extract temporal modes directly…

机器学习 · 计算机科学 2025-08-05 Menglin Kong , Vincent Zhihao Zheng , Xudong Wang , Lijun Sun

We study the forecasting problem for traffic with dynamic, possibly periodical, and joint spatial-temporal dependency between regions. Given the aggregated inflow and outflow traffic of regions in a city from time slots 0 to t-1, we predict…

机器学习 · 计算机科学 2022-05-05 Guanyao Li , Shuhan Zhong , S. -H. Gary Chan , Ruiyuan Li , Chih-Chieh Hung , Wen-Chih Peng

Accurately forecasting the real-time travel demand for dockless scooter-sharing is crucial for the planning and operations of transportation systems. Deep learning models provide researchers with powerful tools to achieve this task, but…

计算机与社会 · 计算机科学 2024-10-28 Yiming Xu , Xilei Zhao , Xiaojian Zhang , Mudit Paliwal

Multi-variate time series (MTS) data is a ubiquitous class of data abstraction in the real world. Any instance of MTS is generated from a hybrid dynamical system and their specific dynamics are usually unknown. The hybrid nature of such a…

机器学习 · 计算机科学 2021-09-07 Jinliang Deng , Xiusi Chen , Renhe Jiang , Xuan Song , Ivor W. Tsang

This paper introduces a novel spatiotemporal feature representation model designed to address the limitations of traditional methods in multidimensional time series (MTS) analysis. The proposed approach converts MTS into one-dimensional…

机器学习 · 计算机科学 2024-10-10 Xu Yan , Yaoting Jiang , Wenyi Liu , Didi Yi , Jianjun Wei

Spatio-temporal prediction plays a crucial role in intelligent transportation, weather forecasting, and urban planning. While integrating multi-modal data has shown potential for enhancing prediction accuracy, key challenges persist: (i)…

机器学习 · 计算机科学 2025-10-29 Yuting Huang , Ziquan Fang , Zhihao Zeng , Lu Chen , Yunjun Gao

This study proposes a multi-resolution Convolutional Long Short-Term Memory (ConvLSTM) ensemble framework that leverages diverse temporal input resolutions to mitigate error accumulation and improve long-horizon forecasting of…

机器学习 · 计算机科学 2026-05-25 Jihoon Kim , Heejung Youn

Time series, typically represented as numerical sequences, can also be transformed into images and texts, offering multi-modal views (MMVs) of the same underlying signal. These MMVs can reveal complementary patterns and enable the use of…

机器学习 · 计算机科学 2025-11-03 ChengAo Shen , Wenchao Yu , Ziming Zhao , Dongjin Song , Wei Cheng , Haifeng Chen , Jingchao Ni

Intelligent transportation systems (ITS) still have a hard time accurately predicting traffic in cities, especially in big, multimodal settings with complicated spatiotemporal dynamics. This paper presents HybridST, a hybrid architecture…

系统与控制 · 电气工程与系统科学 2025-11-05 Ismail Zrigui , Samira Khoulji , Mohamed Larbi Kerkeb

Recent research in geospatial machine learning has demonstrated that models pretrained with self-supervised learning on Earth observation data can perform well on downstream tasks with limited training data. However, most of the existing…

计算机视觉与模式识别 · 计算机科学 2026-02-09 Lucia Gordon , Serge Belongie , Christian Igel , Nico Lang

Time series forecasting is crucial for various applications, such as weather, traffic, electricity, and energy predictions. Currently, common time series forecasting methods are based on Transformers. However, existing approaches primarily…

机器学习 · 计算机科学 2025-09-30 Zixu Wang , Hongbin Dong , Xiaoping Zhang

In this paper, we introduce a novel Synchronized Class Token Fusion (SCT Fusion) architecture in the framework of multi-modal multi-label classification (MLC) of remote sensing (RS) images. The proposed architecture leverages…

计算机视觉与模式识别 · 计算机科学 2023-06-05 David Hoffmann , Kai Norman Clasen , Begüm Demir

Urban anomaly predictions, such as traffic accident prediction and crime prediction, are of vital importance to smart city security and maintenance. Existing methods typically use deep learning to capture the intra-dependencies in spatial…

机器学习 · 计算机科学 2023-04-05 Yao Lu , Pengyuan Zhou , Yong Liao , Haiyong Xie

Spatio-temporal forecasting plays a crucial role in various sectors such as transportation systems, logistics, and supply chain management. However, existing methods are limited by their ability to handle large, complex datasets. To…

机器学习 · 计算机科学 2024-08-27 Sakhinana Sagar Srinivas , Chidaksh Ravuru , Geethan Sannidhi , Venkataramana Runkana

In recent years, there has been a rapid development of spatio-temporal prediction techniques in response to the increasing demands of traffic management and travel planning. While advanced end-to-end models have achieved notable success in…

机器学习 · 计算机科学 2023-11-09 Zhonghang Li , Lianghao Xia , Yong Xu , Chao Huang

Effectively modeling long spatiotemporal sequences is challenging due to the need to model complex spatial correlations and long-range temporal dependencies simultaneously. ConvLSTMs attempt to address this by updating tensor-valued states…

机器学习 · 计算机科学 2023-10-31 Jimmy T. H. Smith , Shalini De Mello , Jan Kautz , Scott W. Linderman , Wonmin Byeon

The immense success of the Transformer architecture in Natural Language Processing has led to its adoption in Time Se ries Forecasting (TSF), where superior performance has been shown. However, a recent important paper questioned their…

计算与语言 · 计算机科学 2025-10-28 Musleh Alharthi , Kaleel Mahmood , Sarosh Patel , Ausif Mahmood

Global Station Weather Forecasting (GSWF) is a key meteorological research area, critical to energy, aviation, and agriculture. Existing time series forecasting methods often ignore or unidirectionally model spatial correlation when…

机器学习 · 计算机科学 2025-09-26 Hongyi Chen , Xiucheng Li , Xinyang Chen , Yun Cheng , Jing Li , Kehai Chen , Liqiang Nie