English
Related papers

Related papers: Multi-modal Spatio-Temporal Transformer for High-r…

200 papers

Multi-modality spatio-temporal (MoST) data extends spatio-temporal (ST) data by incorporating multiple modalities, which is prevalent in monitoring systems, encompassing diverse traffic demands and air quality assessments. Despite…

Machine Learning · Computer Science 2024-05-07 Jiewen Deng , Renhe Jiang , Jiaqi Zhang , Xuan Song

With the rapid development of location based services, multimodal spatio-temporal (ST) data including trajectories, transportation modes, traffic flow and social check-ins are being collected for deep learning based methods. These deep…

Machine Learning · Computer Science 2024-07-24 Chenxing Wang

Long-term satellite image time series (SITS) analysis in heterogeneous landscapes faces significant challenges, particularly in Mediterranean regions where complex spatial patterns, seasonal variations, and multi-decade environmental…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Ido Faran , Nathan S. Netanyahu , Maxim Shoshany

Spatial transcriptomics (ST) technologies have revolutionized the study of gene expression patterns in tissues by providing multimodality data in transcriptomic, spatial, and morphological, offering opportunities for understanding tissue…

Computational Engineering, Finance, and Science · Computer Science 2024-01-17 Zelin Zang , Liangyu Li , Yongjie Xu , Chenrui Duan , Kai Wang , Yang You , Yi Sun , Stan Z. Li

Simulating the long-term dynamics of multi-scale and multi-physics systems poses a significant challenge in understanding complex phenomena across science and engineering. The complexity arises from the intricate interactions between scales…

Machine Learning · Computer Science 2025-09-22 Da Long , Shandian Zhe , Samuel Williams , Leonid Oliker , Zhe Bai

The performance of transformers for time-series forecasting has improved significantly. Recent architectures learn complex temporal patterns by segmenting a time-series into patches and using the patches as tokens. The patch size controls…

Machine Learning · Computer Science 2024-03-25 Yitian Zhang , Liheng Ma , Soumyasundar Pal , Yingxue Zhang , Mark Coates

Traffic prediction is a challenging spatio-temporal forecasting problem that involves highly complex spatio-temporal correlations. This paper proposes a Multi-level Multi-view Augmented Spatio-temporal Transformer (LVSTformer) for traffic…

Machine Learning · Computer Science 2024-06-19 Jiaqi Lin , Qianqian Ren

Medical vision-language pre-training methods mainly leverage the correspondence between paired medical images and radiological reports. Although multi-view spatial images and temporal sequences of image-report pairs are available in…

Artificial Intelligence · Computer Science 2024-05-31 Jinxia Yang , Bing Su , Wayne Xin Zhao , Ji-Rong Wen

Time series forecasting has made significant advances, including with Transformer-based models. The attention mechanism in Transformer effectively captures temporal dependencies by attending to all past inputs simultaneously. However, its…

Machine Learning · Computer Science 2025-11-04 Xiongxiao Xu , Canyu Chen , Yueqing Liang , Baixiang Huang , Guangji Bai , Liang Zhao , Kai Shu

In the era of information explosion, spatio-temporal data mining serves as a critical part of urban management. Considering the various fields demanding attention, e.g., traffic state, human activity, and social event, predicting multiple…

Artificial Intelligence · Computer Science 2023-09-19 Zijian Zhang , Xiangyu Zhao , Qidong Liu , Chunxu Zhang , Qian Ma , Wanyu Wang , Hongwei Zhao , Yiqi Wang , Zitao Liu

Land Surface Temperature (LST) is a key variable for various applications, such as urban climate and ecology studies. Yet, existing satellite-derived LST products provide either high spatial or high temporal resolution, resulting in a…

Machine Learning · Computer Science 2026-05-14 Solomiia Kurchaba , Angela Meyer

Precise crop yield prediction provides valuable information for agricultural planning and decision-making processes. However, timely predicting crop yields remains challenging as crop growth is sensitive to growing season weather variation…

Change detection plays a fundamental role in Earth observation for analyzing temporal iterations over time. However, recent studies have largely neglected the utilization of multimodal data that presents significant practical and technical…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Biyuan Liu , Huaixin Chen , Kun Li , Michael Ying Yang

Effective management of environmental resources and agricultural sustainability heavily depends on accurate soil moisture data. However, datasets like the SMAP/Sentinel-1 soil moisture product often contain missing values across their…

Machine Learning · Computer Science 2023-12-05 Kehui Yao , Jingyi Huang , Jun Zhu

Modeling spatiotemporal dynamical systems is a fundamental challenge in machine learning. Transformer models have been very successful in NLP and computer vision where they provide interpretable representations of data. However, a…

Machine Learning · Computer Science 2023-08-01 Antonio H. de O. Fonseca , Emanuele Zappala , Josue Ortega Caro , David van Dijk

Near-real-time regional-scale monitoring of ground deformation is increasingly required to support urban planning, critical infrastructure management, and natural hazard mitigation. While Interferometric Synthetic Aperture Radar (InSAR) and…

Signal Processing · Electrical Eng. & Systems 2026-01-01 Wendong Yao , Binhua Huang , Soumyabrata Dev

Spatial transcriptomics (ST) enables transcriptome-wide profiling while preserving the spatial context of tissues, offering unprecedented opportunities to study tissue organization and cell-cell interactions in situ. Despite recent…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Wei Wang , Quoc-Toan Ly , Chong Yu , Jun Bai

Spatiotemporal predictive learning (ST-PL) is a hotspot with numerous applications, such as object movement and meteorological prediction. It aims at predicting the subsequent frames via observed sequences. However, inherent uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Zenghao Chai , Zhengzhuo Xu , Yunpeng Bai , Zhihui Lin , Chun Yuan

Spatial synchronization in roadside scenarios is essential for integrating data from multiple sensors at different locations. Current methods using cascading spatial transformation (CST) often lead to cumulative errors in large-scale…

Signal Processing · Electrical Eng. & Systems 2023-11-09 Yong Li , Zhiguo Zhao , Yunli Chen , Rui Tian

Hyperspectral image super-resolution has attained widespread prominence to enhance the spatial resolution of hyperspectral images. However, convolution-based methods have encountered challenges in harnessing the global spatial-spectral…

Image and Video Processing · Electrical Eng. & Systems 2023-11-30 Shi Chen , Lefei Zhang , Liangpei Zhang
‹ Prev 1 2 3 10 Next ›