English
Related papers

Related papers: MuST2-Learn: Multi-view Spatial-Temporal-Type Lear…

200 papers

Humans perceive and understand real-world spaces through a stream of visual observations. Therefore, the ability to streamingly maintain and update spatial evidence from potentially unbounded video streams is essential for spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Fangfu Liu , Diankun Wu , Jiawei Chi , Yimo Cai , Yi-Hsin Hung , Xumin Yu , Hao Li , Han Hu , Yongming Rao , Yueqi Duan

Cross-modal alignment aims to map heterogeneous modalities into a shared latent space, as exemplified by models like CLIP, which benefit from large-scale image-text pretraining for strong recognition capabilities. However, when operating in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Jiaxiang Liu , Yuan Wang , Jiawei Du , Joey Tianyi Zhou , Mingkun Xu , Zuozhu Liu

Nowadays, navigation and ride-sharing apps have collected numerous images with spatio-temporal data. A core technology for analyzing such images, associated with spatiotemporal information, is Traffic Scene Understanding (TSU), which aims…

Multimedia · Computer Science 2025-11-13 Jingtian Ma , Jingyuan Wang , Wayne Xin Zhao , Guoping Liu , Xiang Wen

Urbanization advances at unprecedented rates, leading to negative environmental and societal impacts. Remote sensing can help mitigate these effects by supporting sustainable development strategies with accurate information on urban growth.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Sebastian Hafner , Heng Fang , Hossein Azizpour , Yifang Ban

Achieving reliable multidimensional Vehicle-to-Vehicle (V2V) channel state information (CSI) prediction is both challenging and crucial for optimizing downstream tasks that depend on instantaneous CSI. This work extends traditional…

Systems and Control · Electrical Eng. & Systems 2024-09-24 Lei Chu , Daoud Burghal , Rui Wang , Michael Neuman , Andreas F. Molisch

Work zone is one of the major causes of non-recurrent traffic congestion and road incidents. Despite the significance of its impact, studies on predicting the traffic impact of work zones remain scarce. In this paper, we propose a data…

Machine Learning · Computer Science 2024-06-03 Qinhua Jiang , Xishun Liao , Yaofa Gong , Jiaqi Ma

Spatial-temporal forecasting plays an important role in many real-world applications, such as traffic forecasting, air pollutant forecasting, crowd-flow forecasting, and so on. State-of-the-art spatial-temporal forecasting models take…

Machine Learning · Computer Science 2024-01-22 Xinyu Su , Jianzhong Qi , Egemen Tanin , Yanchuan Chang , Majid Sarvi

The sensory traffic in Machine-to-Machine (M2M) communications has fairly heterogeneous service delay requirements. Therefore, we study the delay-performance of a heterogeneous M2M uplink from the sensors to a M2M application server (AS)…

Networking and Internet Architecture · Computer Science 2016-04-26 Akshay Kumar , Ahmed Abdelhadi , Charles Clancy

Multivariate Time Series (MTS) data capture temporal behaviors to provide invaluable insights into various physical dynamic phenomena. In smart mobility, MTS plays a crucial role in providing temporal dynamics of behaviors such as maneuver…

Machine Learning · Computer Science 2024-09-12 Thabang Lebese

Environmental monitoring is crucial to our understanding of climate change, biodiversity loss and pollution. The availability of large-scale spatio-temporal data from sources such as sensors and satellites allows us to develop sophisticated…

Multi-task learning (MTL) can advance assistive driving by exploring inter-task correlations through shared representations. However, existing methods face two critical limitations: single-modality constraints limiting comprehensive scene…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Wenzhuo Liu , Yicheng Qiao , Zhen Wang , Qiannan Guo , Zilong Chen , Meihua Zhou , Xinran Li , Letian Wang , Zhiwei Li , Huaping Liu , Wenshuo Wang

In recent years, semi-supervised learning has been widely explored and shows excellent data efficiency for 2D data. There is an emerging need to improve data efficiency for 3D tasks due to the scarcity of labeled 3D data. This paper…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zhimin Chen , Longlong Jing , Yang Liang , YingLi Tian , Bing Li

The rapid growth of location-based services (LBS) has yielded massive amounts of data on human mobility. Effectively extracting meaningful representations for user-generated check-in sequences is pivotal for facilitating various downstream…

Machine Learning · Computer Science 2024-07-26 Letian Gong , Huaiyu Wan , Shengnan Guo , Xiucheng Li , Yan Lin , Erwen Zheng , Tianyi Wang , Zeyu Zhou , Youfang Lin

Street view imagery is extensively utilized in representation learning for urban visual environments, supporting various sustainable development tasks such as environmental perception and socio-economic assessment. However, it is…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yong Li , Yingjing Huang , Gengchen Mai , Fan Zhang

Multivariate time series anomaly detection (MTSAD) aims to accurately identify and localize complex abnormal patterns in the large-scale industrial control systems. While existing approaches excel in recognizing the distinct patterns under…

Machine Learning · Computer Science 2025-12-17 Xuechun Liu , Heli Sun , Xuecheng Wu , Ruichen Cao , Yunyun Shi , Dingkang Yang , Haoran Li

Significant improvements in end-to-end speech translation (ST) have been achieved through the application of multi-task learning. However, the extent to which auxiliary tasks are highly consistent with the ST task, and how much this…

Computation and Language · Computer Science 2023-11-08 Yuhao Zhang , Chen Xu , Bei Li , Hao Chen , Tong Xiao , Chunliang Zhang , Jingbo Zhu

Spatio-temporal alignment is crucial for temporal modeling of end-to-end (E2E) perception in autonomous driving (AD), providing valuable structural and textural prior information. Existing methods typically rely on the attention mechanism…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Xiaoyu Li , Peidong Li , Xian Wu , Long Shi , Dedong Liu , Yitao Wu , Jiajia Fu , Dixiao Cui , Lijun Zhao , Lining Sun

Environmental sound classification systems often do not perform robustly across different sound classification tasks and audio signals of varying temporal structures. We introduce a multi-stream convolutional neural network with temporal…

Sound · Computer Science 2019-01-28 Xinyu Li , Venkata Chebiyyam , Katrin Kirchhoff

Traffic forecasting in cellular networks is a challenging spatiotemporal prediction problem due to strong temporal dependencies, spatial heterogeneity across cells, and the need for scalability to large network deployments. Traditional…

Machine Learning · Computer Science 2026-03-16 Zineddine Bettouche , Khalid Ali , Andreas Fischer , Andreas Kassler

Accurate forecasting of bus ridership (passengers numbers) is crucial for efficient management and optimization of public transport systems. Traditional forecasting models often fail to capture the unique and localized dynamics of different…

Machine Learning · Computer Science 2026-05-04 Daniel Azenkot , Michael Fire , Eran Ben Elia