中文
相关论文

相关论文: SCFormer: Structured Channel-wise Transformer with…

200 篇论文

Multivariate time series classification (MTSC) has attracted significant research attention due to its diverse real-world applications. Recently, exploiting transformers for MTSC has achieved state-of-the-art performance. However, existing…

机器学习 · 计算机科学 2024-05-24 Xuan-May Le , Ling Luo , Uwe Aickelin , Minh-Tuan Tran

Long-term time series forecasting (LTSF) has been widely applied in finance, traffic prediction, and other domains. Recently, patch-based transformers have emerged as a promising approach, segmenting data into sub-level patches that serve…

机器学习 · 计算机科学 2024-08-06 Ruixin Ding , Yuqi Chen , Yu-Ting Lan , Wei Zhang

Long-term urban mobility predictions play a crucial role in the effective management of urban facilities and services. Conventionally, urban mobility data has been structured as spatiotemporal videos, treating longitude and latitude grids…

机器学习 · 计算机科学 2023-12-05 Jinguo Cheng , Ke Li , Yuxuan Liang , Lijun Sun , Junchi Yan , Yuankai Wu

The Transformer is a highly successful deep learning model that has revolutionised the world of artificial neural networks, first in natural language processing and later in computer vision. This model is based on the attention mechanism…

机器学习 · 计算机科学 2023-05-09 Riccardo Ughi , Eugenio Lomurno , Matteo Matteucci

The recent development of multimodal single-cell technology has made the possibility of acquiring multiple omics data from individual cells, thereby enabling a deeper understanding of cellular states and dynamics. Nevertheless, the…

基因组学 · 定量生物学 2023-10-16 Wenzhuo Tang , Hongzhi Wen , Renming Liu , Jiayuan Ding , Wei Jin , Yuying Xie , Hui Liu , Jiliang Tang

Periodicity is a fundamental characteristic of time series data and has long played a central role in forecasting. Recent deep learning methods strengthen the exploitation of periodicity by treating patches as basic tokens, thereby…

机器学习 · 计算机科学 2025-10-07 Yiming Niu , Jinliang Deng , Yongxin Tong

Time series forecasting plays a critical role in domains such as energy, finance, and healthcare, where accurate predictions inform decision-making under uncertainty. Although Transformer-based models have demonstrated success in sequential…

机器学习 · 计算机科学 2025-05-27 Ali Forootani , Mohammad Khosravi

Transformers have demonstrated remarkable efficacy in forecasting time series data. However, their extensive dependence on self-attention mechanisms demands significant computational resources, thereby limiting their practical applicability…

机器学习 · 计算机科学 2024-06-26 Cat P. Le , Chris Cannella , Ali Hasan , Yuting Ng , Vahid Tarokh

In multivariate time series forecasting, the Transformer architecture encounters two significant challenges: effectively mining features from historical sequences and avoiding overfitting during the learning of temporal dependencies. To…

机器学习 · 计算机科学 2024-04-30 Han Zhou , Yuntian Chen

In this work we propose for the first time a transformer-based framework for unsupervised representation learning of multivariate time series. Pre-trained models can be potentially used for downstream tasks such as regression and…

机器学习 · 计算机科学 2020-12-10 George Zerveas , Srideepika Jayaraman , Dhaval Patel , Anuradha Bhamidipaty , Carsten Eickhoff

Accurate single-object tracking and short-term motion forecasting remain challenging under occlusion, scale variation, and temporal drift, which disrupt the temporal coherence required for real-time perception. We introduce…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Zhongping Dong , Pengyang Yu , Shuangjian Li , Liming Chen , Mohand Tahar Kechadi

Traffic forecasting, which aims to predict traffic conditions based on historical observations, has been an enduring research topic and is widely recognized as an essential component of intelligent transportation. Recent proposals on…

机器学习 · 计算机科学 2025-12-23 Zezhi Shao , Fei Wang , Tao Sun , Chengqing Yu , Yuchen Fang , Guangyin Jin , Zhulin An , Yang Liu , Xiaobo Qu , Yongjun Xu

Bases have become an integral part of modern deep learning-based models for time series forecasting due to their ability to act as feature extractors or future references. To be effective, a basis must be tailored to the specific set of…

机器学习 · 计算机科学 2024-01-19 Zelin Ni , Hang Yu , Shizhan Liu , Jianguo Li , Weiyao Lin

Time-series data are critical in diverse applications, such as industrial monitoring, medical diagnostics, and climate research. However, effectively integrating these high-dimensional temporal signals with natural language for dynamic,…

计算与语言 · 计算机科学 2025-06-26 Yilin Wang , Peixuan Lei , Jie Song , Yuzhe Hao , Tao Chen , Yuxuan Zhang , Lei Jia , Yuanxiang Li , Zhongyu Wei

Driver intention prediction seeks to anticipate drivers' actions by analyzing their behaviors with respect to surrounding traffic environments. Existing approaches primarily focus on late-fusion techniques, and neglect the importance of…

计算机视觉与模式识别 · 计算机科学 2023-05-16 Yunsheng Ma , Wenqian Ye , Xu Cao , Amr Abdelraouf , Kyungtae Han , Rohit Gupta , Ziran Wang

Recurrent Neural Networks were, until recently, one of the best ways to capture the timely dependencies in sequences. However, with the introduction of the Transformer, it has been proven that an architecture with only attention-mechanisms…

机器学习 · 计算机科学 2021-08-19 Radostin Cholakov , Todor Kolev

Deep models have demonstrated remarkable performance in time series forecasting. However, due to the partially-observed nature of real-world applications, solely focusing on the target of interest, so-called endogenous variables, is usually…

机器学习 · 计算机科学 2024-11-12 Yuxuan Wang , Haixu Wu , Jiaxiang Dong , Guo Qin , Haoran Zhang , Yong Liu , Yunzhong Qiu , Jianmin Wang , Mingsheng Long

Time series prediction is a widespread and well studied problem with applications in many domains (medical, geoscience, network analysis, finance, econometry etc.). In the case of multivariate time series, the key to good performances is to…

机器学习 · 计算机科学 2022-02-09 Darko Drakulic , Jean-Marc Andreoli

Within the field of complicated multivariate time series forecasting (TSF), popular techniques frequently rely on intricate deep learning architectures, ranging from transformer-based designs to recurrent neural networks. However, recent…

机器学习 · 计算机科学 2023-12-25 Aiyinsi Zuo , Haixi Zhang , Zirui Li , Ce Zheng

Dynamic link prediction plays a crucial role in diverse applications including social network analysis, communication forecasting, and financial modeling. While recent Transformer-based approaches have demonstrated promising results in…

机器学习 · 计算机科学 2026-03-05 Hantong Feng , Yonggang Wu , Duxin Chen , Wenwu Yu