中文
相关论文

相关论文: TwinFormer: A Dual-Level Transformer for Long-Sequ…

200 篇论文

Most existing ultra-high resolution (UHR) segmentation methods always struggle in the dilemma of balancing memory cost and local characterization accuracy, which are both taken into account in our proposed Guided Patch-Grouping Wavelet…

计算机视觉与模式识别 · 计算机科学 2023-07-07 Deyi Ji , Feng Zhao , Hongtao Lu

Forecasting long-term time series in IoT environments remains a significant challenge due to the non-stationary and multi-scale characteristics of sensor signals. Furthermore, error accumulation causes a decrease in forecast quality when…

机器学习 · 计算机科学 2025-11-10 Qianyang Li , Xingjun Zhang , Peng Tao , Shaoxun Wang , Yancheng Pan , Jia Wei

Origin-Destination (OD) matrices record directional flow data between pairs of OD regions. The intricate spatiotemporal dependency in the matrices makes the OD matrix forecasting (ODMF) problem not only intractable but also non-trivial.…

人工智能 · 计算机科学 2022-08-18 Jin Huang , Bosong Huang , Weihao Yu , Jing Xiao , Ruzhong Xie , Ke Ruan

In the real world, long sequence time-series forecasting (LSTF) is needed in many cases, such as power consumption prediction and air quality prediction.Multi-dimensional long time series model has more strict requirements on the model,…

机器学习 · 计算机科学 2022-05-11 Ning Wang

Time series forecasting is crucial for various applications, such as weather, traffic, electricity, and energy predictions. Currently, common time series forecasting methods are based on Transformers. However, existing approaches primarily…

机器学习 · 计算机科学 2025-09-30 Zixu Wang , Hongbin Dong , Xiaoping Zhang

Time series analysis faces significant challenges in handling variable-length data and achieving robust generalization. While Transformer-based models have advanced time series tasks, they often struggle with feature redundancy and limited…

机器学习 · 计算机科学 2025-09-23 Kai Zhang , Siming Sun , Zhengyu Fan , Qinmin Yang , Xuejun Jiang

Accurate forecasting of multivariate time series remains challenging due to the need to capture both short-term fluctuations and long-range temporal dependencies. Transformer-based models have emerged as a powerful approach, but their…

机器学习 · 计算机科学 2026-03-26 Aymane Harkati , Moncef Garouani , Olivier Teste , Julien Aligon , Mohamed Hamlich

Accurate typhoon track forecasting is crucial for early system warning and disaster response. While Transformer-based models have demonstrated strong performance in modeling the temporal dynamics of dense trajectories of humans and vehicles…

计算与语言 · 计算机科学 2025-11-25 Lincan Li , Eren Erman Ozguven , Yue Zhao , Guang Wang , Yiqun Xie , Yushun Dong

In long-term multivariate time series forecasting, effectively capturing both periodic patterns and residual dynamics is essential. To address this within standard deep learning benchmark settings, we propose the Hierarchical Patching Mixer…

机器学习 · 计算机科学 2026-02-20 Jung Min Choi , Vijaya Krishna Yalavarthi , Lars Schmidt-Thieme

Transformers have emerged as viable alternatives to convolutional neural networks owing to their ability to learn non-local region relationships in the spatial domain. The self-attention mechanism of the transformer enables transformers to…

图像与视频处理 · 电气工程与系统科学 2023-08-09 Rahul G. S. , Sriprabha Ramnarayanan , Mohammad Al Fahim , Keerthi Ram , Preejith S. P , Mohanasankar Sivaprakasam

Time series forecasting has played a significant role in many practical fields. But time series data generated from real-world applications always exhibits high variance and lots of noise, which makes it difficult to capture the inherent…

机器学习 · 计算机科学 2024-10-10 Yangyang Guo , Yanjun Zhao , Sizhe Dang , Tian Zhou , Liang Sun , Yi Qian

Transformers have shown dominant performance across a range of domains including language and vision. However, their computational cost grows quadratically with the sequence length, making their usage prohibitive for resource-constrained…

计算与语言 · 计算机科学 2023-10-24 Yinghan Long , Sayeed Shafayet Chowdhury , Kaushik Roy

Local feature matching is a computationally intensive task at the subpixel level. While detector-based methods coupled with feature descriptors struggle in low-texture scenes, CNN-based methods with a sequential extract-to-match pipeline,…

计算机视觉与模式识别 · 计算机科学 2022-09-27 Qing Wang , Jiaming Zhang , Kailun Yang , Kunyu Peng , Rainer Stiefelhagen

Time Series Forecasting plays a crucial role in various fields such as industrial equipment maintenance, meteorology, energy consumption, traffic flow and financial investment. However, despite their considerable advantages over traditional…

机器学习 · 计算机科学 2024-07-02 Ruiqi Li , Maowei Jiang , Kai Wang , Kaiduo Feng , Quangao Liu , Yue Sun , Xiufang Zhou

Multivariate time series forecasting is a pivotal task in several domains, including financial planning, medical diagnostics, and climate science. This paper presents the Neural Fourier Transform (NFT) algorithm, which combines…

机器学习 · 计算机科学 2024-05-24 Noam Koren , Kira Radinsky

Seasonal time series Forecasting remains a challenging problem due to the long-term dependency from seasonality. In this paper, we propose a two-stage framework to forecast univariate seasonal time series. The first stage explicitly learns…

机器学习 · 计算机科学 2021-06-08 Qingyang Xu , Qingsong Wen , Liang Sun

The emergence of 6th generation (6G) mobile networks brings new challenges in supporting high-mobility communications, particularly in addressing the issue of channel aging. While existing channel prediction methods offer improved accuracy…

机器学习 · 计算机科学 2024-10-30 Yanliang Jin , Yifan Wu , Yuan Gao , Shunqing Zhang , Shugong Xu , Cheng-Xiang Wang

Standard inference and training with transformer based architectures scale quadratically with input sequence length. This is prohibitively large for a variety of applications especially in web-page translation, query-answering etc.…

计算与语言 · 计算机科学 2023-03-20 Lovish Madaan , Srinadh Bhojanapalli , Himanshu Jain , Prateek Jain

Non-hierarchical sparse attention Transformer-based models, such as Longformer and Big Bird, are popular approaches to working with long documents. There are clear benefits to these approaches compared to the original Transformer in terms…

计算与语言 · 计算机科学 2022-10-12 Ilias Chalkidis , Xiang Dai , Manos Fergadiotis , Prodromos Malakasiotis , Desmond Elliott

Transformers have recently gained prominence in long time series forecasting by elevating accuracies in a variety of use cases. Regrettably, in the race for better predictive performance the overhead of model architectures has grown…