中文
相关论文

相关论文: Dataset-Driven Channel Masks in Transformers for M…

200 篇论文

Time series forecasting is a key component in many industrial and business decision processes and recurrent neural network (RNN) based models have achieved impressive progress on various time series forecasting tasks. However, most of the…

机器学习 · 计算机科学 2021-01-26 Zekai Chen , Jiaze E , Xiao Zhang , Hao Sheng , Xiuzheng Cheng

There has been a recent surge of interest in time series modeling using the Transformer architecture. However, forecasting multivariate time series with Transformer presents a unique challenge as it requires modeling both temporal…

机器学习 · 计算机科学 2025-07-04 Yu-Hsiang Lan , Eric K. Oermann

Time series forecasting has attracted significant attention in the field of AI. Previous works have revealed that the Channel-Independent (CI) strategy improves forecasting performance by modeling each channel individually, but it often…

机器学习 · 计算机科学 2026-03-17 Dongyuan Li , Shun Zheng , Chang Xu , Jiang Bian , Renhe Jiang

Medical image segmentation faces challenges due to variations in anatomical structures. While convolutional neural networks (CNNs) effectively capture local features, they struggle with modeling long-range dependencies. Transformers…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Lalit Maurya , Honghai Liu , Reyer Zwiggelaar

Transformer-based models have shown strong performance in time-series forecasting by leveraging self-attention to model long-range temporal dependencies. However, their effectiveness depends critically on the quality and structure of input…

机器学习 · 计算机科学 2026-02-11 Saurish Nagrath , Saroj Kumar Panigrahy

Long-term time series forecasting (LTSF) is a crucial aspect of modern society, playing a pivotal role in facilitating long-term planning and developing early warning systems. While many Transformer-based models have recently been…

机器学习 · 计算机科学 2023-05-31 Jiaxin Gao , Wenbo Hu , Yuntian Chen

Recent synthetic speech detectors leveraging the Transformer model have superior performance compared to the convolutional neural network counterparts. This improvement could be due to the powerful modeling ability of the multi-head…

声音 · 计算机科学 2024-09-10 Duc-Tuan Truong , Ruijie Tao , Tuan Nguyen , Hieu-Thi Luong , Kong Aik Lee , Eng Siong Chng

Transformer-based models have emerged as powerful tools for multivariate time series forecasting (MTSF). However, existing Transformer models often fall short of capturing both intricate dependencies across variate and temporal dimensions…

机器学习 · 计算机科学 2024-06-10 Juncheng Liu , Chenghao Liu , Gerald Woo , Yiwei Wang , Bryan Hooi , Caiming Xiong , Doyen Sahoo

Transformer-based time series forecasting has recently gained strong interest due to the ability of transformers to model sequential data. Most of the state-of-the-art architectures exploit either temporal or inter-channel dependencies,…

机器学习 · 计算机科学 2025-03-25 Davide Villaboni , Alberto Castellini , Ivan Luciano Danesi , Alessandro Farinelli

Deep learning (DL)-based methods have recently shown great promise in bitemporal change detection (CD). Existing discriminative methods based on Convolutional Neural Networks (CNNs) and Transformers rely on discriminative representation…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Yihan Wen , Xianping Ma , Xiaokang Zhang , Man-On Pun

Causal discovery from time series is critical for many real-world applications, such as tracing the root causes of anomalies. Existing approaches typically rely on dataset-specific optimization, making it difficult to transfer their causal…

机器学习 · 计算机科学 2026-05-27 Biao Ouyang , Tengxue Zhang , Zhihao Zhuang , Yang Shu , Chenjuan Guo , Bin Yang

Finding effective representations for time series data is a useful but challenging task. Several works utilize self-supervised or unsupervised learning methods to address this. However, there still remains the open question of how to…

机器学习 · 计算机科学 2024-03-19 Yuansan Liu , Sudanthi Wijewickrema , Christofer Bester , Stephen O'Leary , James Bailey

Deep learning based change detection methods have received wide attentoion, thanks to their strong capability in obtaining rich features from images. However, existing AI-based CD methods largely rely on three functionality-enhancing…

计算机视觉与模式识别 · 计算机科学 2022-12-12 Kaixuan Lu , Xiao Huang

Time series forecasting is widely used in the fields of equipment life cycle forecasting, weather forecasting, traffic flow forecasting, and other fields. Recently, some scholars have tried to apply Transformer to time series forecasting…

机器学习 · 计算机科学 2022-02-24 Benhan Li , Shengdong Du , Tianrui Li

Liquid Chromatography coupled to Mass Spectrometry (LC-MS) based methods are commonly used for high-throughput, quantitative measurements of the proteome (i.e. the set of all proteins in a sample at a given time). Targeted LC-MS produces…

计算机视觉与模式识别 · 计算机科学 2020-10-28 Leon L. Xu , Hannes L. Röst

Time series forecasting is essential for many practical applications, with the adoption of transformer-based models on the rise due to their impressive performance in NLP and CV. Transformers' key feature, the attention mechanism,…

机器学习 · 计算机科学 2024-02-09 PeiSong Niu , Tian Zhou , Xue Wang , Liang Sun , Rong Jin

Remote sensing change detection aims to compare two or more images recorded for the same area but taken at different time stamps to quantitatively and qualitatively assess changes in geographical entities and environmental factors.…

计算机视觉与模式识别 · 计算机科学 2024-06-24 Xiaowen Ma , Zhenkai Wu , Rongrong Lian , Wei Zhang , Siyang Song

Time series analysis faces significant challenges in handling variable-length data and achieving robust generalization. While Transformer-based models have advanced time series tasks, they often struggle with feature redundancy and limited…

机器学习 · 计算机科学 2025-09-23 Kai Zhang , Siming Sun , Zhengyu Fan , Qinmin Yang , Xuejun Jiang

International Classification of Disease (ICD) coding procedure which refers to tagging medical notes with diagnosis codes has been shown to be effective and crucial to the billing system in medical sector. Currently, ICD codes are assigned…

计算与语言 · 计算机科学 2021-04-22 Biplob Biswas , Thai-Hoang Pham , Ping Zhang

Deep models for Multivariate Time Series (MTS) forecasting have recently demonstrated significant success. Channel-dependent models capture complex dependencies that channel-independent models cannot capture. However, the number of channels…

机器学习 · 计算机科学 2024-08-09 Xin Zhou , Weiqing Wang , Wray Buntine , Shilin Qu , Abishek Sriramulu , Weicong Tan , Christoph Bergmeir