English
Related papers

Related papers: Frequency-Aware Attention-LSTM for PM$_{2.5}$ Time…

200 papers

Fault diagnosis plays a crucial role in maintaining the operational integrity of mechanical systems, preventing significant losses due to unexpected failures. As intelligent manufacturing and data-driven approaches evolve, Deep Learning…

Machine Learning · Computer Science 2024-04-01 Zhongzhi Li , Rong Fan , Jingqi Tu , Jinyi Ma , Jianliang Ai , Yiqun Dong

In the post-Moore era, 2.5D chiplet-based ICs present significant challenges in thermal management due to increased power density and thermal hotspots. Neural network-based thermal prediction models can perform real-time predictions for…

Machine Learning · Computer Science 2025-04-22 Dekang Zhang , Dan Niu , Zhou Jin , Yichao Dong , Jingweijia Tan , Changyin Sun

Short-term passenger flow forecasting is an essential component in urban rail transit operation. Emerging deep learning models provide good insight into improving prediction precision. Therefore, we propose a deep learning architecture…

Signal Processing · Electrical Eng. & Systems 2021-08-09 Jinlei Zhang , Feng Chen , Zhiyong Cui , Yinan Guo , Yadi Zhu

Air quality is closely related to public health. Health issues such as cardiovascular diseases and respiratory diseases, may have connection with long exposure to highly polluted environment. Therefore, accurate air quality forecasts are…

Applications · Statistics 2019-12-17 Haolin Fei , Xiaofeng Wu , Chunbo Luo

Interpreting scattered acoustic and electromagnetic wave patterns is a computational task that enables remote imaging in a number of important applications, including medical imaging, geophysical exploration, sonar and radar detection, and…

Computational Physics · Physics 2025-04-03 Owen Melia , Olivia Tsang , Vasileios Charisopoulos , Yuehaw Khoo , Jeremy Hoskins , Rebecca Willett

Traditional Transformers face a major bottleneck in long-sequence time series forecasting due to their quadratic complexity $(\mathcal{O}(T^2))$ and their limited ability to effectively exploit frequency-domain information. Inspired by…

Machine Learning · Computer Science 2025-12-10 Qingyuan Yang , Shizhuo Deng , Dongyue Chen , Da Teng , Zehua Gan

Environmental Sound Classification (ESC) is a rapidly evolving field that recently demonstrated the advantages of application of visual domain techniques to the audio-related tasks. Previous studies indicate that the domain-specific…

Sound · Computer Science 2021-04-26 Andrey Guzhov , Federico Raue , Jörn Hees , Andreas Dengel

An increasing number of software applications incorporate runtime Deep Neural Networks (DNNs) to process sensor data and return inference results to humans. Effective deployment of DNNs in these interactive scenarios requires meeting…

Performance · Computer Science 2024-07-09 Chengcheng Wan , Muhammad Santriaji , Eri Rogers , Henry Hoffmann , Michael Maire , Shan Lu

Multi-task learning for dense prediction is limited by the need for extensive annotation for every task, though recent works have explored training with partial task labels. Leveraging the generalization power of diffusion models, we extend…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Anh-Quan Cao , Ivan Lopes , Raoul de Charette

Global ambient air pollution, a transboundary challenge, is typically addressed through interventions relying on data from spatially sparse and heterogeneously placed monitoring stations. These stations often encounter temporal data gaps…

Machine Learning · Computer Science 2024-02-19 Liam J Berrisford , Hugo Barbosa , Ronaldo Menezes

We consider the problem of segmentation and classification of high-resolution and hyperspectral remote sensing images. Unlike conventional natural (RGB) images, the inherent large scale and complex structures of remote sensing images pose…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Qingsong Xu , Xin Yuan , Chaojun Ouyang , Yue Zeng

Multi-task learning (MTL) and attention mechanism have been proven to effectively extract robust acoustic features for various speech-related tasks in noisy environments. In this study, we propose an attention-based MTL (ATM) approach that…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-23 Chiang-Jen Peng , Yun-Ju Chan , Cheng Yu , Syu-Siang Wang , Yu Tsao , Tai-Shih Chi

Many real-world time series exhibit strong periodic structures arising from physical laws, human routines, or seasonal cycles. However, modern deep forecasting models often fail to capture these recurring patterns due to spectral bias and a…

Machine Learning · Computer Science 2025-08-05 Menglin Kong , Vincent Zhihao Zheng , Lijun Sun

Multivariate time series forecasting is extensively studied throughout the years with ubiquitous applications in areas such as finance, traffic, environment, etc. Still, concerns have been raised on traditional methods for incapable of…

Machine Learning · Computer Science 2018-09-10 Yen-Yu Chang , Fan-Yun Sun , Yueh-Hua Wu , Shou-De Lin

Spatio-temporal (ST) data, which represent multiple time series data corresponding to different spatial locations, are ubiquitous in real-world dynamic systems, such as air quality readings. Forecasting over ST data is of great importance…

Machine Learning · Computer Science 2018-10-01 Zheyi Pan , Yuxuan Liang , Junbo Zhang , Xiuwen Yi , Yong Yu , Yu Zheng

In recent years, deep learning has increasingly gained attention in the field of traffic prediction. Existing traffic prediction models often rely on GCNs or attention mechanisms with O(N^2) complexity to dynamically extract traffic node…

Machine Learning · Computer Science 2024-08-15 Wenchao Weng , Mei Wu , Hanyu Jiang , Wanzeng Kong , Xiangjie Kong , Feng Xia

Currently, spatiotemporal features are embraced by most deep learning approaches for human action detection in videos, however, they neglect the important features in frequency domain. In this work, we propose an end-to-end network that…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Changhai Li , Huawei Chen , Jingqing Lu , Yang Huang , Yingying Liu

In this paper, we introduce spatial attention for refining the information in multi-direction neural beamformer for far-field automatic speech recognition. Previous approaches of neural beamformers with multiple look directions, such as the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-10 Weipeng He , Lu Lu , Biqiao Zhang , Jay Mahadeokar , Kaustubh Kalgaonkar , Christian Fuegen

For hourly PM2.5 concentration prediction, accurately capturing the data patterns of external factors that affect PM2.5 concentration changes, and constructing a forecasting model is one of efficient means to improve forecasting accuracy.…

Signal Processing · Electrical Eng. & Systems 2020-12-08 Fuxin Jiang , Chengyuan Zhang , Shaolong Sun , Jingyun Sun

Recently, masked image modeling (MIM), which learns visual representations by reconstructing the masked patches of an image, has dominated self-supervised learning in computer vision. However, the pre-training of MIM always takes massive…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Jie Gui , Tuo Chen , Minjing Dong , Zhengqi Liu , Hao Luo , James Tin-Yau Kwok , Yuan Yan Tang