English
Related papers

Related papers: SCINet: Time Series Modeling and Forecasting with …

200 papers

Time series forecasting has received a lot of attention, with recurrent neural networks (RNNs) being one of the widely used models due to their ability to handle sequential data. Previous studies on RNN time series forecasting, however,…

Machine Learning · Computer Science 2024-04-29 Christopher Salazar , Ashis G. Banerjee

Spatiotemporal learning is challenging due to the intricate interplay between spatial and temporal dependencies, the high dimensionality of the data, and scalability constraints. These challenges are further amplified in scientific domains,…

Machine Learning · Computer Science 2025-04-17 David Keetae Park , Xihaier Luo , Guang Zhao , Seungjun Lee , Miruna Oprescu , Shinjae Yoo

Deep convolutional networks have achieved great success for visual recognition in still images. However, for action recognition in videos, the advantage over traditional methods is not so evident. This paper aims to discover the principles…

Computer Vision and Pattern Recognition · Computer Science 2016-08-03 Limin Wang , Yuanjun Xiong , Zhe Wang , Yu Qiao , Dahua Lin , Xiaoou Tang , Luc Van Gool

Time series forecasting is traditionally dominated by sequence-based architectures such as recurrent neural networks and attention mechanisms, which process all time steps uniformly and often incur substantial computational cost. However,…

Signal Processing · Electrical Eng. & Systems 2026-04-21 K. A. Shahriar

Although deep feedforward neural networks share some characteristics with the primate visual system, a key distinction is their dynamics. Deep nets typically operate in serial stages wherein each layer completes its computation before…

Machine Learning · Computer Science 2021-11-03 Michael L. Iuzzolino , Michael C. Mozer , Samy Bengio

Downsampling is widely adopted to achieve a good trade-off between accuracy and latency for visual recognition. Unfortunately, the commonly used pooling layers are not learned, and thus cannot preserve important information. As another…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Ho Man Kwan , Shenghui Song

Convolutional neural networks (CNNs) have made significant advances in computer vision tasks, yet their high inference times and latency often limit real-world applicability. While model compression techniques have gained popularity as…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Zhumazhan Balapanov , Vanessa Matvei , Olivia Holmberg , Edward Magongo , Jonathan Pei , Kevin Zhu

Time series (TS) forecasting has been an unprecedentedly popular problem in recent years, with ubiquitous applications in both scientific and business fields. Various approaches have been introduced to time series analysis, including both…

Machine Learning · Computer Science 2024-05-20 Ziyou Guo , Yan Sun , Tieru Wu

Convolutional neural networks (CNNs) can potentially provide powerful tools for classifying and identifying patterns in climate and environmental data. However, because of the inherent complexities of such data, which are often…

Atmospheric and Oceanic Physics · Physics 2020-03-03 Ashesh Chattopadhyay , Pedram Hassanzadeh , Saba Pasha

The availability of large amounts of time series data, paired with the performance of deep-learning algorithms on a broad class of problems, has recently led to significant interest in the use of sequence-to-sequence models for time series…

Machine Learning · Computer Science 2019-02-27 Vitaly Kuznetsov , Zelda Mariet

Convolutional Neural Networks (CNNs) filter the input data using spatial convolution operators with compact stencils. Commonly, the convolution operators couple features from all channels, which leads to immense computational cost in the…

Machine Learning · Computer Science 2019-05-17 Jonathan Ephrath , Lars Ruthotto , Eldad Haber , Eran Treister

In this paper, we study the challenging problem of multi-object tracking in a complex scene captured by a single camera. Different from the existing tracklet association-based tracking methods, we propose a novel and efficient way to obtain…

Computer Vision and Pattern Recognition · Computer Science 2016-09-27 Bing Wang , Li Wang , Bing Shuai , Zhen Zuo , Ting Liu , Kap Luk Chan , Gang Wang

Neural forecasting of spatiotemporal time series drives both research and industrial innovation in several relevant application domains. Graph neural networks (GNNs) are often the core component of the forecasting architecture. However, in…

Machine Learning · Computer Science 2023-02-21 Andrea Cini , Ivan Marisca , Filippo Maria Bianchi , Cesare Alippi

Subsequence-based time series classification algorithms provide accurate and interpretable models, but training these models is extremely computation intensive. The asymptotic time complexity of subsequence-based algorithms remains a…

Machine Learning · Computer Science 2021-02-18 Atif Raza , Stefan Kramer

Sensor-based time series analysis is an essential task for applications such as activity recognition and brain-computer interface. Recently, features extracted with deep neural networks (DNNs) are shown to be more effective than…

Signal Processing · Electrical Eng. & Systems 2020-12-11 Minhao Liu , Ailing Zeng , Qiuxia Lai , Qiang Xu

Long-term time series forecasting is a vital task and has a wide range of real applications. Recent methods focus on capturing the underlying patterns from one single domain (e.g. the time domain or the frequency domain), and have not taken…

Machine Learning · Computer Science 2023-08-28 Yuxiao Luo , Ziyu Lyu , Xingyu Huang

Time series analysis is relevant in various disciplines such as physics, biology, chemistry, and finance. In this paper, we present a novel neural network architecture that integrates elements from ResNet structures, while introducing the…

Machine Learning · Computer Science 2024-02-12 Jarrod Mau , Kevin Moon

Instance normalization (IN) is widely used in non-stationary multivariate time series forecasting to reduce distribution shifts and highlight common patterns across samples. However, IN can over-smooth instance-specific structural…

Machine Learning · Computer Science 2026-05-15 Hao Li , Lu Zhang , Liu Chong , Yankai Chen , Pengyang Wang , Yingjie Zhou

Multivariate time series forecasting is crucial for various applications, such as financial investment, energy management, weather forecasting, and traffic optimization. However, accurate forecasting is challenging due to two main factors.…

Machine Learning · Computer Science 2025-01-13 Xiangfei Qiu , Xingjian Wu , Yan Lin , Chenjuan Guo , Jilin Hu , Bin Yang

A novel convolution neural network model, abbreviated NL-CNN is proposed, where nonlinear convolution is emulated in a cascade of convolution + nonlinearity layers. The code for its implementation and some trained models are made publicly…

Machine Learning · Computer Science 2021-02-03 Radu Dogaru , Ioana Dogaru