English
Related papers

Related papers: What Makes Convolutional Models Great on Long Sequ…

200 papers

The use of Convolutional Neural Networks (CNNs) is widespread in Deep Learning due to a range of desirable model properties which result in an efficient and effective machine learning framework. However, performant CNN architectures must be…

In recent years, numerous Transformer-based models have been applied to long-term time-series forecasting (LTSF) tasks. However, recent studies with linear models have questioned their effectiveness, demonstrating that simple linear layers…

Machine Learning · Computer Science 2024-08-20 Jiaheng Yin , Zhengxin Shi , Jianshen Zhang , Xiaomin Lin , Yulin Huang , Yongzhi Qi , Wei Qi

Neural networks based on convolutional operations have achieved remarkable results in the field of deep learning, but there are two inherent flaws in standard convolutional operations. On the one hand, the convolution operation is confined…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Xin Zhang , Yingze Song , Tingting Song , Degang Yang , Yichen Ye , Jie Zhou , Liming Zhang

Current state-of-the-art reading comprehension models rely heavily on recurrent neural networks. We explored an entirely different approach to question answering: a convolutional model. By their nature, these convolutional models are fast…

Computation and Language · Computer Science 2018-10-23 Tobin Bell , Benjamin Penchas

Applying machine learning models to meteorological data brings many opportunities to the Geosciences field, such as predicting future weather conditions more accurately. In recent years, modeling meteorological data with deep neural…

Machine Learning · Computer Science 2020-11-11 Rafaela Castro , Yania M. Souto , Eduardo Ogasawara , Fabio Porto , Eduardo Bezerra

Linear time-invariant state space models (SSM) are a classical model from engineering and statistics, that have recently been shown to be very promising in machine learning through the Structured State Space sequence model (S4). A core…

Machine Learning · Computer Science 2022-08-08 Albert Gu , Isys Johnson , Aman Timalsina , Atri Rudra , Christopher Ré

This paper proposes the paradigm of large convolutional kernels in designing modern Convolutional Neural Networks (ConvNets). We establish that employing a few large kernels, instead of stacking multiple smaller ones, can be a superior…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Yiyuan Zhang , Xiaohan Ding , Xiangyu Yue

The prevalent approach to sequence to sequence learning maps an input sequence to a variable length output sequence via recurrent neural networks. We introduce an architecture based entirely on convolutional neural networks. Compared to…

Computation and Language · Computer Science 2017-07-26 Jonas Gehring , Michael Auli , David Grangier , Denis Yarats , Yann N. Dauphin

Modeling long range dependencies in sequential data is a fundamental step towards attaining human-level performance in many modalities such as text, vision, audio and video. While attention-based models are a popular and effective choice in…

Machine Learning · Computer Science 2022-05-20 Ankit Gupta , Albert Gu , Jonathan Berant

The convolutional neural network (CNN) is one of the most commonly used architectures for computer vision tasks. The key building block of a CNN is the convolutional kernel that aggregates information from the pixel neighborhood and shares…

Image and Video Processing · Electrical Eng. & Systems 2022-02-08 Tianyu Ma , Alan Q. Wang , Adrian V. Dalca , Mert R. Sabuncu

Models using structured state space sequence (S4) layers have achieved state-of-the-art performance on long-range sequence modeling tasks. An S4 layer combines linear state space models (SSMs), the HiPPO framework, and deep learning to…

Machine Learning · Computer Science 2023-03-06 Jimmy T. H. Smith , Andrew Warrington , Scott W. Linderman

Performant Convolutional Neural Network (CNN) architectures must be tailored to specific tasks in order to consider the length, resolution, and dimensionality of the input data. In this work, we tackle the need for problem-specific CNN…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 David M. Knigge , David W. Romero , Albert Gu , Efstratios Gavves , Erik J. Bekkers , Jakub M. Tomczak , Mark Hoogendoorn , Jan-Jakob Sonke

Existing models encounter bottlenecks in balancing performance and computational efficiency when modeling long sequences. Although the state space model (SSM) has achieved remarkable success in handling long sequence tasks, it still faces…

Machine Learning · Computer Science 2025-05-06 Tongyi Liang , Han-Xiong Li

The convolution operation is a central building block of neural network architectures widely used in computer vision. The size of the convolution kernels determines both the expressiveness of convolutional neural networks (CNN), as well as…

Image and Video Processing · Electrical Eng. & Systems 2022-10-10 Tianyu Ma , Adrian V. Dalca , Mert R. Sabuncu

Conventional neural architectures for sequential data present important limitations. Recurrent networks suffer from exploding and vanishing gradients, small effective memory horizons, and must be trained sequentially. Convolutional networks…

Machine Learning · Computer Science 2022-03-18 David W. Romero , Anna Kuzina , Erik J. Bekkers , Jakub M. Tomczak , Mark Hoogendoorn

When designing Convolutional Neural Networks (CNNs), one must select the size\break of the convolutional kernels before training. Recent works show CNNs benefit from different kernel sizes at different layers, but exploring all possible…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 David W. Romero , Robert-Jan Bruintjes , Jakub M. Tomczak , Erik J. Bekkers , Mark Hoogendoorn , Jan C. van Gemert

Vision Transformers have shown great promise recently for many vision tasks due to the insightful architecture design and attention mechanism. By revisiting the self-attention responses in Transformers, we empirically observe two…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Xu Ma , Huan Wang , Can Qin , Kunpeng Li , Xingchen Zhao , Jie Fu , Yun Fu

Large-scale point cloud consists of a multitude of individual objects, thereby encompassing rich structural and underlying semantic contextual information, resulting in a challenging problem in efficiently segmenting a point cloud. Most…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Zhenchao Lin , Li He , Hongqiang Yang , Xiaoqun Sun , Cuojin Zhang , Weinan Chen , Yisheng Guan , Hong Zhang

In this work, we tackle model efficiency by exploiting redundancy in the \textit{implicit structure} of the building blocks of convolutional neural networks. We start our analysis by introducing a general definition of Composite Kernel…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Yash Bhalgat , Yizhe Zhang , Jamie Lin , Fatih Porikli

In the realm of deep learning, spatial attention mechanisms have emerged as a vital method for enhancing the performance of convolutional neural networks. However, these mechanisms possess inherent limitations that cannot be overlooked.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Xin Zhang , Chen Liu , Degang Yang , Tingting Song , Yichen Ye , Ke Li , Yingze Song