English
Related papers

Related papers: Adaptive Frequency Filters As Efficient Global Tok…

200 papers

Fast Fourier convolution (FFC) is the recently proposed neural operator showing promising performance in several computer vision problems. The FFC operator allows employing large receptive field operations within early layers of the neural…

Sound · Computer Science 2022-04-08 Ivan Shchekotov , Pavel Andreev , Oleg Ivanov , Aibek Alanov , Dmitry Vetrov

Convolutional Neural Networks (CNNs) are widely used in fault diagnosis of mechanical systems due to their powerful feature extraction and classification capabilities. However, the CNN is a typical black-box model, and the mechanism of…

Artificial Intelligence · Computer Science 2024-03-12 Qian Chen , Xingjian Dong , Guowei Tu , Dong Wang , Baoxuan Zhao , Zhike Peng

Machine learning applied to computer vision and signal processing is achieving results comparable to the human brain on specific tasks due to the great improvements brought by the deep neural networks (DNN). The majority of state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 José Augusto Stuchi , Levy Boccato , Romis Attux

Fine-tuning is widely applied in image classification tasks as a transfer learning approach. It re-uses the knowledge from a source task to learn and obtain a high performance in target tasks. Fine-tuning is able to alleviate the challenge…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Xuyang Shen , Jo Plested , Sabrina Caldwell , Yiran Zhong , Tom Gedeon

We show that Transformer encoder architectures can be sped up, with limited accuracy costs, by replacing the self-attention sublayers with simple linear transformations that "mix" input tokens. These linear mixers, along with standard…

Computation and Language · Computer Science 2022-05-30 James Lee-Thorp , Joshua Ainslie , Ilya Eckstein , Santiago Ontanon

Convolutional neural network (CNN) has achieved impressive success in computer vision during the past few decades. The image convolution operation helps CNNs to get good performance on image-related tasks. However, it also has high…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Hengyue Pan , Yixin Chen , Zhiliang Tian , Peng Qiao , Linbo Qiao , Dongsheng Li

Window-based transformers have demonstrated outstanding performance in super-resolution tasks due to their adaptive modeling capabilities through local self-attention (SA). However, they exhibit higher computational complexity and inference…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Zhenyu Hu , Wanjie Sun

This paper proposes a deep neural network (DNN)-driven framework to address the longstanding generalization challenge in adaptive filtering (AF). In contrast to traditional AF frameworks that emphasize explicit cost function design, the…

Machine Learning · Statistics 2025-08-07 Qizhen Wang , Gang Wang , Ying-Chang Liang

Analog mixed-signal (AMS) devices promise faster, more energy-efficient deep neural network (DNN) inference than their digital counterparts. However, recent studies show that DNNs on AMS devices with fixed-point numbers can incur an…

Improving the generalization ability of Deep Neural Networks (DNNs) is critical for their practical uses, which has been a longstanding challenge. Some theoretical studies have uncovered that DNNs have preferences for some frequency…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Shiqi Lin , Zhizheng Zhang , Zhipeng Huang , Yan Lu , Cuiling Lan , Peng Chu , Quanzeng You , Jiang Wang , Zicheng Liu , Amey Parulkar , Viraj Navkal , Zhibo Chen

Transformers have captured growing attention in computer vision, thanks to its large capacity and global processing capabilities. However, transformers are data hungry, and their ability to generalize is constrained compared to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Hosam S. EL-Assiouti , Hadeer El-Saadawy , Maryam N. Al-Berry , Mohamed F. Tolba

Transformer-based language models utilize the attention mechanism for substantial performance improvements in almost all natural language processing (NLP) tasks. Similar attention structures are also extensively studied in several other…

Computation and Language · Computer Science 2023-05-17 Nurullah Sevim , Ege Ozan Özyedek , Furkan Şahinuç , Aykut Koç

The particle filter (PF) and the ensemble Kalman filter (EnKF) are widely used for approximate inference in state-space models. From a Bayesian perspective, these algorithms represent the prior by an ensemble of particles and update it to…

Methodology · Statistics 2025-02-11 Chengxin Gong , Wei Lin , Cheng Zhang

Accurate localization is a critical requirement for most robotic tasks. The main body of existing work is focused on passive localization in which the motions of the robot are assumed given, abstracting from their influence on sampling…

Robotics · Computer Science 2022-10-17 Daniel Honerkamp , Suresh Guttikonda , Abhinav Valada

While transformer models have been highly successful, they are computationally inefficient. We observe that for each layer, the full width of the layer may be needed only for a small subset of tokens inside a batch and that the "effective"…

Machine Learning · Computer Science 2024-12-19 Bartosz Wójcik , Alessio Devoto , Karol Pustelnik , Pasquale Minervini , Simone Scardapane

Applying feature dependent network weights have been proved to be effective in many fields. However, in practice, restricted by the enormous size of model parameters and memory footprints, scalable and versatile dynamic convolutions with…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Ze Wang , Zichen Miao , Jun Hu , Qiang Qiu

Deep learning and Convolutional Neural Networks (CNNs) have driven major transformations in diverse research areas. However, their limitations in handling low-frequency information present obstacles in certain tasks like interpreting global…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Fuzhi Wu , Jiasong Wu , Youyong Kong , Chunfeng Yang , Guanyu Yang , Huazhong Shu , Guy Carrault , Lotfi Senhadji

Recent studies have integrated convolutions into transformers to introduce inductive bias and improve generalization performance. However, the static nature of conventional convolution prevents it from dynamically adapting to input…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Meng Lou , Shu Zhang , Hong-Yu Zhou , Sibei Yang , Chuan Wu , Yizhou Yu

Vision Transformer and its variants have demonstrated great potential in various computer vision tasks. But conventional vision transformers often focus on global dependency at a coarse level, which suffer from a learning challenge on…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Yunhao Wang , Huixin Sun , Xiaodi Wang , Bin Zhang , Chao Li , Ying Xin , Baochang Zhang , Errui Ding , Shumin Han

To improve the throughput and energy efficiency of Deep Neural Networks (DNNs) on customized hardware, lightweight neural networks constrain the weights of DNNs to be a limited combination (denoted as $k\in\{1,2\}$) of powers of 2. In such…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Ruizhou Ding , Zeye Liu , Ting-Wu Chin , Diana Marculescu , R. D. , Blanton