中文
相关论文

相关论文: Selective Kernel Networks

200 篇论文

Convolutional neural networks (CNNs) have been successfully applied to medical image classification, segmentation, and related tasks. Among the many CNNs architectures, U-Net and its improved versions based are widely used and achieve…

计算机视觉与模式识别 · 计算机科学 2020-02-27 Henry H. Yu , Xue Feng , Hao Sun , Ziwen Wang

Convolutional neural networks (CNNs) for biomedical image analysis are often of very large size, resulting in high memory requirement and high latency of operations. Searching for an acceptable compressed representation of the base CNN for…

计算机视觉与模式识别 · 计算机科学 2019-09-10 Suraj Mishra , Peixian Liang , Adam Czajka , Danny Z. Chen , X. Sharon Hu

In this era of artificial intelligence, deep neural networks like Convolutional Neural Networks (CNNs) have emerged as front-runners, often surpassing human capabilities. These deep networks are often perceived as the panacea for all…

计算机视觉与模式识别 · 计算机科学 2023-11-15 Neeraj Kumar Singh , Nikhil R. Pal

We introduce the concept of scalable neural network kernels (SNNKs), the replacements of regular feedforward layers (FFLs), capable of approximating the latter, but with favorable computational properties. SNNKs effectively disentangle the…

机器学习 · 计算机科学 2024-03-07 Arijit Sehanobish , Krzysztof Choromanski , Yunfan Zhao , Avinava Dubey , Valerii Likhosherstov

Many recent machine learning tasks resort to quantum computing to improve classification accuracy and training efficiency by taking advantage of quantum mechanics, known as quantum machine learning (QML). The variational quantum circuit…

量子物理 · 物理学 2022-08-17 Jindi Wu , Zeyi Tao , Qun Li

Convolutional Neural Network(CNN) has been widely used for image recognition with great success. However, there are a number of limitations of the current CNN based image recognition paradigm. First, the receptive field of CNN is generally…

计算机视觉与模式识别 · 计算机科学 2018-03-28 Dong-Qing Zhang

Convolutional Neural Networks (CNNs) have been proven to be extremely successful at solving computer vision tasks. State-of-the-art methods favor such deep network architectures for its accuracy performance, with the cost of having massive…

计算机视觉与模式识别 · 计算机科学 2019-04-23 Jiahui Huang , Kshitij Dwivedi , Gemma Roig

The majority of recent state-of-the-art speaker verification architectures adopt multi-scale processing and frequency-channel attention mechanisms. Convolutional layers of these models typically have a fixed kernel size, e.g., 3 or 5. In…

音频与语音处理 · 电气工程与系统科学 2022-10-13 Sung Hwan Mun , Jee-weon Jung , Min Hyun Han , Nam Soo Kim

Convolutional neural network (CNN) is a class of artificial neural networks widely used in computer vision tasks. Most CNNs achieve excellent performance by stacking certain types of basic units. In addition to increasing the depth and…

计算机视觉与模式识别 · 计算机科学 2021-02-09 Junyi An , Fengshan Liu , Jian Zhao , Furao Shen

In this paper we propose cross-modal convolutional neural networks (X-CNNs), a novel biologically inspired type of CNN architectures, treating gradient descent-specialised CNNs as individual units of processing in a larger-scale network…

机器学习 · 统计学 2017-09-26 Petar Veličković , Duo Wang , Nicholas D. Lane , Pietro Liò

A biological neural network in the cortex forms a neural field. Neurons in the field have their own receptive fields, and connection weights between two neurons are random but highly correlated when they are in close proximity in receptive…

机器学习 · 计算机科学 2023-01-10 Kaito Watanabe , Kotaro Sakamoto , Ryo Karakida , Sho Sonoda , Shun-ichi Amari

Traditional convolutional neural networks (CNN) are stationary and feedforward. They neither change their parameters during evaluation nor use feedback from higher to lower layers. Real brains, however, do. So does our Deep Attention…

计算机视觉与模式识别 · 计算机科学 2014-07-29 Marijn Stollenga , Jonathan Masci , Faustino Gomez , Juergen Schmidhuber

The deep Convolutional Neural Network (CNN) is the state-of-the-art solution for large-scale visual recognition. Following basic principles such as increasing the depth and constructing highway connections, researchers have manually…

计算机视觉与模式识别 · 计算机科学 2017-03-07 Lingxi Xie , Alan Yuille

Light-weight convolutional neural networks (CNNs) suffer performance degradation as their low computational budgets constrain both the depth (number of convolution layers) and the width (number of channels) of CNNs, resulting in limited…

计算机视觉与模式识别 · 计算机科学 2020-04-02 Yinpeng Chen , Xiyang Dai , Mengchen Liu , Dongdong Chen , Lu Yuan , Zicheng Liu

Deep learning-based speech enhancement methods have significantly improved speech quality and intelligibility. Convolutional neural networks (CNNs) have been proven to be essential components of many high-performance models. In this paper,…

音频与语音处理 · 电气工程与系统科学 2025-11-11 Dahan Wang , Xiaobin Rong , Shiruo Sun , Yuxiang Hu , Changbao Zhu , Jing Lu

This paper presents a module, Spatial Cross-scale Convolution (SCSC), which is verified to be effective in improving both CNNs and Transformers. Nowadays, CNNs and Transformers have been successful in a variety of tasks. Especially for…

计算机视觉与模式识别 · 计算机科学 2023-08-15 Xijun Wang , Xiaojie Chu , Chunrui Han , Xiangyu Zhang

Spiking neural networks (SNNs) have gained attention in recent years due to their ability to handle sparse and event-based data better than regular artificial neural networks (ANNs). Since the structure of SNNs is less suited for typically…

信号处理 · 电气工程与系统科学 2023-11-27 Daniel Windhager , Bernhard A. Moser , Michael Lunglmayr

We propose a novel deep network structure called "Network In Network" (NIN) to enhance model discriminability for local patches within the receptive field. The conventional convolutional layer uses linear filters followed by a nonlinear…

神经与进化计算 · 计算机科学 2014-03-05 Min Lin , Qiang Chen , Shuicheng Yan

In this paper, we proposed large selective kernel and sparse attention network (LSKSANet) for remote sensing image semantic segmentation. The LSKSANet is a lightweight network that effectively combines convolution with sparse attention…

图像与视频处理 · 电气工程与系统科学 2024-06-04 Miao Fu , Feng Gao , Ruzhuang Hua , Yanhai Gan , Xiaowei Zhou , Yang Zhou

Accurate medical image segmentation is essential for diagnosis and treatment planning of diseases. Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance for automatic medical image segmentation. However, they are…

图像与视频处理 · 电气工程与系统科学 2020-11-05 Ran Gu , Guotai Wang , Tao Song , Rui Huang , Michael Aertsen , Jan Deprest , Sébastien Ourselin , Tom Vercauteren , Shaoting Zhang