English
Related papers

Related papers: TC-SKNet with GridMask for Low-complexity Classifi…

200 papers

Acoustic scene classification (ASC) has been approached in the last years using deep learning techniques such as convolutional neural networks or recurrent neural networks. Many state-of-the-art solutions are based on image classification…

In this paper, we investigate the effect of different hyperparameters as well as different combinations of hyperparameters settings on the performance of the Attention-Gated Convolutional Neural Networks (AGCNNs), e.g., the kernel window…

Computation and Language · Computer Science 2019-10-17 Yang Liu , Jianpeng Zhang , Chao Gao , Jinghua Qu , Lixin Ji

Convolutional neural networks (CNNs), such as the time-delay neural network (TDNN), have shown their remarkable capability in learning speaker embedding. However, they meanwhile bring a huge computational cost in storage size, processing,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Rui Wang , Zhihua Wei , Haoran Duan , Shouling Ji , Yang Long , Zhen Hong

Recently, some large kernel convnets strike back with appealing performance and efficiency. However, given the square complexity of convolution, scaling up kernels can bring about an enormous amount of parameters and the proliferated…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Honghao Chen , Xiangxiang Chu , Yongjian Ren , Xin Zhao , Kaiqi Huang

We investigate the potential of stochastic neural networks for learning effective waveform-based acoustic models. The waveform-based setting, inherent to fully end-to-end speech recognition systems, is motivated by several comparative…

Machine Learning · Statistics 2021-08-17 Dino Oglic , Zoran Cvetkovic , Peter Sollich

Since medical image data sets contain few samples and singular features, lesions are viewed as highly similar to other tissues. The traditional neural network has a limited ability to learn features. Even if a host of feature maps is…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Hongfeng You , Long Yu , Shengwei Tian , Xiang Ma , Yan Xing , Xiaojie Ma

Light-weight convolutional neural networks (CNNs) suffer performance degradation as their low computational budgets constrain both the depth (number of convolution layers) and the width (number of channels) of CNNs, resulting in limited…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yinpeng Chen , Xiyang Dai , Mengchen Liu , Dongdong Chen , Lu Yuan , Zicheng Liu

Stochastic computing (SC) has emerged as an efficient low-power alternative for deploying neural networks (NNs) in resource-limited scenarios, such as the Internet of Things (IoT). By encoding values as serial bitstreams, SC significantly…

Machine Learning · Computer Science 2025-08-14 Ziheng Wang , Pedro Reviriego , Farzad Niknia , Zhen Gao , Javier Conde , Shanshan Liu , Fabrizio Lombardi

Deep learning-based super-resolution (SR) techniques have generally achieved excellent performance in the computer vision field. Recently, it has been proven that three-dimensional (3D) SR for medical volumetric data delivers better visual…

Image and Video Processing · Electrical Eng. & Systems 2021-05-19 Yinhao Li , Yutaro Iwamoto , Lanfen Lin , Rui Xu , Yen-Wei Chen

Extracting features from a huge amount of data for object recognition is a challenging task. Convolution neural network can be used to meet the challenge, but it often requires a large number of computation resources. In this paper, a…

Image and Video Processing · Electrical Eng. & Systems 2018-05-08 Yunlong Ma , Chunyan Wang

Colorectal cancer (CRC) grading is typically carried out by assessing the degree of gland formation within histology images. To do this, it is important to consider the overall tissue micro-environment by assessing the cell-level…

Image and Video Processing · Electrical Eng. & Systems 2019-09-04 Yanning Zhou , Simon Graham , Navid Alemi Koohbanani , Muhammad Shaban , Pheng-Ann Heng , Nasir Rajpoot

We propose a new approach for 3D instance segmentation based on sparse convolution and point affinity prediction, which indicates the likelihood of two points belonging to the same instance. The proposed network, built upon submanifold…

Computer Vision and Pattern Recognition · Computer Science 2019-02-13 Chen Liu , Yasutaka Furukawa

Hyperspectral image (HSI) classification faces critical challenges, including high spectral dimensionality, complex spectral-spatial correlations, and limited training samples with severe class imbalance. While CNNs excel at local feature…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Asmit Bandyopadhyay , Anindita Das Bhattacharjee , Rakesh Das

Complex-valued processing brought deep learning-based speech enhancement and signal extraction to a new level. Typically, the noise reduction process is based on a time-frequency (TF) mask which is applied to a noisy spectrogram. Complex…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-24 Hendrik Schröter , Tobias Rosenkranz , Alberto N. Escalante-B. , Andreas Maier

In this work, we investigate two popular end-to-end automatic speech recognition (ASR) models, namely Connectionist Temporal Classification (CTC) and RNN-Transducer (RNN-T), for offline recognition of voice search queries, with up to 2B…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-25 Weiran Wang , Rohit Prabhavalkar , Dongseong Hwang , Qiujia Li , Khe Chai Sim , Bo Li , James Qin , Xingyu Cai , Adam Stooke , Zhong Meng , CJ Zheng , Yanzhang He , Tara Sainath , Pedro Moreno Mengibar

Spatial transcriptomic (ST) clustering employs spatial and transcription information to group spots spatially coherent and transcriptionally similar together into the same spatial domain. Graph convolution network (GCN) and graph attention…

Quantitative Methods · Quantitative Biology 2023-10-24 Chen Zhang , Junhui Gao , Lingxin Kong , Guangshuo cao , Xiangyu Guo , Wei Liu

Porting state of the art deep learning algorithms to resource constrained compute platforms (e.g. VR, AR, wearables) is extremely challenging. We propose a fast, compact, and accurate model for convolutional neural networks that enables…

Computer Vision and Pattern Recognition · Computer Science 2017-06-14 Hessam Bagherinezhad , Mohammad Rastegari , Ali Farhadi

Recent research shows that the following two models are equivalent: (a) infinitely wide neural networks (NNs) trained under l2 loss by gradient descent with infinitesimally small learning rate (b) kernel regression with respect to so-called…

Machine Learning · Computer Science 2019-10-29 Sanjeev Arora , Simon S. Du , Zhiyuan Li , Ruslan Salakhutdinov , Ruosong Wang , Dingli Yu

In speech enhancement, complex neural network has shown promising performance due to their effectiveness in processing complex-valued spectrum. Most of the recent speech enhancement approaches mainly focus on wide-band signal with a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-17 Shubo Lv , Yihui Fu , Mengtao Xing , Jiayao Sun , Lei Xie , Jun Huang , Yannan Wang , Tao Yu

Time series classification is one of the most critical and challenging problems in data mining, existing widely in various fields and holding significant research importance. Despite extensive research and notable achievements with…

Machine Learning · Computer Science 2024-04-30 Haoxiao Wang , Bo Peng , Jianhua Zhang , Xu Cheng