English
Related papers

Related papers: Dynamic Multi-scale Convolution for Dialect Identi…

200 papers

This paper describes the extension and optimization of our previous work on very deep convolutional neural networks (CNNs) for effective recognition of noisy speech in the Aurora 4 task. The appropriate number of convolutional layers, the…

Computation and Language · Computer Science 2016-10-04 Yanmin Qian , Philip C Woodland

Convolutional recurrent neural networks (CRNNs) have achieved state-of-the-art performance for sound event detection (SED). In this paper, we propose to use a dilated CRNN, namely a CRNN with a dilated convolutional kernel, as the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-21 Yanxiong Li , Mingle Liu , Konstantinos Drossos , Tuomas Virtanen

Convolutional neural networks (CNNs) are a standard component of many current state-of-the-art Large Vocabulary Continuous Speech Recognition (LVCSR) systems. However, CNNs in LVCSR have not kept pace with recent advances in other domains…

Computation and Language · Computer Science 2016-01-26 Tom Sercu , Christian Puhrsch , Brian Kingsbury , Yann LeCun

Deep neural networks face many problems in the field of hyperspectral image classification, lack of effective utilization of spatial spectral information, gradient disappearance and overfitting as the model depth increases. In order to…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Guandong Li

Sound events often occur in unstructured environments where they exhibit wide variations in their frequency content and temporal structure. Convolutional neural networks (CNN) are able to extract higher level features that are invariant to…

Machine Learning · Computer Science 2017-05-31 Emre Çakır , Giambattista Parascandolo , Toni Heittola , Heikki Huttunen , Tuomas Virtanen

Fault diagnosis plays a crucial role in maintaining the operational integrity of mechanical systems, preventing significant losses due to unexpected failures. As intelligent manufacturing and data-driven approaches evolve, Deep Learning…

Machine Learning · Computer Science 2024-04-01 Zhongzhi Li , Rong Fan , Jingqi Tu , Jinyi Ma , Jianliang Ai , Yiqun Dong

Convolutional neural networks (CNN) have shown promising results for end-to-end speech recognition, albeit still behind other state-of-the-art methods in performance. In this paper, we study how to bridge this gap and go beyond with a novel…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Wei Han , Zhengdong Zhang , Yu Zhang , Jiahui Yu , Chung-Cheng Chiu , James Qin , Anmol Gulati , Ruoming Pang , Yonghui Wu

This paper proposes a new deep convolutional neural network (DCNN) architecture that learns pixel embeddings, such that pairwise distances between the embeddings can be used to infer whether or not the pixels lie on the same region. That…

Computer Vision and Pattern Recognition · Computer Science 2016-01-11 Adam W. Harley , Konstantinos G. Derpanis , Iasonas Kokkinos

Deep Convolutional Neural Networks (CNN) have exhibited superior performance in many visual recognition tasks including image classification, object detection, and scene label- ing, due to their large learning capacity and resistance to…

Computer Vision and Pattern Recognition · Computer Science 2016-10-12 Miao Sun , Tony X. Han , Xun Xu , Ming-Chang Liu , Ahmad Khodayari-Rostamabad

Crowd management technologies that leverage computer vision are widespread in contemporary times. There exists many security-related applications of these methods, including, but not limited to: following the flow of an array of people and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Soufien Hamrouni , Hakim Ghazzai , Hamid Menouar , Yahya Massoud

Convolutional neural networks (CNNs) have found many applications in tasks involving two-dimensional (2D) data, such as image classification and image processing. Therefore, 2D convolution layers have been heavily optimized on CPUs and…

Deep neural network (DNN) accelerators with improved energy and delay are desirable for meeting the requirements of hardware targeted for IoT and edge computing systems. Convolutional neural networks (CoNNs) belong to one of the most…

Computer Vision and Pattern Recognition · Computer Science 2019-05-06 Qiuwen Lou , Chenyun Pan , John McGuiness , Andras Horvath , Azad Naeemi , Michael Niemier , X. Sharon Hu

Efficient processing of large-scale time series data is an intricate problem in machine learning. Conventional sensor signal processing pipelines with hand engineered feature extraction often involve huge computational cost with high…

Within Convolutional Neural Network (CNN), the convolution operations are good at extracting local features but experience difficulty to capture global representations. Within visual transformer, the cascaded self-attention modules can…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Zhiliang Peng , Wei Huang , Shanzhi Gu , Lingxi Xie , Yaowei Wang , Jianbin Jiao , Qixiang Ye

Two architectures that generalize convolutional neural networks (CNNs) for the processing of signals supported on graphs are introduced. We start with the selection graph neural network (GNN), which replaces linear time invariant filters…

Signal Processing · Electrical Eng. & Systems 2019-01-30 Fernando Gama , Antonio G. Marques , Geert Leus , Alejandro Ribeiro

Deep learning algorithms, especially Transformer-based models, have achieved significant performance by capturing long-range dependencies and historical information. However, the power of convolution has not been fully investigated.…

Machine Learning · Computer Science 2023-12-29 Zhihao Yu , Liantao Ma , Yasha Wang , Junfeng Zhao

There are a variety of approaches to obtain a vast receptive field with convolutional neural networks (CNNs), such as pooling or striding convolutions. Most of these approaches were initially designed for image classification and later…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Omid Hosseini Jafari , Carsten Rother

Most convolutional neural networks use some method for gradually downscaling the size of the hidden layers. This is commonly referred to as pooling, and is applied to reduce the number of parameters, improve invariance to certain…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Faraz Saeedan , Nicolas Weber , Michael Goesele , Stefan Roth

Porting state of the art deep learning algorithms to resource constrained compute platforms (e.g. VR, AR, wearables) is extremely challenging. We propose a fast, compact, and accurate model for convolutional neural networks that enables…

Computer Vision and Pattern Recognition · Computer Science 2017-06-14 Hessam Bagherinezhad , Mohammad Rastegari , Ali Farhadi

Image denoising is a classical problem in low level computer vision. Model-based optimization methods and deep learning approaches have been the two main strategies for solving the problem. Model-based optimization methods are flexible for…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Chang Liu , Zhaowei Shang , Anyong Qin