English
Related papers

Related papers: Exploiting Hybrid Models of Tensor-Train Networks …

200 papers

Deep structured output learning shows great promise in tasks like semantic image segmentation. We proffer a new, efficient deep structured model learning scheme, in which we show how deep Convolutional Neural Networks (CNNs) can be used to…

Computer Vision and Pattern Recognition · Computer Science 2015-09-09 Guosheng Lin , Chunhua Shen , Ian Reid , Anton van den Hengel

Convolutional neural networks have become increasingly deep and complex, leading to higher computational costs. While tropical convolutional neural networks (TCNNs) reduce multiplications, they underperform compared to standard CNNs. To…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Mingbo Li , Liying Liu , Ye Luo

Recent end-to-end Automatic Speech Recognition (ASR) systems demonstrated the ability to outperform conventional hybrid DNN/ HMM ASR. Aside from architectural improvements in those systems, those models grew in terms of depth, parameters…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-06 Ludwig Kürzinger , Dominik Winkelbauer , Lujun Li , Tobias Watzel , Gerhard Rigoll

To extract accurate speaker information for text-independent speaker verification, temporal dynamic CNNs (TDY-CNNs) adapting kernels to each time bin was proposed. However, model size of TDY-CNN is too large and the adaptive kernel's degree…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-28 Seong-Hu Kim , Hyeonuk Nam , Yong-Hwa Park

Emotion recognition from speech signal based on deep learning is an active research area. Convolutional neural networks (CNNs) may be the dominant method in this area. In this paper, we implement two neural architectures to address this…

Computation and Language · Computer Science 2020-11-03 Ahmed Ali , Yasser Hifny

We propose a new method for creating computationally efficient and compact convolutional neural networks (CNNs) using a novel sparse connection structure that resembles a tree root. This allows a significant reduction in computational cost…

Neural and Evolutionary Computing · Computer Science 2020-10-13 Yani Ioannou , Duncan Robertson , Roberto Cipolla , Antonio Criminisi

Convolutional neural network (CNN) models have been widely used for fault diagnosis of complex systems. However, traditional CNN models rely on small kernel filters to obtain local features from images. Thus, an excessively deep CNN is…

Systems and Control · Electrical Eng. & Systems 2022-10-05 Qiugang Lu , Saif S. S. Al-Wahaibi

In this paper, a multilingual end-to-end framework, called as ATCSpeechNet, is proposed to tackle the issue of translating communication speech into human-readable text in air traffic control (ATC) systems. In the proposed framework, we…

Computation and Language · Computer Science 2021-02-18 Yi Lin , Bo Yang , Linchao Li , Dongyue Guo , Jianwei Zhang , Hu Chen , Yi Zhang

In this paper, we propose to use deep 3-dimensional convolutional networks (3D CNNs) in order to address the challenge of modelling spectro-temporal dynamics for speech emotion recognition (SER). Compared to a hybrid of Convolutional Neural…

Computation and Language · Computer Science 2017-08-18 Jaebok Kim , Khiet P. Truong , Gwenn Englebienne , Vanessa Evers

End-to-end automatic speech recognition systems have achieved great accuracy by using deeper and deeper models. However, the increased depth comes with a larger receptive field that can negatively impact model performance in streaming…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-23 Aleksei Kalinov , Somshubra Majumdar , Jagadeesh Balam , Boris Ginsburg

With the increasing popularity of deep learning, Convolutional Neural Networks (CNNs) have been widely applied in various domains, such as image classification and object detection, and achieve stunning success in terms of their high…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Yuke Wang , Boyuan Feng , Xueqiao Peng , Yufei Ding

The front-end module in multi-channel automatic speech recognition (ASR) systems mainly use microphone array techniques to produce enhanced signals in noisy conditions with reverberation and echos. Recently, neural network (NN) based…

Sound · Computer Science 2020-11-19 Yuxiang Kong , Jian Wu , Quandong Wang , Peng Gao , Weiji Zhuang , Yujun Wang , Lei Xie

Recently, deep learning-based Text-to-Speech (TTS) systems have achieved high-quality speech synthesis results. Recurrent neural networks have become a standard modeling technique for sequential data in TTS systems and are widely used.…

Sound · Computer Science 2024-03-19 Ziqi Liang , Haoxiang Shi , Jiawei Wang , Keda Lu

The use of Convolutional Neural Networks (CNNs) is widespread in Deep Learning due to a range of desirable model properties which result in an efficient and effective machine learning framework. However, performant CNN architectures must be…

We present an efficient deep learning approach for the challenging task of tumor segmentation in multisequence MR images. In recent years, Convolutional Neural Networks (CNN) have achieved state-of-the-art performances in a large variety of…

Computer Vision and Pattern Recognition · Computer Science 2018-07-24 Pawel Mlynarski , Hervé Delingette , Antonio Criminisi , Nicholas Ayache

The performance of automatic speech recognition (ASR) has improved tremendously due to the application of deep neural networks (DNNs). Despite this progress, building a new ASR system remains a challenging task, requiring various resources,…

Computation and Language · Computer Science 2015-10-20 Yajie Miao , Mohammad Gowayyed , Florian Metze

Speech codecs learn compact representations of speech signals to facilitate data transmission. Many recent deep neural network (DNN) based end-to-end speech codecs achieve low bitrates and high perceptual quality at the cost of model…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-11 Kai Zhen , Jongmo Sung , Mi Suk Lee , Seungkwon Beack , Minje Kim

The recent developments in technology have re-warded us with amazing audio synthesis models like TACOTRON and WAVENETS. On the other side, it poses greater threats such as speech clones and deep fakes, that may go undetected. To tackle…

Machine Learning · Computer Science 2021-07-27 Arun Kumar Singh , Priyanka Singh , Karan Nathwani

Convolutional Neural Network (CNN) struggle to capture the multi-dimensional structural information of complex high-dimensional data, which limits their feature learning capability. This paper proposes a feature fusion method based on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yang Han , Qin Guangjun , Liu Ziyuan , Hu Yongqing , Liu Guangnan , Dai Qinglong

In this work, we propose Tiny-CRNN (Tiny Convolutional Recurrent Neural Network) models applied to the problem of wakeword detection, and augment them with scaled dot product attention. We find that, compared to Convolutional Neural Network…

Machine Learning · Computer Science 2021-10-01 Mohammad Omar Khursheed , Christin Jose , Rajath Kumar , Gengshen Fu , Brian Kulis , Santosh Kumar Cheekatmalla