English
Related papers

Related papers: MatchboxNet: 1D Time-Channel Separable Convolution…

200 papers

We present a novel neural network for processing sequences. The ByteNet is a one-dimensional convolutional neural network that is composed of two parts, one to encode the source sequence and the other to decode the target sequence. The two…

Computation and Language · Computer Science 2017-03-17 Nal Kalchbrenner , Lasse Espeholt , Karen Simonyan , Aaron van den Oord , Alex Graves , Koray Kavukcuoglu

In this paper we propose the Structured Deep Neural Network (structured DNN) as a structured and deep learning framework. This approach can learn to find the best structured object (such as a label sequence) given a structured input (such…

Computation and Language · Computer Science 2015-11-10 Yi-Hsiu Liao , Hung-yi Lee , Lin-shan Lee

Despite the fact that neural networks are widely used for speech-driven head motion synthesis, it is well-known that the output of neural networks is noisy or discontinuous due to the limited capability of deep neural networks in predicting…

Signal Processing · Electrical Eng. & Systems 2019-07-26 JinHong Lu , Hiroshi Shimodaira

Semantic segmentation and change detection are two fundamental challenges in remote sensing, requiring models to capture either spatial semantics or temporal differences from satellite imagery. Existing deep learning models often struggle…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Ali Shibli , Andrea Nascetti , Yifang Ban

Balancing predictive power and interpretability has long been a challenging research area, particularly in powerful yet complex models like neural networks, where nonlinearity obstructs direct interpretation. This paper introduces a novel…

Machine Learning · Computer Science 2025-02-20 Antoine Ledent , Peng Liu

Neural audio codecs, used as speech tokenizers, have demonstrated remarkable potential in the field of speech generation. However, to ensure high-fidelity audio reconstruction, neural audio codecs typically encode audio into long sequences…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-02 Wenrui Liu , Qian Chen , Wen Wang , Yafeng Chen , Jin Xu , Zhifang Guo , Guanrou Yang , Weiqin Li , Xiaoda Yang , Tao Jin , Minghui Fang , Jialong Zuo , Bai Jionghao , Zemin Liu

Semantic Segmentation is a crucial component in the perception systems of many applications, such as robotics and autonomous driving that rely on accurate environmental perception and understanding. In literature, several approaches are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Ran Cheng , Ryan Razani , Yuan Ren , Liu Bingbing

Speech enhancement in multichannel settings has been realized by utilizing the spatial information embedded in multiple microphone signals. Moreover, deep neural networks (DNNs) have been recently advanced in this field; however, studies on…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-28 Dongheon Lee , Seongrae Kim , Jung-Woo Choi

State-of-the-art performance for many edge applications is achieved by deep neural networks (DNNs). Often, these DNNs are location- and time-sensitive, and must be delivered over a wireless channel rapidly and efficiently. In this paper, we…

Networking and Internet Architecture · Computer Science 2023-07-21 Mikolaj Jankowski , Deniz Gunduz , Krystian Mikolajczyk

This paper describes a novel method of live keyword spotting using a two-stage time delay neural network. The model is trained using transfer learning: initial training with phone targets from a large speech corpus is followed by training…

Audio and Speech Processing · Electrical Eng. & Systems 2018-08-29 Samuel Myer , Vikrant Singh Tomar

We address monaural multi-speaker-image separation in reverberant conditions, aiming at separating mixed speakers but preserving the reverberation of each speaker. A straightforward approach for this task is to directly train end-to-end DNN…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-08 Jingqi Sun , Shulin He , Ruizhe Pang , Zhong-Qiu Wang

In this paper, we investigate a deep learning approach for speech denoising through an efficient ensemble of specialist neural networks. By splitting up the speech denoising task into non-overlapping subproblems and introducing a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-11 Aswin Sivaraman , Minje Kim

Deep learning approaches to 3D shape segmentation are typically formulated as a multi-class labeling problem. Existing models are trained for a fixed set of labels, which greatly limits their flexibility and adaptivity. We opt for top-down…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Fenggen Yu , Kun Liu , Yan Zhang , Chenyang Zhu , Kai Xu

Recently, a massive number of deep learning based approaches have been successfully applied to various remote sensing image (RSI) recognition tasks. However, most existing advances of deep learning methods in the RSI field heavily rely on…

Image and Video Processing · Electrical Eng. & Systems 2021-12-08 Cheng Peng , Yangyang Li , Ronghua Shang , Licheng Jiao

PET-CT lesion segmentation is challenging due to noise sensitivity, small and variable lesion morphology, and interference from physiological high-metabolic signals. Current mainstream approaches follow the practice of one network solving…

Image and Video Processing · Electrical Eng. & Systems 2025-07-11 Xinglong Liang , Jiaju Huang , Luyi Han , Tianyu Zhang , Xin Wang , Yuan Gao , Chunyao Lu , Lishan Cai , Tao Tan , Ritse Mann

Segmental models are an alternative to frame-based models for sequence prediction, where hypothesized path weights are based on entire segment scores rather than a single frame at a time. Neural segmental models are segmental models that…

Computation and Language · Computer Science 2018-02-14 Hao Tang , Liang Lu , Lingpeng Kong , Kevin Gimpel , Karen Livescu , Chris Dyer , Noah A. Smith , Steve Renals

Convolution Neural Networks (CNN) have performed well in many applications such as object detection, pattern recognition, video surveillance and so on. CNN carryout feature extraction on labelled data to perform classification. Multi-label…

Machine Learning · Computer Science 2021-01-28 Tolulope A. Odetola , Ogheneuriri Oderhohwo , Syed Rafay Hasan

Multi-frame algorithms for single-channel speech enhancement are able to take advantage from short-time correlations within the speech signal. Deep Filtering (DF) was proposed to directly estimate a complex filter in frequency domain to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-16 Hendrik Schröter , Tobias Rosenkranz , Alberto N. Escalante-B. , Andreas Maier

Recently, there has been growing interest in multi-speaker speech recognition, where the utterances of multiple speakers are recognized from their mixture. Promising techniques have been proposed for this task, but earlier works have…

Sound · Computer Science 2018-05-16 Hiroshi Seki , Takaaki Hori , Shinji Watanabe , Jonathan Le Roux , John R. Hershey

We present a method to perform first-pass large vocabulary continuous speech recognition using only a neural network and language model. Deep neural network acoustic models are now commonplace in HMM-based speech recognition systems, but…

Computation and Language · Computer Science 2014-12-09 Awni Y. Hannun , Andrew L. Maas , Daniel Jurafsky , Andrew Y. Ng