English
Related papers

Related papers: The OCON model: an old but gold solution for distr…

200 papers

Unsupervised learning has always been appealing to machine learning researchers and practitioners, allowing them to avoid an expensive and complicated process of labeling the data. However, unsupervised learning of complex data is…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Evgenii Zheltonozhskii , Chaim Baskin , Alex M. Bronstein , Avi Mendelson

Single-channel speech enhancement algorithms are often used in resource-constrained embedded devices, where low latency and low complexity designs gain more importance. In recent years, researchers have proposed a wide variety of novel…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-29 Nicolás Arrieta Larraza , Niels de Koeijer

Supervised learning for single-channel speech enhancement requires carefully labeled training examples where the noisy mixture is input into the network and the network is trained to produce an output close to the ideal target. To relax the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-19 Yu-Che Wang , Shrikant Venkataramani , Paris Smaragdis

We consider the two related problems of detecting if an example is misclassified or out-of-distribution. We present a simple baseline that utilizes probabilities from softmax distributions. Correctly classified examples tend to have greater…

Neural and Evolutionary Computing · Computer Science 2018-10-04 Dan Hendrycks , Kevin Gimpel

The purpose of this paper is to present a method for automatic classification of dialogue utterances and the results of applying that method to a corpus. Superficial features of a set of training utterances (which we will call cues) are…

cmp-lg · Computer Science 2008-02-03 Toine Andernach

A comprehensive and high-quality lexicon plays a crucial role in traditional text classification approaches. And it improves the utilization of the linguistic knowledge. Although it is helpful for the task, the lexicon has got little…

Computation and Language · Computer Science 2020-02-19 QingBiao LI , Chunhua Wu , Kangfeng Zheng

Speech fluency/disfluency can be evaluated by analyzing a range of phonetic and prosodic features. Deep neural networks are commonly trained to map fluency-related features into the human scores. However, the effectiveness of deep…

Computation and Language · Computer Science 2023-05-22 Kaiqi Fu , Shaojun Gao , Shuju Shi , Xiaohai Tian , Wei Li , Zejun Ma

Recent neural sequence-to-sequence models with a copy mechanism have achieved remarkable progress in various text generation tasks. These models addressed out-of-vocabulary problems and facilitated the generation of rare words. However, the…

Computation and Language · Computer Science 2021-12-21 Sanghyuk Choi , Jeong-in Hwang , Hyungjong Noh , Yeonsoo Lee

While traditional statistical signal processing model-based methods can derive the optimal estimators relying on specific statistical assumptions, current learning-based methods further promote the performance upper bound via deep neural…

Sound · Computer Science 2022-03-17 Andong Li , Chengshi Zheng , Ziyang Zhang , Xiaodong Li

Self-supervised learning enables the training of large neural models without the need for large, labeled datasets. It has been generating breakthroughs in several fields, including computer vision, natural language processing, biology, and…

Computation and Language · Computer Science 2023-12-19 Luis Lugo , Valentin Vielzeuf

Deep neural networks are a family of computational models that are naturally suited to the analysis of hierarchical data such as, for instance, sequential data with the use of recurrent neural networks. In the other hand, ordinal regression…

Machine Learning · Statistics 2021-01-08 Louis Falissard , Karim Bounebache , Grégoire Rey

As the field of representation learning grows, there has been a proliferation of different loss functions to solve different classes of problems. We introduce a single information-theoretic equation that generalizes a large collection of…

Machine Learning · Computer Science 2025-04-24 Shaden Alshammari , John Hershey , Axel Feldmann , William T. Freeman , Mark Hamilton

Class-imbalanced node classification tasks are prevalent in real-world scenarios. Due to the uneven distribution of nodes across different classes, learning high-quality node representations remains a challenging endeavor. The engineering…

Machine Learning · Computer Science 2024-05-24 Xinyu Guo , Kai Wu , Xiaoyu Zhang , Jing Liu

Developing new machine learning applications often requires the collection of new datasets. However, existing datasets may already contain relevant information to train models for new purposes. We propose SoundCollage: a framework to…

The paper introduces a new efficient nonlinear one-class classifier formulated as the Rayleigh quotient criterion optimisation. The method, operating in a reproducing kernel Hilbert space, minimises the scatter of target distribution along…

Machine Learning · Computer Science 2019-02-12 Shervin Rahimzadeh Arashloo , Josef Kittler

We propose a direct-to-word sequence model which uses a word network to learn word embeddings from letters. The word network can be integrated seamlessly with arbitrary sequence models including Connectionist Temporal Classification and…

Computation and Language · Computer Science 2020-07-16 Ronan Collobert , Awni Hannun , Gabriel Synnaeve

We describe and analyze a simple and effective algorithm for sequence segmentation applied to speech processing tasks. We propose a neural architecture that is composed of two modules trained jointly: a recurrent neural network (RNN) module…

Computation and Language · Computer Science 2016-10-26 Yossi Adi , Joseph Keshet , Emily Cibelli , Matthew Goldrick

Unsupervised Machine Learning techniques have been applied to Natural Language Processing tasks and surpasses the benchmarks such as GLUE with great success. Building language models approach achieves good results in one language and it can…

Computation and Language · Computer Science 2022-11-28 Amir Jafari

Hardware-Software Co-Design is a highly successful strategy for improving performance of domain-specific computing systems. We argue for the application of the same methodology to deep learning; specifically, we propose to extend neural…

Machine Learning · Computer Science 2020-01-10 Andrew Anderson , Jing Su , Rozenn Dahyot , David Gregg

Since Bahdanau et al. [1] first introduced attention for neural machine translation, most sequence-to-sequence models made use of attention mechanisms [2, 3, 4]. While they produce soft-alignment matrices that could be interpreted as…

Computation and Language · Computer Science 2019-09-12 Marcely Zanon Boito , Aline Villavicencio , Laurent Besacier