English
Related papers

Related papers: Hybrid Real- And Complex-Valued Neural Network Con…

200 papers

Neuromorphic (brain-inspired) photonics leverages photonic chips to accelerate artificial intelligence, offering high-speed and energy efficient solutions in RF communication, tensor processing, and data classification. However, the limited…

Quantum Physics · Physics 2024-07-16 Tristan Austin , Simon Bilodeau , Andrew Hayman , Nir Rotenberg , Bhavin Shastri

Nearly all previous work on neural machine translation (NMT) has used quite restricted vocabularies, perhaps with a subsequent method to patch in unknown words. This paper presents a novel word-character solution to achieving open…

Computation and Language · Computer Science 2016-06-24 Minh-Thang Luong , Christopher D. Manning

Complicated and deep neural network models can achieve high accuracy for image recognition. However, they require a huge amount of computations and model parameters, which are not suitable for mobile and embedded devices. Therefore,…

Computer Vision and Pattern Recognition · Computer Science 2019-06-14 Hong-Yen Chen , Chung-Yen Su

FullSubNet is our recently proposed real-time single-channel speech enhancement network that achieves outstanding performance on the Deep Noise Suppression (DNS) Challenge dataset. A number of variants of FullSubNet have been proposed, but…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-08 Xiang Hao , Xiaofei Li

Reconstructing the room transfer functions needed to calculate the complex sound field in a room has several important real-world applications. However, an unpractical number of microphones is often required. Recently, in addition to…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-12 Francesca Ronchini , Luca Comanducci , Mirco Pezzoli , Fabio Antonacci , Augusto Sarti

Deep neural networks have proven to be particularly effective in visual and audio recognition tasks. Existing models tend to be computationally expensive and memory intensive, however, and so methods for hardware-oriented approximation have…

Computer Vision and Pattern Recognition · Computer Science 2019-07-09 Erwei Wang , James J. Davis , Ruizhe Zhao , Ho-Cheung Ng , Xinyu Niu , Wayne Luk , Peter Y. K. Cheung , George A. Constantinides

Quality and intelligibility of speech signals are degraded under additive background noise which is a critical problem for hearing aid and cochlear implant users. Motivated to address this problem, we propose a novel speech enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-06 Hamidreza Baradaran Kashani , Ata Jodeiri , Mohammad Mohsen Goodarzi , Iman Sarraf Rezaei

Memory-augmented neural networks enhance a neural network with an external key-value memory whose complexity is typically dominated by the number of support vectors in the key memory. We propose a generalized key-value memory that decouples…

Machine Learning · Computer Science 2022-05-18 Denis Kleyko , Geethan Karunaratne , Jan M. Rabaey , Abu Sebastian , Abbas Rahimi

We develop hybrid memory architectures for general-purpose sequence processing neural networks, that combine key-value memory using softmax attention (KV-memory) with fast weight memory through dynamic synaptic modulation (FW-memory) -- the…

Machine Learning · Computer Science 2025-10-24 Kazuki Irie , Morris Yau , Samuel J. Gershman

In hearing aids, the presence of babble noise degrades hearing intelligibility of human speech greatly. However, removing the babble without creating artifacts in human speech is a challenging task in a low SNR environment. Here, we sought…

Machine Learning · Computer Science 2016-09-23 Se Rim Park , Jinwon Lee

This research explores a hybrid approach to fine-tuning large language models (LLMs) by integrating real-world and synthetic data to boost model performance, particularly in generating accurate and contextually relevant responses. By…

Computation and Language · Computer Science 2024-10-15 Alexey Zhezherau , Alexei Yanockin

Recurrent neural networks have been widely used in sequence learning tasks. In previous studies, the performance of the model has always been improved by either wider or deeper structures. However, the former becomes more prone to…

Machine Learning · Computer Science 2019-11-20 Yu-Xuan Li , Jin-Yuan Liu , Liang Li , Xiang Guan

Driven by the appealing properties of neural fields for storing and communicating 3D data, the problem of directly processing them to address tasks such as classification and part segmentation has emerged and has been investigated in recent…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Adriano Cardace , Pierluigi Zama Ramirez , Francesco Ballerini , Allan Zhou , Samuele Salti , Luigi Di Stefano

Usually, complex-valued RKHS are presented as an straightforward application of the real-valued case. In this paper we prove that this procedure yields a limited solution for regression. We show that another kernel, here denoted as pseudo…

The research explores the potential of quantum deep learning models to address challenging machine learning problems that classical deep learning models find difficult to tackle. We introduce a novel model architecture that combines…

Machine Learning · Computer Science 2023-12-05 Hao-Yuan Chen , Yen-Jui Chang , Shih-Wei Liao , Ching-Ray Chang

The dialogue management is a task of conversational artificial intelligence. The goal of the dialogue manager is to select the appropriate response to the conversational partner conditioned by the input message and recent dialogue state.…

Computation and Language · Computer Science 2019-07-30 Petr Marek

We present scalable hybrid-parallel algorithms for training large-scale 3D convolutional neural networks. Deep learning-based emerging scientific workflows often require model training with large, high-dimensional samples, which can make…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-28 Yosuke Oyama , Naoya Maruyama , Nikoli Dryden , Erin McCarthy , Peter Harrington , Jan Balewski , Satoshi Matsuoka , Peter Nugent , Brian Van Essen

Neural network based approaches to speech enhancement have shown to be particularly powerful, being able to leverage a data-driven approach to result in a significant performance gain versus other approaches. Such approaches are reliant on…

Sound · Computer Science 2023-12-15 George Close , William Ravenscroft , Thomas Hain , Stefan Goetze

Speech recognition in noisy and channel distorted scenarios is often challenging as the current acoustic modeling schemes are not adaptive to the changes in the signal distribution in the presence of noise. In this work, we develop a novel…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-03 Purvi Agrawal , Sriram Ganapathy

The first artificial quantum neuron models followed a similar path to classic models, as they work only with discrete values. Here we introduce an algorithm that generalizes the binary model manipulating the phase of complex numbers. We…

Quantum Physics · Physics 2025-03-07 Jhordan Silveira de Borba , Jonas Maziero