English
Related papers

Related papers: Sequential Neural Probabilistic Amplitude Shaping:…

200 papers

This paper proposes APSS, a novel neural speech separation model with parallel amplitude and phase spectrum estimation. Unlike most existing speech separation methods, the APSS distinguishes itself by explicitly estimating the phase…

Sound · Computer Science 2025-09-18 Fei Liu , Yang Ai , Zhen-Hua Ling

This paper presents a method of sequence-to-sequence (seq2seq) voice conversion using non-parallel training data. In this method, disentangled linguistic and speaker representations are extracted from acoustic features, and voice conversion…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-14 Jing-Xuan Zhang , Zhen-Hua Ling , Li-Rong Dai

We propose a novel neural sequence prediction method based on \textit{error-correcting output codes} that avoids exact softmax normalization and allows for a tradeoff between speed and performance. Instead of minimizing measures between the…

Machine Learning · Computer Science 2019-09-06 James O' Neill , Danushka Bollegala

The choice of constellations largely affects the performance of communication systems. When designing constellations, both the locations and probability of occurrence of the points can be optimized. These approaches are referred to as…

Information Theory · Computer Science 2019-08-30 Maximilian Stark , Fayçal Ait Aoudia , Jakob Hoydis

Graph representation learning has become a hot research topic due to its powerful nonlinear fitting capability in extracting representative node embeddings. However, for sequential data such as speech signals, most traditional methods…

Sound · Computer Science 2024-05-08 Yingxue Gao , Huan Zhao , Zixing Zhang

Temporal coding is one approach to representing information in spiking neural networks. An example of its application is the location of sounds by barn owls that requires especially precise temporal coding. Dependent upon the azimuthal…

Neurons and Cognition · Quantitative Biology 2014-01-24 Thomas Pfeil , Anne-Christine Scherzer , Johannes Schemmel , Karlheinz Meier

In this paper, we propose a sequential neural encoder with latent structured description (SNELSD) for modeling sentences. This model introduces latent chunk-level representations into conventional sequential neural encoders, i.e., recurrent…

Computation and Language · Computer Science 2017-11-16 Yu-Ping Ruan , Qian Chen , Zhen-Hua Ling

We propose the first practical learned lossless image compression system, L3C, and show that it outperforms the popular engineered codecs, PNG, WebP and JPEG 2000. At the core of our method is a fully parallelizable hierarchical…

Image and Video Processing · Electrical Eng. & Systems 2020-03-09 Fabian Mentzer , Eirikur Agustsson , Michael Tschannen , Radu Timofte , Luc Van Gool

Acoustic-to-Word recognition provides a straightforward solution to end-to-end speech recognition without needing external decoding, language model re-scoring or lexicon. While character-based models offer a natural solution to the…

Audio and Speech Processing · Electrical Eng. & Systems 2018-08-22 Shruti Palaskar , Florian Metze

We introduce a practical sign-dependent sequence selection metric for probabilistic amplitude shaping and propose a simple method to predict the gains in signal-to-noise ratio (SNR) for sequence selection. The proposed metric provides a…

Signal Processing · Electrical Eng. & Systems 2024-07-15 Mohammad Taha Askari , Lutz Lampe

Artificial intelligence (AI) provides an alternative way to design channel coding with affordable complexity. However, most existing studies can only learn codes for a given size and rate, typically defined by a fixed network architecture…

Signal Processing · Electrical Eng. & Systems 2024-11-28 Yukun Cheng , Wei Chen , Tianwei Hou , Geoffrey Ye Li , Bo Ai

We apply the latest advances in machine learning with deep neural networks to the tasks of radio modulation recognition, channel coding recognition, and spectrum monitoring. This paper first proposes an identification algorithm for…

Information Theory · Computer Science 2020-02-13 Wenjun Yan , Qing Ling , Limin Zhang

Can we effectively learn a nonlinear representation in time comparable to linear learning? We describe a new algorithm that explicitly and adaptively expands higher-order interaction features over base linear representations. The algorithm…

Machine Learning · Computer Science 2014-10-03 Alekh Agarwal , Alina Beygelzimer , Daniel Hsu , John Langford , Matus Telgarsky

Error correction codes are a crucial part of the physical communication layer, ensuring the reliable transfer of data over noisy channels. The design of optimal linear block codes capable of being efficiently decoded is of major concern,…

Information Theory · Computer Science 2024-05-08 Yoni Choukroun , Lior Wolf

An unsupervised learning approach based on expectation maximization is proposed to obtain the parameters of a soft decision forward error correction decoding metric for probabilistic shaping. The algorithm depends only on the channel…

Information Theory · Computer Science 2018-06-27 Fabian Steiner , Patrick Schulte , Georg Böcherer

Probabilistic circuits (PCs) are powerful probabilistic models that enable exact and tractable inference, making them highly suitable for probabilistic reasoning and inference tasks. While dominant in neural networks, representation…

Machine Learning · Computer Science 2025-07-29 Steven Braun , Sahil Sidheekh , Antonio Vergari , Martin Mundt , Sriraam Natarajan , Kristian Kersting

Sequence-to-sequence models have achieved impressive results on various tasks. However, they are unsuitable for tasks that require incremental predictions to be made as more data arrives or tasks that have long input sequences and output…

Machine Learning · Computer Science 2016-08-08 Navdeep Jaitly , David Sussillo , Quoc V. Le , Oriol Vinyals , Ilya Sutskever , Samy Bengio

This short paper describes a simple coding technique, Sparse Sequential Dirichlet Coding, for multi-alphabet memoryless sources. It is appropriate in situations where only a small, unknown subset of the possible alphabet symbols can be…

Information Theory · Computer Science 2012-06-19 Joel Veness , Marcus Hutter

We propose a probabilistic shaping approach for region-of-interest signaling, where a low-rate signal controls the desired probabilistic ranges of a high-rate data stream using a flexible distribution controller. In addition, we introduce…

Signal Processing · Electrical Eng. & Systems 2022-09-05 Duc-Phuc Nguyen , Yoshifumi Shiraki , Jun Muramatsu , Takehiro Moriya

Real-time decoding of target variables from multiple simultaneously recorded neural time-series modalities, such as discrete spiking activity and continuous field potentials, is important across various neuroscience applications. However, a…

Machine Learning · Computer Science 2025-12-16 Eray Erturk , Maryam M. Shanechi