English
Related papers

Related papers: Discontinuous phase transition of feature detectio…

200 papers

We consider the problem of transmitting correlated data after independent encoding to a central receiver through orthogonal channels. We assume that the channel state information is not known at the transmitter. The receiver has access to…

Information Theory · Computer Science 2010-07-07 Arvind Yedla , Henry D. Pfister , Krishna R. Narayanan

In this work, we explore the interplay between information and computation in non-linear transform-based compression for broad classes of modern information-processing tasks. We first investigate two emerging nonlinear data transformation…

Information Theory · Computer Science 2025-06-23 Connor Ding , Abhiram Rao Gorle , Jiwon Jeong , Naomi Sagan , Tsachy Weissman

Biological synaptic transmission is unreliable, and this unreliability likely degrades neural circuit performance. While there are biophysical mechanisms that can increase reliability, for instance by increasing vesicle release probability,…

Neurons and Cognition · Quantitative Biology 2024-07-02 James Malkin , Cian O'Donnell , Conor Houghton , Laurence Aitchison

In fact, the broadcast nature of every transmitter makes it possible for other transceivers in the channel to overhear the broadcasted signal. The proposed idea in cooperative communication is to use these intermediate transceivers as relay…

Signal Processing · Electrical Eng. & Systems 2024-09-25 Ali Mehrban

Independent component analysis (ICA) is popular in many applications, including cognitive neuroscience and signal processing. Due to computational constraints, principal component analysis is used for dimension reduction prior to ICA…

Methodology · Statistics 2017-10-03 Benjamin B. Risk , David S. Matteson , David Ruppert

In the Minimum Description Length (MDL) principle, learning from the data is equivalent to an optimal coding problem. We show that the codes that achieve optimal compression in MDL are critical in a very precise sense. First, when they are…

Methodology · Statistics 2018-10-03 Ryan John Cubero , Matteo Marsili , Yasser Roudi

Individual components such as cells, particles, or agents within a larger system often require detailed understanding of their relative position to act accordingly, enabling the system as a whole to function in an organised and efficient…

Statistical Mechanics · Physics 2025-02-28 Jonas Berx , Prashant Singh , Karel Proesmans

Recently, a parallel decoding framework of $G_N$-coset codes was proposed. High throughput is achieved by decoding the independent component polar codes in parallel. Various algorithms can be employed to decode these component codes,…

Information Theory · Computer Science 2020-04-22 Xianbin Wang , Jiajie Tong , Huazi Zhang , Shengchen Dai , Rong Li , Jun Wang

Continuous-variable quantum key distribution utilizes an ensemble of coherent states of light to distribute secret encryption keys between two parties. One of the challenges is thereby the requirement of capacity approaching error…

Information Theory · Computer Science 2021-06-30 Hossein Mani , Tobias Gehring , Christoph Pacher , Ulrik Lund Andersen

Departing from traditional communication theory where decoding algorithms are assumed to perform without error, a system where noise perturbs both computational devices and communication channels is considered here. This paper studies…

Information Theory · Computer Science 2010-05-31 Lav R. Varshney

We generalize the low-rank decomposition problem, such as principal and independent component analysis (PCA, ICA) for continuous-time vector-valued signals and provide a model-agnostic implicit neural signal representation framework to…

Machine Learning · Computer Science 2025-07-15 Shayan K. Azmoodeh , Krishna Subramani , Paris Smaragdis

We present three related ways of using Transfer Learning to improve feature selection. The three methods address different problems, and hence share different kinds of information between tasks or feature classes, but all three are based on…

Machine Learning · Computer Science 2009-05-26 Paramveer S. Dhillon , Dean Foster , Lyle Ungar

Discrete-time domain Iterative Learning Control (ILC) schemes inspired by Repetitive control algorithms are proposed and analyzed. The well known relation between a discrete-time plant (filter) and its Markov Toeplitz matrix representation…

Optimization and Control · Mathematics 2014-08-12 K. Krishnamoorthy , Tsu-Chin Tsao

This paper presents a distributed learning model predictive control (DLMPC) scheme for distributed linear time invariant systems with coupled dynamics and state constraints. The proposed solution method is based on an online distributed…

Systems and Control · Electrical Eng. & Systems 2020-06-25 Yvonne R. Stürz , Edward L. Zhu , Ugo Rosolia , Karl H. Johansson , Francesco Borrelli

A low-density parity-check (LDPC) code is a linear block code described by a sparse parity-check matrix, which can be efficiently represented by a bipartite Tanner graph. The standard iterative decoding algorithm, known as belief…

Information Theory · Computer Science 2016-05-17 Sachini Jayasooriya , Sarah J. Johnson , Lawrence Ong , Regina Berretta

In this paper we present a thorough analysis of non binary LDPC codes over the binary erasure channel. First, the decoding of non binary LDPC codes is investigated. The proposed algorithm performs on-the-fly decoding, i.e. it starts…

Information Theory · Computer Science 2008-10-27 Valentin Savin

Undirected graphical models are widely used in statistics, physics and machine vision. However Bayesian parameter estimation for undirected models is extremely challenging, since evaluation of the posterior typically involves the…

Computation · Statistics 2012-03-19 Richard G. Everitt

The identification of distribution network topology and parameters is a critical problem that lays the foundation for improving network efficiency, enhancing reliability, and increasing its capacity to host distributed energy resources.…

Systems and Control · Electrical Eng. & Systems 2023-08-23 Ognjen Stanojev , Lucien Werner , Steven Low , Gabriela Hug

Spectral methods have been the mainstay in several domains such as machine learning and scientific computing. They involve finding a certain kind of spectral decomposition to obtain basis functions that can capture important structures for…

Machine Learning · Computer Science 2020-04-20 Majid Janzamin , Rong Ge , Jean Kossaifi , Anima Anandkumar

Suppose we observe data of the form $Y_i = D_i (S_i + \varepsilon_i) \in \mathbb{R}^p$ or $Y_i = D_i S_i + \varepsilon_i \in \mathbb{R}^p$, $i=1,\ldots,n$, where $D_i \in \mathbb{R}^{p\times p}$ are known diagonal matrices, $\varepsilon_i$…

Statistics Theory · Mathematics 2018-11-05 Edgar Dobriban , William Leeb , Amit Singer