English
Related papers

Related papers: Recovering Sparse Neural Connectivity from Partial…

200 papers

Recovering jointly sparse signals in the multiple measurement vectors (MMV) setting is a fundamental problem in machine learning, but traditional methods often require careful parameter tuning or prior knowledge of the sparsity of the…

Machine Learning · Computer Science 2026-02-02 Lakshmi Jayalal , Sheetal Kalyani

Flat regions of the neural network loss landscape have long been hypothesized to correlate with better generalization properties. A closely related but distinct problem is training models that are robust to internal perturbations to their…

Machine Learning · Computer Science 2026-02-10 Philip Jacobson , Ben Feinberg , Suhas Kumar , Sapan Agarwal , T. Patrick Xiao , Christopher Bennett

There is a great need for robust techniques in data mining and machine learning contexts where many standard techniques such as principal component analysis and linear discriminant analysis are inherently susceptible to outliers.…

Methodology · Statistics 2015-09-28 Garth Tarr , Samuel Müller , Neville C. Weber

To gain insight into complex systems it is a key challenge to infer nonlinear causal directional relations from observational time-series data. Specifically, estimating causal relationships between interacting components in large systems…

Machine Learning · Computer Science 2021-11-04 Axel Wismüller , Adora M. DSouza , Anas Z. Abidin

This paper presents a Bayesian reformulation of covariate-assisted principal (CAP) regression of Zhao and others (2021), which aims to identify components in the covariance of response signal that are associated with covariates in a…

Methodology · Statistics 2024-08-30 Hyung G. Park

Sensory perception originates from the responses of sensory neurons, which react to a collection of sensory signals linked to various physical attributes of a singular perceptual object. Unraveling how the brain extracts perceptual…

Neurons and Cognition · Quantitative Biology 2025-10-27 Zhichao Zhu , Yang Qi , Wenlian Lu , Jianfeng Feng

This paper addresses the task of estimating a covariance matrix under a patternless sparsity assumption. In contrast to existing approaches based on thresholding or shrinkage penalties, we propose a likelihood-based method that regularizes…

Methodology · Statistics 2021-09-13 Jason Xu , Kenneth Lange

In multivariate statistics, the question of finding direct interactions can be formulated as a problem of network inference - or network reconstruction - for which the Gaussian graphical model (GGM) provides a canonical framework.…

Methodology · Statistics 2018-06-11 Julien Chiquet , Mahendra Mariadassou , Stéphane Robin

This article proposes a systematic methodological review and objective criticism of existing methods enabling the derivation of time-varying Granger-causality statistics in neuroscience. The increasing interest and the huge number of…

Applications · Statistics 2017-04-12 Sezen Cekic , Didier Grandjean , Olivier Renaud

Randomized experiments are a crucial tool for causal inference in many different fields. Rerandomization addresses any covariate imbalance in such experiments by resampling treatment assignments until certain balance criteria are satisfied.…

Methodology · Statistics 2025-05-27 Jiuyao Lu , Daogao Liu , Zhanran Lin , Xiaomeng Wang

We investigate the high-dimensional linear regression problem in the presence of noise correlated with Gaussian covariates. This correlation, known as endogeneity in regression models, often arises from unobserved variables and other…

Statistics Theory · Mathematics 2023-10-23 Toshiki Tsuda , Masaaki Imaizumi

We study the problem of estimating from data, a sparse approximation to the inverse covariance matrix. Estimating a sparsity constrained inverse covariance matrix is a key component in Gaussian graphical model learning, but one that is…

Machine Learning · Statistics 2011-06-28 Suvrit Sra , Dongmin Kim

We derive a method to reconstruct Gaussian signals from linear measurements with Gaussian noise. This new algorithm is intended for applications in astrophysics and other sciences. The starting point of our considerations is the principle…

Instrumentation and Methods for Astrophysics · Physics 2011-10-18 Niels Oppermann , Georg Robbers , Torsten A. Ensslin

The discontinuous operations inherent in quantization and sparsification introduce a long-standing obstacle to backpropagation, particularly in ultra-low precision and sparse regimes. While the community has long viewed quantization as…

Machine Learning · Computer Science 2026-03-11 Chengxi Ye , Grace Chu , Yanfeng Liu , Yichi Zhang , Lukasz Lew , Li Zhang , Mark Sandler , Andrew Howard

We present a loss function for neural networks that encompasses an idea of trivial versus non-trivial predictions, such that the network jointly determines its own prediction goals and learns to satisfy them. This permits the network to…

Artificial Intelligence · Computer Science 2016-12-15 Nicholas Guttenberg , Martin Biehl , Ryota Kanai

We propose a method to reconstruct sparse signals degraded by a nonlinear distortion and acquired at a limited sampling rate. Our method formulates the reconstruction problem as a nonconvex minimization of the sum of a data fitting term and…

Optimization and Control · Mathematics 2023-01-19 Arthur Marmin , Marc Castella , Jean-Christophe Pesquet , Laurent Duval

We propose and study a regularization method for recovering an approximate electrical conductivity solely from the magnitude of one interior current density field. Without some minimal knowledge of the boundary voltage potential, the…

Analysis of PDEs · Mathematics 2019-03-27 Alexandru Tamasan , Alexander Timonov

Convolutional neural networks (CNNs) are reported to be overparametrized. The search for optimal (minimal) and sufficient architecture is an NP-hard problem as the hyperparameter space for possible network configurations is vast. Here, we…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Tin Barisin , Illia Horenko

Efficient estimation of wideband spectrum is of great importance for applications such as cognitive radio. Recently, sub-Nyquist sampling schemes based on compressed sensing have been proposed to greatly reduce the sampling rate. However,…

Signal Processing · Electrical Eng. & Systems 2018-05-23 Haoyu Fu , Yuejie Chi

We propose a flexible yet interpretable model for high-dimensional data with time-varying second order statistics, motivated and applied to functional neuroimaging data. Motivated by the neuroscience literature, we factorize the covariances…

Machine Learning · Statistics 2021-07-20 Katherine Tsai , Mladen Kolar , Oluwasanmi Koyejo