English
Related papers

Related papers: Density Evolution Analysis of Node-Based Verificat…

200 papers

Static word embeddings are ubiquitous in computational social science applications and contribute to practical decision-making in a variety of fields including law and healthcare. However, assessing the statistical uncertainty in downstream…

Computation and Language · Computer Science 2024-06-19 Andrea Vallebueno , Cassandra Handan-Nader , Christopher D. Manning , Daniel E. Ho

In this work, we study the problem of reconstructing a sparse signal from a limited number of linear 'incoherent' noisy measurements, when a part of its support is known. The known part of the support may be available from prior knowledge…

Information Theory · Computer Science 2009-10-12 Wei Lu , Namrata Vaswani

We perform differential expression analysis of high-throughput sequencing count data under a Bayesian nonparametric framework, removing sophisticated ad-hoc pre-processing steps commonly required in existing algorithms. We propose to use…

Applications · Statistics 2017-05-04 Siamak Zamani Dadaneh , Xiaoning Qian , Mingyuan Zhou

Modern neural networks tend to be overconfident on unseen, noisy or incorrectly labelled data and do not produce meaningful uncertainty measures. Bayesian deep learning aims to address this shortcoming with variational approximations (such…

Machine Learning · Statistics 2018-05-28 Nick Pawlowski , Andrew Brock , Matthew C. H. Lee , Martin Rajchl , Ben Glocker

Symbolic regression searches for analytic expressions that accurately describe studied phenomena. The main attraction of this approach is that it returns an interpretable model that can be insightful to users. Historically, the majority of…

The extraction of geoelectric structural information from airborne transient electromagnetic(ATEM)data primarily involves data processing and inversion. Conventional methods rely on empirical parameter selection, making it difficult to…

Machine Learning · Computer Science 2025-03-31 Shuang Wang , Xuben Wang , Fei Deng , Xiaodong Yu , Peifan Jiang , Lifeng Mao

Non-negative signals form an important class of sparse signals. Many algorithms have already beenproposed to recover such non-negative representations, where greedy and convex relaxed algorithms are among the most popular methods. One fast…

Signal Processing · Electrical Eng. & Systems 2020-06-09 Konstantinos Voulgaris , Mike E. Davies , Mehrdad Yaghoobi

Compressive sensing is a methodology for the reconstruction of sparse or compressible signals using far fewer samples than required by the Nyquist criterion. However, many of the results in compressive sensing concern random sampling…

Information Theory · Computer Science 2013-06-11 Atul Divekar , Deanna Needell

Anomaly detection tools and methods enable key analytical capabilities in modern cyberphysical and sensor-based systems. Despite the fast-paced development in deep learning architectures for anomaly detection, model optimization for a given…

Neural and Evolutionary Computing · Computer Science 2024-04-12 Marcin Pietroń , Dominik Żurek , Kamil Faber , Roberto Corizzo

This paper studies the problem of recursively estimating the weighted adjacency matrix of a network out of a temporal sequence of binary-valued observations. The observation sequence is generated from nonlinear networked dynamics in which…

Systems and Control · Electrical Eng. & Systems 2019-12-06 Yu Xing , Xingkang He , Haitao Fang , Karl Henrik Johansson

In this article we perform an asymptotic analysis of parallel Bayesian logspline density estimators. Such estimators are useful for the analysis of datasets that are partitioned into subsets and stored in separate databases without the…

Statistics Theory · Mathematics 2023-07-18 Konstandinos Kotsiopoulos , Alexey Miroshnikov , Erin Conlon

Most real-world problems that machine learning algorithms are expected to solve face the situation with 1) unknown data distribution; 2) little domain-specific knowledge; and 3) datasets with limited annotation. We propose Non-Parametric…

Machine Learning · Computer Science 2022-09-20 Zhiying Jiang , Yiqin Dai , Ji Xin , Ming Li , Jimmy Lin

We present a method for feature interpretation that makes use of recent advances in autoregressive density estimation models to invert model representations. We train generative inversion models to express a distribution over input features…

Machine Learning · Statistics 2019-01-03 Charlie Nash , Nate Kushman , Christopher K. I. Williams

This manuscript goes through the fundamental connections between statistical mechanics and estimation theory by focusing on the particular problem of compressive sensing. We first show that the asymptotic analysis of a sparse recovery…

Information Theory · Computer Science 2022-12-21 Ali Bereyhi , Ralf R. Müller , Hermann Schulz-Baldes

In scientific machine learning, the task of identifying partial differential equations accurately from sparse and noisy data poses a significant challenge. Current sparse regression methods may identify inaccurate equations on sparse and…

Machine Learning · Computer Science 2025-04-08 Su Chen , Yi Ding , Hiroe Miyake , Xiaojun Li

Word vector embeddings have been shown to contain and amplify biases in data they are extracted from. Consequently, many techniques have been proposed to identify, mitigate, and attenuate these biases in word representations. In this paper,…

Computation and Language · Computer Science 2021-04-08 Archit Rathore , Sunipa Dev , Jeff M. Phillips , Vivek Srikumar , Yan Zheng , Chin-Chia Michael Yeh , Junpeng Wang , Wei Zhang , Bei Wang

We study aleatoric and epistemic uncertainty estimation in a learned regressive system dynamics model. Disentangling aleatoric uncertainty (the inherent randomness of the system) from epistemic uncertainty (the lack of data) is crucial for…

Machine Learning · Computer Science 2025-03-21 Zhiyu An , Zhibo Hou , Wan Du

The decoding of Low-Density Parity-Check codes by the Belief Propagation (BP) algorithm is revisited. We check the iterative algorithm for its convergence to a codeword (termination), we run Monte Carlo simulations to find the probability…

Information Theory · Computer Science 2007-07-13 M. G. Stepanov , M. Chertkov

Scientific machine learning has been successfully applied to inverse problems and PDE discovery in computational physics. One caveat concerning current methods is the need for large amounts of ("clean") data, in order to characterize the…

Numerical Analysis · Mathematics 2021-11-30 Christophe Bonneville , Christopher J. Earls

Recovery of the sparsity pattern (or support) of an unknown sparse vector from a limited number of noisy linear measurements is an important problem in compressed sensing. In the high-dimensional setting, it is known that recovery with a…

Information Theory · Computer Science 2012-06-26 Galen Reeves , Michael Gastpar