English
Related papers

Related papers: Maximum Entropy Snapshot Sampling for Reduced Basi…

200 papers

Solving inverse problems in imaging requires models that support efficient inference, uncertainty quantification, and principled probabilistic reasoning. Energy-Based Models (EBMs), with their interpretable energy landscapes and…

Image and Video Processing · Electrical Eng. & Systems 2026-01-07 Jyothi Rikhab Chand , Mathews Jacob

New experimental methods make it possible to measure the expression levels of many genes, simultaneously, in snapshots from thousands or even millions of individual cells. Current approaches to analyze these experiments involve clustering…

Herding is a deterministic algorithm used to generate data points that can be regarded as random samples satisfying input moment conditions. The algorithm is based on the complex behavior of a high-dimensional dynamical system and is…

Machine Learning · Statistics 2023-05-10 Hiroshi Yamashita , Hideyuki Suzuki , Kazuyuki Aihara

The selection of an equilibrium state by maximising the entropy of a system, subject to certain constraints, is often powerfully motivated as an exercise in logical inference, a procedure where conclusions are reached on the basis of…

Statistical Mechanics · Physics 2015-12-03 Ian J. Ford

Whether a system is to be considered complex or not depends on how one searches for correlations. We propose a general scheme for calculation of entropies in lattice systems that has high flexibility in how correlations are successively…

Statistical Mechanics · Physics 2015-06-18 Torbjørn Helvik , Kristian Lindgren

Compressed sensing applied to magnetic resonance imaging (MRI) allows to reduce the scanning time by enabling images to be reconstructed from highly undersampled data. In this paper, we tackle the problem of designing a sampling mask for an…

Image and Video Processing · Electrical Eng. & Systems 2020-03-17 Thomas Sanchez , Baran Gözcü , Ruud B. van Heeswijk , Armin Eftekhari , Efe Ilıcak , Tolga Çukur , Volkan Cevher

We present a selective sampling method designed to accelerate the training of deep neural networks. To this end, we introduce a novel measurement, the minimal margin score (MMS), which measures the minimal amount of displacement an input…

Machine Learning · Computer Science 2019-11-19 Berry Weinstein , Shai Fine , Yacov Hel-Or

We propose a technique called Optimal Analysis-Specific Importance Sampling (OASIS) to reduce the number of simulated events required for a high-energy experimental analysis to reach a target sensitivity. We provide recipes to obtain the…

High Energy Physics - Phenomenology · Physics 2021-02-17 Konstantin T. Matchev , Prasanth Shyamsundar

A new statistical model designed for regression analysis with a sparse design matrix is proposed. This new model utilizes the positions of the limited non-zero elements in the design matrix to decompose the regression model into…

Applications · Statistics 2022-01-17 Hsien-Wei Chen

Hyperspectral imaging is one of the most promising techniques for intraoperative tissue characterisation. Snapshot mosaic cameras, which can capture hyperspectral data in a single exposure, have the potential to make a real-time…

Image and Video Processing · Electrical Eng. & Systems 2021-12-02 Peichao Li , Michael Ebner , Philip Noonan , Conor Horgan , Anisha Bahl , Sebastien Ourselin , Jonathan Shapey , Tom Vercauteren

We introduce Generalized Discrete Diffusion from Snapshots (GDDS), a unified framework for discrete diffusion modeling that supports arbitrary noising processes over large discrete state spaces. Our formulation encompasses all existing…

Machine Learning · Statistics 2026-03-24 Oussama Zekri , Théo Uscidda , Nicolas Boullé , Anna Korba

Data mixing augmentation has proved effective in training deep models. Recent methods mix labels mainly based on the mixture proportion of image pixels. As the main discriminative information of a fine-grained image usually resides in…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Shaoli Huang , Xinchao Wang , Dacheng Tao

We report on an improvement to the implementation of the Maximum Entropy Method (MEM). It amounts to departing from the search space obtained through a singular value decomposition (SVD) of the Kernel. Based on the shape of the SVD basis…

Computational Physics · Physics 2015-03-20 Alexander Rothkopf

Many practical sensing applications involve multiple sensors simultaneously acquiring measurements of a single object. Conversely, most existing sparse recovery guarantees in compressed sensing concern only single-sensor acquisition…

Information Theory · Computer Science 2023-08-31 Il Yong Chun , Ben Adcock

Hyperedge prediction is crucial in hypergraph analysis for understanding complex multi-entity interactions in various web-based applications, including social networks and e-commerce systems. Traditional methods often face difficulties in…

Information Retrieval · Computer Science 2024-11-20 Shilin Qu , Weiqing Wang , Yuan-Fang Li , Quoc Viet Hung Nguyen , Hongzhi Yin

Compressed sensing (CS) MRI relies on adequate undersampling of the k-space to accelerate the acquisition without compromising image quality. Consequently, the design of optimal sampling patterns for these k-space coefficients has received…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Iris A. M. Huijben , Bastiaan S. Veeling , Ruud J. G. van Sloun

Blind source separation (BSS) is a natural framework for studying how latent causes may be recovered from sensory mixtures, but deriving online and biologically plausible algorithms for structured (i.e., constrained to known domains) and…

Machine Learning · Computer Science 2026-05-22 Bariscan Bozkurt , Efe Ali Gorguner , Francesco Innocenti , Rafal Bogacz

In most data-scientific approaches, the principle of Maximum Entropy (MaxEnt) is used to a posteriori justify some parametric model which has been already chosen based on experience, prior knowledge or computational simplicity. In a…

Methodology · Statistics 2022-06-29 Orestis Loukas , Ho Ryun Chung

Subsampling methods aim to select a subsample as a surrogate for the observed sample. Such methods have been used pervasively in large-scale data analytics, active learning, and privacy-preserving analysis in recent decades. Instead of…

Machine Learning · Statistics 2022-06-03 Jingyi Zhang , Cheng Meng , Jun Yu , Mengrui Zhang , Wenxuan Zhong , Ping Ma

The rare-event sampling problem has long been the central limiting factor in molecular dynamics (MD), especially in biomolecular simulation. Recently, diffusion models such as BioEmu have emerged as powerful equilibrium samplers that…