English
Related papers

Related papers: Distributed High Dimensional Information Theoretic…

200 papers

Standard random projection techniques typically operate as a black box, mapping high-dimensional structures directly to a lower-dimensional space where the target dimension must be specified a \textit{priori}. To address scenarios where the…

Signal Processing · Electrical Eng. & Systems 2026-05-19 Nazanin Mirhosseini

Implicit neural representations (INRs) have emerged as a powerful tool for compressing large-scale volume data. This opens up new possibilities for in situ visualization. However, the efficient application of INRs to distributed data…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-23 Qi Wu , Joseph A. Insley , Victor A. Mateevitsi , Silvio Rizzi , Michael E. Papka , Kwan-Liu Ma

We show that the symmetries of image formation by scattering enable graph-theoretic manifold-embedding techniques to extract structural and timing information from simulated and experimental snapshots at extremely low signal. The approach…

Computational Physics · Physics 2011-09-27 Peter Schwander , Chun Hong Yoon , Abbas Ourmazd , Dimitrios Giannakis

High-dimensional big data appears in many research fields such as image recognition, biology and collaborative filtering. Often, the exploration of such data by classic algorithms is encountered with difficulties due to `curse of…

Machine Learning · Computer Science 2016-07-13 Amit Bermanis , Aviv Rotbart , Moshe Salhov , Amir Averbuch

One of the fundamental problems in machine learning is the estimation of a probability distribution from data. Many techniques have been proposed to study the structure of data, most often building around the assumption that observations…

Machine Learning · Statistics 2013-02-22 Oren Rippel , Ryan Prescott Adams

Subsampled Randomized Hadamard Transform (SRHT), a popular random projection method that can efficiently project a $d$-dimensional data into $r$-dimensional space ($r \ll d$) in $O(dlog(d))$ time, has been widely used to address the…

Machine Learning · Computer Science 2020-10-07 Zijian Lei , Liang Lan

We develop information-theoretic measures of spatial structure and pattern in more than one dimension. As is well known, the entropy density of a two-dimensional configuration can be efficiently and accurately estimated via a converging…

Statistical Mechanics · Physics 2009-11-07 David P. Feldman , James P. Crutchfield

It is known that statistical model selection as well as identification of dynamical equations from available data are both very challenging tasks. Physical systems behave according to their underlying dynamical equations which, in turn, can…

Mathematical Physics · Physics 2017-10-11 Sean Alan Ali , Carlo Cafaro

An active learning algorithm for the classification of high-dimensional images is proposed in which spatially-regularized nonlinear diffusion geometry is used to characterize cluster cores. The proposed method samples from estimated cluster…

Machine Learning · Computer Science 2019-11-07 James M. Murphy

Approximate inference via information projection has been recently introduced as a general-purpose approach for efficient probabilistic inference given sparse variables. This manuscript goes beyond classical sparsity by proposing efficient…

Machine Learning · Statistics 2016-07-13 Rajiv Khanna , Joydeep Ghosh , Russell Poldrack , Oluwasanmi Koyejo

In this work, we study distance metric learning (DML) for high dimensional data. A typical approach for DML with high dimensional data is to perform the dimensionality reduction first before learning the distance metric. The main…

Machine Learning · Computer Science 2015-09-16 Qi Qian , Rong Jin , Lijun Zhang , Shenghuo Zhu

In this work, we address the unsupervised classification issue by exploiting the general idea of Random Projection Ensemble. Specifically, we propose to generate a set of low dimensional independent random projections and to perform…

Methodology · Statistics 2020-11-24 Laura Anderlucci , Francesca Fortunato , Angela Montanari

Repeated-measure designs allow comparisons within a group as well as between groups, and are commonly referred to as split-plot designs. While originating in agricultural experiments, they are now widely used in medical research,…

Computation · Statistics 2025-12-22 Paavo Sattler , Nils Hichert

Random field and random cluster theory are used to describe certain mathematical results concerning the probability distribution of image pixel intensities characterized as generic $2D$ integer arrays. The size of the smallest bounded…

Image and Video Processing · Electrical Eng. & Systems 2023-04-27 Robert A. Murphy

We propose a unified theoretical framework for quantifying spatio-temporal interactions in a stochastic dynamical system based on information geometry. In the proposed framework, the degree of interactions is quantified by the divergence…

Neurons and Cognition · Quantitative Biology 2016-12-08 Masafumi Oizumi , Naotsugu Tsuchiya , Shun-ichi Amari

Inferring models, predicting the future, and estimating the entropy rate of discrete-time, discrete-event processes is well-worn ground. However, a much broader class of discrete-event processes operates in continuous-time. Here, we provide…

Statistical Mechanics · Physics 2020-05-11 S. E. Marzen , J. P. Crutchfield

Various kinds of data are routinely represented as discrete probability distributions. Examples include text documents summarized by histograms of word occurrences and images represented as histograms of oriented gradients. Viewing a…

Computational Geometry · Computer Science 2019-03-29 Herbert Edelsbrunner , Ziga Virk , Hubert Wagner

Embeddings are a basic initial feature extraction step in many machine learning models, particularly in natural language processing. An embedding attempts to map data tokens to a low-dimensional space where similar tokens are mapped to…

Machine Learning · Computer Science 2025-04-10 Golara Ahmadi Azar , Melika Emami , Alyson Fletcher , Sundeep Rangan

Majority of the current dimensionality reduction or retrieval techniques rely on embedding the learned feature representations onto a computable metric space. Once the learned features are mapped, a distance metric aids the bridging of gaps…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Muhammad Kamran Janjua , Shah Nawaz , Alessandro Calefati , Ignazio Gallo

Image registration is the inference of transformations relating noisy and distorted images. It is fundamental in computer vision, experimental physics, and medical imaging. Many algorithms and analyses exist for inferring shift, rotation,…

Data Analysis, Statistics and Probability · Physics 2019-02-21 Colin B. Clement , Matthew Bierbaum , James P. Sethna