English
Related papers

Related papers: Sampling in a Union of Frame Generated Subspaces

200 papers

Comparing the internal representations of neural networks is a central goal in both neuroscience and machine learning. Standard alignment metrics operate on raw neural activations, implicitly assuming that similar representations produce…

Machine Learning · Computer Science 2026-04-02 Sunny Liu , Habon Issa , André Longon , Liv Gorton , Meenakshi Khosla , David Klindt

Assume that samples of a filtered version of a function in a shift-invariant space are avalaible. This work deals with the existence of a sampling formula involving these samples and having reconstruction functions with compact support.…

Information Theory · Computer Science 2008-06-13 A. G. Garcia , M. A. Hernandez-Medina , G. Perez-Villalon

In the algorithmic (Kolmogorov) view, agents are programs that track and compress sensory streams using generative programs. We propose a framework where the relevant structural prior is simplicity (Solomonoff) understood as…

Machine Learning · Computer Science 2025-10-14 Giulio Ruffini

Modern inference and learning often hinge on identifying low-dimensional structures that approximate large scale data. Subspace clustering achieves this through a union of linear subspaces. However, in contemporary applications data is…

Machine Learning · Computer Science 2018-08-03 Daniel L. Pimentel-Alarcón , Usman Mahmood

We present a signal representation framework called the sparse manifold transform that combines key ideas from sparse coding, manifold learning, and slow feature analysis. It turns non-linear transformations in the primary sensory signal…

Machine Learning · Statistics 2018-12-04 Yubei Chen , Dylan M. Paiton , Bruno A. Olshausen

Mechanism for generation of suppressed neutrino masses, within low scale theories, is considered. The mechanism do not have extradimensional nature and is realized through extended $SU(2)_L$ scalar multiplets. Latters, in some cases, are…

High Energy Physics - Phenomenology · Physics 2017-08-23 Zurab Tavartkiladze

The enormous size of modern deep neural networks makes it challenging to deploy those models in memory and communication limited scenarios. Thus, compressing a trained model without a significant loss in performance has become an…

Information Theory · Computer Science 2019-01-25 Weihao Gao , Yu-Han Liu , Chong Wang , Sewoong Oh

We develop a new class of random graph models for the statistical estimation of network formation -- subgraph generated models (SUGMs). Various subgraphs -- e.g., links, triangles, cliques, stars -- are generated and their union results in…

Physics and Society · Physics 2024-11-27 Arun G. Chandrasekhar , Matthew O. Jackson

Random sampling has become a critical tool in solving massive matrix problems. For linear regression, a small, manageable set of data rows can be randomly selected to approximate a tall, skinny data matrix, improving processing time…

Data Structures and Algorithms · Computer Science 2014-08-22 Michael B. Cohen , Yin Tat Lee , Cameron Musco , Christopher Musco , Richard Peng , Aaron Sidford

In this short note we show two results concerning sampling translation invariant subspaces of $\ltwod$ on unions of lattices. The first result shows that the sampling transform on a union of lattices is a constant times an isometry if and…

Functional Analysis · Mathematics 2007-05-23 Eric Weber

We consider the problem of learning a low-dimensional signal model from a collection of training samples. The mainstream approach would be to learn an overcomplete dictionary to provide good approximations of the training samples using…

Numerical Analysis · Mathematics 2015-06-05 Mehrdad Yaghoobi , Sangnam Nam , Remi Gribonval , Mike E. Davies

We introduce a theoretical approach for designing generalizations of the approximate message passing (AMP) algorithm for compressed sensing which are valid for large observation matrices that are drawn from an invariant random matrix…

Information Theory · Computer Science 2017-05-12 Burak Çakmak , Manfred Opper , Ole Winther , Bernard H. Fleury

Using coherent-state techniques, we prove a sampling theorem for Majorana's (holomorphic) functions on the Riemann sphere and we provide an exact reconstruction formula as a convolution product of $N$ samples and a given reconstruction…

Mathematical Physics · Physics 2011-09-13 Manuel Calixto , Julio Guerrero , Juan Carlos Sánchez-Monreal

In physics we often use very simple models to describe systems with many degrees of freedom, but it is not clear why or how this success can be transferred to the more complex biological context. We consider models for the joint…

Neurons and Cognition · Quantitative Biology 2024-12-06 Luisa Ramirez , William Bialek , Stephanie E. Palmer , David J. Schwab

In compressed sensing, a small number of linear measurements can be used to reconstruct an unknown signal. Existing approaches leverage assumptions on the structure of these signals, such as sparsity or the availability of a generative…

Machine Learning · Statistics 2018-08-02 Manik Dhar , Aditya Grover , Stefano Ermon

We demonstrate the synthesis of sparse sampling and machine learning to characterize and model complex, nonlinear dynamical systems over a range of bifurcation parameters. First, we construct modal libraries using the classical proper…

Pattern Formation and Solitons · Physics 2015-10-28 Syuzanna Sargsyan , Steven L. Brunton , J. Nathan Kutz

Recent results in compressed sensing showed that the optimal subsampling strategy should take into account the sparsity pattern of the signal at hand. This oracle-like knowledge, even though desirable, nevertheless remains elusive in most…

Information Theory · Computer Science 2023-06-28 Simon Ruetz

In this paper, we study the problem of direction of arrival estimation and model order selection for systems employing subarray sampling. Thereby, we focus on scenarios, where the number of active sources is not smaller than the number of…

Signal Processing · Electrical Eng. & Systems 2021-06-15 Andreas Barthelme , Wolfgang Utschick

Functions or distributions used to sample and to reconstruct signals often occur in different domains, like the Dirac delta and a band-limited bump function in classical sampling. Oblique dual frames generalize this phenomenon. In this…

Functional Analysis · Mathematics 2026-01-14 Dongwei Chen , Emily J. King , Clayton Shonkwiler

This paper investigates the problem of dynamical sampling for graph signals influenced by a constant source term. We consider signals evolving over time according to a linear dynamical system on a graph, where both the initial state and the…

Numerical Analysis · Mathematics 2025-09-23 Le Gong , Longxiu Huang