English
Related papers

Related papers: Multivariate Exponential Analysis from the Minimal…

200 papers

Subsampling is a computationally efficient and scalable method to draw inference in large data settings based on a subset of the data rather than needing to consider the whole dataset. When employing subsampling techniques, a crucial…

Methodology · Statistics 2025-10-08 Amalan Mahendran , Helen Thompson , James M. McGree

Multivariate statistical methods are widely used throughout the sciences, including microscopy, however, their utilisation for analysis of electron backscatter diffraction (EBSD) data has not been adequately explored. The basic aim of most…

In this paper we consider the uniformity testing problem for high-dimensional discrete distributions (multinomials) under sparse alternatives. More precisely, we derive sharp detection thresholds for testing, based on $n$ samples, whether a…

Statistics Theory · Mathematics 2022-02-17 Bhaswar B. Bhattacharya , Rajarshi Mukherjee

We study the problem of supervised linear dimensionality reduction, taking an information-theoretic viewpoint. The linear projection matrix is designed by maximizing the mutual information between the projected signal and the class label…

Machine Learning · Computer Science 2012-07-03 Minhua Chen , William Carson , Miguel Rodrigues , Robert Calderbank , Lawrence Carin

Mixed linear regression involves the recovery of two (or more) unknown vectors from unlabeled linear measurements; that is, where each sample comes from exactly one of the vectors, but we do not know which one. It is a classic problem, and…

Machine Learning · Statistics 2014-02-10 Xinyang Yi , Constantine Caramanis , Sujay Sanghavi

A unified view of sparse signal processing is presented in tutorial form by bringing together various fields. For each of these fields, various algorithms and techniques, which have been developed to leverage sparsity, are described…

Information Theory · Computer Science 2009-02-12 F. Marvasti , A. Amini , F. Haddadi , M. Soltanolkotabi , B. H. Khalaj , A. Aldroubi , S. Holm , S. Sanei , J. Chambers

Real world scenarios can be captured with lifted probability distributions. However, distributions are usually encoded in a table or list, requiring an exponential number of values. Hence, we propose a method for extracting first-order…

Artificial Intelligence · Computer Science 2026-04-01 Florian Andreas Marwitz , Tanya Braun , Ralf Möller

A method is introduced to perform simultaneous sparse dimension reduction on two blocks of variables. Beyond dimension reduction, it also yields an estimator for multivariate regression with the capability to intrinsically deselect…

Methodology · Statistics 2024-11-28 Sven Serneels

Sparsity constrained minimization captures a wide spectrum of applications in both machine learning and signal processing. This class of problems is difficult to solve since it is NP-hard and existing solutions are primarily based on…

Optimization and Control · Mathematics 2018-12-31 Ganzhao Yuan , Bernard Ghanem

Suppose an $n \times d$ design matrix in a linear regression problem is given, but the response for each point is hidden unless explicitly requested. The goal is to sample only a small number $k \ll n$ of the responses, and then produce a…

Machine Learning · Computer Science 2018-09-06 Michał Dereziński , Manfred K. Warmuth , Daniel Hsu

Finding a sparse representation of a possibly noisy signal can be modeled as a variational minimization with l_q-sparsity constraints for q less than one. Especially for real-time, on-line, or iterative applications, in which problems of…

Numerical Analysis · Mathematics 2017-09-04 Martin Ehler

This paper addresses the problem of sparse phase retrieval, a fundamental inverse problem in applied mathematics, physics, and engineering, where a signal need to be reconstructed using only the magnitude of its transformation while phase…

Machine Learning · Statistics 2025-04-15 The Tien Mai

The fundamental multidimensional line spectral estimation problem is addressed utilizing the Bayesian methods. Motivated by the recently proposed variational line spectral estimation (VALSE) algorithm, multidimensional VALSE (MDVALSE) is…

Information Theory · Computer Science 2020-07-15 Qi Zhang , Jiang Zhu , Ning Zhang , Zhiwei Xu

We study the Electrical Impedance Tomography Bayesian inverse problem for recovering the conductivity given noisy measurements of the voltage on some boundary surface electrodes. The uncertain conductivity depends linearly on a countable…

Numerical Analysis · Mathematics 2023-06-16 Quang Huy Pham , Viet Ha Hoang

We consider the problem of constraining diffusion model outputs with a user-supplied reference image. Our key objective is to extract multiple attributes (e.g., color, object, layout, style) from this single reference image, and then…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Aishwarya Agarwal , Srikrishna Karanam , Tripti Shukla , Balaji Vasan Srinivasan

We present a novel binary convex reformulation of the sparse regression problem that constitutes a new duality perspective. We devise a new cutting plane method and provide evidence that it can solve to provable optimality the sparse…

Optimization and Control · Mathematics 2017-09-29 Dimitris Bertsimas , Bart Van Parys

Computation of the large sparse matrix exponential has been an important topic in many fields, such as network and finite-element analysis. The existing scaling and squaring algorithm (SSA) is not suitable for the computation of the large…

Numerical Analysis · Mathematics 2021-10-12 Feng Wu , Kailing Zhang , Li Zhu , Jiayao Hu

After a decade of extensive study of the sparse representation synthesis model, we can safely say that this is a mature and stable field, with clear theoretical foundations, and appealing applications. Alongside this approach, there is an…

Numerical Analysis · Mathematics 2012-04-26 Sangnam Nam , Mike E. Davies , Michael Elad , Rémi Gribonval

The success of the compressed sensing paradigm has shown that a substantial reduction in sampling and storage complexity can be achieved in certain linear and non-adaptive estimation problems. It is therefore an advisable strategy for…

Information Theory · Computer Science 2014-08-27 Peter Jung , Philipp Walk

This contribution introduces a novel signal extrapolation algorithm and its application to image error concealment. The signal extrapolation is carried out by iteratively generating a model of the signal suffering from distortion. Thereby,…

Image and Video Processing · Electrical Eng. & Systems 2022-07-15 Jürgen Seiler , André Kaup