English
Related papers

Related papers: Sparse approximation of multilinear problems with …

200 papers

This paper introduces a multilevel kernel-based approximation method to estimate efficiently solutions to elliptic partial differential equations (PDEs) with periodic random coefficients. Building upon the work of Kaarnioja, Kazashi, Kuo,…

Numerical Analysis · Mathematics 2025-04-23 Alexander D. Gilbert , Michael B. Giles , Frances Y. Kuo , Ian H. Sloan , Abirami Srikumar

Spectral-based subspace clustering methods have proved successful in many challenging applications such as gene sequencing, image recognition, and motion segmentation. In this work, we first propose a novel spectral-based subspace…

Machine Learning · Statistics 2021-06-09 Hankui Peng , Nicos G. Pavlidis

In this paper, we propose an optimization selection methodology for the ubiquitous sparse matrix-vector multiplication (SpMV) kernel. We propose two models that attempt to identify the major performance bottleneck of the kernel for every…

Performance · Computer Science 2016-01-12 Athena Elafrou , Georgios Goumas , Nectarios Koziris

Two contrasting algorithmic paradigms for constraint satisfaction problems are successive local explorations of neighboring configurations versus producing new configurations using global information about the problem (e.g. approximating…

Quantum Physics · Physics 2022-12-09 S. Andrew Lanham

We consider a sparse grid collocation method in conjunction with a time discretization of the differential equations for computing expectations of functionals of solutions to differential equations perturbed by time-dependent white noise.…

Numerical Analysis · Mathematics 2015-05-18 Z. Zhang , M. V. Tretyakov , B. Rozovskii , G. E. Karniadakis

This paper, broadly speaking, covers the use of randomness in two main areas: low-rank approximation and kernel methods. Low-rank approximation is very important in numerical linear algebra. Many applications depend on matrix decomposition…

Numerical Analysis · Mathematics 2020-08-12 Rishi Advani , Madison Crim , Sean O'Hagan

We propose a sequential quadratic programming (SQP) algorithm for inequality constrained optimization that is robust to the presence of bounded noise in function and derivative evaluations. We cover the case where constraint evaluations…

Optimization and Control · Mathematics 2026-04-17 Figen Oztoprak , Richard Byrd

We describe an algorithm for sampling a low-rank random matrix $Q$ that best approximates a fixed target matrix $P\in\mathbb{C}^{n\times m}$ in the following sense: $Q$ is unbiased, i.e., $\mathbb{E}[Q] = P$; $\mathsf{rank}(Q)\leq r$; and…

Data Structures and Algorithms · Computer Science 2026-03-18 Leighton Pate Barnes , Stephen Cameron , Benjamin Howard

Unitary equivariance is a natural symmetry that occurs in many contexts in physics and mathematics. Optimization problems with such symmetry can often be formulated as semidefinite programs for a $d^{p+q}$-dimensional matrix variable that…

Quantum Physics · Physics 2025-01-07 Dmitry Grinko , Maris Ozols

Multiple kernel learning (MKL) algorithms combine different base kernels to obtain a more efficient representation in the feature space. Focusing on discriminative tasks, MKL has been used successfully for feature selection and finding the…

Machine Learning · Computer Science 2019-03-14 Babak Hosseini , Barbara Hammer

We study robust convex quadratic programs where the uncertain problem parameters can contain both continuous and integer components. Under the natural boundedness assumption on the uncertainty set, we show that the generic problems are…

Optimization and Control · Mathematics 2018-12-19 Areesh Mittal , Can Gokalp , Grani A. Hanasusanto

Low-rank approximation is a common tool used to accelerate kernel methods: the $n \times n$ kernel matrix $K$ is approximated via a rank-$k$ matrix $\tilde K$ which can be stored in much less space and processed more quickly. In this work…

Data Structures and Algorithms · Computer Science 2017-11-07 Cameron Musco , David P. Woodruff

In this article, we use the monotonic optimization approach to propose an outcome-space outer approximation by copolyblocks for solving strictly quasiconvex multiobjective programming problems and especially in the case that the objective…

Optimization and Control · Mathematics 2020-03-26 Tran Ngoc Thang , Vijender Kumar Solanki , Tuan Anh Dao , Nguyen Thi Ngoc Anh , Hai V. Pham

Nonlinear kernels can be approximated using finite-dimensional feature maps for efficient risk minimization. Due to the inherent trade-off between the dimension of the (mapped) feature space and the approximation accuracy, the key problem…

Machine Learning · Computer Science 2018-10-10 Shahin Shahrampour , Vahid Tarokh

We present a successive constraint approach that makes it possible to cheaply solve large-scale linear matrix inequalities for a large number of parameter values. The efficiency of our method is made possible by an offline/online…

Numerical Analysis · Mathematics 2017-08-08 Robert O'Connor

In this work we are interested in the problems of supervised learning and variable selection when the input-output dependence is described by a nonlinear function depending on a few variables. Our goal is to consider a sparse nonparametric…

Machine Learning · Statistics 2012-08-14 Lorenzo Rosasco , Silvia Villa , Sofia Mosci , Matteo Santoro , Alessandro verri

Inverse problems play a key role in modern image/signal processing methods. However, since they are generally ill-conditioned or ill-posed due to lack of observations, their solutions may have significant intrinsic uncertainty. Analysing…

Signal Processing · Electrical Eng. & Systems 2019-09-09 Xiaohao Cai , Marcelo Pereyra , Jason D. McEwen

This work proposes a research problem of finding sparse solution of undetermined Linear system with some applications. Two approaches how to solve the compressive sensing problem: using l_1 approach , the l_q approach with 0 < q < 1.…

Optimization and Control · Mathematics 2017-02-24 Maddullah Almerdasy

Sparsity finds applications in areas as diverse as statistics, machine learning, and signal processing. Computations over sparse structures are less complex compared to their dense counterparts, and their storage consumes less space. This…

Signal Processing · Electrical Eng. & Systems 2023-01-31 Omar M. Sleem , M. E. Ashour , N. S. Aybat , Constantino M. Lagoa

Column-sparse packing problems arise in several contexts in both deterministic and stochastic discrete optimization. We present two unifying ideas, (non-uniform) attenuation and multiple-chance algorithms, to obtain improved approximation…

Data Structures and Algorithms · Computer Science 2019-08-07 Brian Brubach , Karthik Abinav Sankararaman , Aravind Srinivasan , Pan Xu