English
Related papers

Related papers: Mosaic-skeleton approximation is all you need for …

200 papers

This paper introduces a new and effective algorithm for learning kernels in a Multi-Task Learning (MTL) setting. Although, we consider a MTL scenario here, our approach can be easily applied to standard single task learning, as well. As…

Machine Learning · Computer Science 2017-07-13 Niloofar Yousefi , Cong Li , Mansooreh Mollaghasemi , Georgios Anagnostopoulos , Michael Georgiopoulos

Mixed integer linear programming (MILP) has seen a sharp rise in use for engineering optimization applications in recent years. Even for initially non-linear problems, it is often the method of choice. Then, the non-linear functions have to…

Optimization and Control · Mathematics 2023-09-20 Felix Birkelbach , David Huber , René Hofmann

We consider Smoluchowski's coagulation equation with a kernel of the form $K = 2 + \epsilon W$, where $W$ is a bounded kernel of homogeneity zero. For small $\epsilon$, we prove that solutions approach a universal, unique self-similar…

Analysis of PDEs · Mathematics 2019-10-18 José A. Cañizo , Sebastian Throm

Successive quadratic approximations, or second-order proximal methods, are useful for minimizing functions that are a sum of a smooth part and a convex, possibly nonsmooth part that promotes regularization. Most analyses of iteration…

Optimization and Control · Mathematics 2019-01-25 Ching-pei Lee , Stephen J. Wright

When representing a solid object there are alternatives to the use of traditional explicit (surface meshes) or implicit (zero crossing of implicit functions) methods. Skeletal representations encode shape information in a mixed fashion:…

Graphics · Computer Science 2014-06-26 Andrea Tagliasacchi

Let $\mathscr{P}(E)$ be the space of probability measures on a measurable space $(E,\mathcal{E})$. In this paper we introduce a class of nonlinear Markov chain Monte Carlo (MCMC) methods for simulating from a probability measure…

Statistics Theory · Mathematics 2011-07-18 Christophe Andrieu , Ajay Jasra , Arnaud Doucet , Pierre Del Moral

Recently, convex nested stochastic composite optimization (NSCO) has received considerable attention for its applications in reinforcement learning and risk-averse optimization. The current NSCO algorithms have worse stochastic oracle…

Optimization and Control · Mathematics 2022-06-22 Zhe Zhang , Guanghui Lan

Bayesian model selection provides a powerful framework for objectively comparing models directly from observed data, without reference to ground truth data. However, Bayesian model selection requires the computation of the marginal…

Methodology · Statistics 2024-01-17 Xiaohao Cai , Jason D. McEwen , Marcelo Pereyra

We demonstrate a scaling method for non-Markovian Monte Carlo wave-function simulations used to study open quantum systems weakly coupled to their environments. We derive a scaling equation, from which the result for the expectation values…

Quantum Physics · Physics 2009-11-10 J. Piilo , S. Maniscalco , A. Messina , F. Petruccione

We study nonlinear approximation in $\operatorname{BMO}$ from splines generated by a hierarchy of B-splines over regular multilevel nested partitions of $\mathbb R$. Companion Jackson and Bernstein estimates are established that allow to…

Classical Analysis and ODEs · Mathematics 2020-01-30 Kamen G. Ivanov , Pencho Petrushev

We present in this work a new methodology to design kernels on data which is structured with smaller components, such as text, images or sequences. This methodology is a template procedure which can be applied on most kernels on measures…

Machine Learning · Computer Science 2007-05-23 Marco Cuturi , Kenji Fukumizu

This note studies numerical methods for solving compositional optimization problems, where the inner function is smooth, and the outer function is Lipschitz continuous, non-smooth, and non-convex but exhibits one of two special structures…

Optimization and Control · Mathematics 2024-11-22 Yao Yao , Qihang Lin , Tianbao Yang

In this article, we combine the periodic sinc basis set with a curvilinear coordinate system for electronic structure calculations. This extension allows for variable resolution across the computational domain, with higher resolution close…

Computational Physics · Physics 2024-07-09 Michael Lindsey , Sandeep Sharma

We consider the computational efficiency of Monte Carlo (MC) and Multilevel Monte Carlo (MLMC) methods applied to partial differential equations with random coefficients. These arise, for example, in groundwater flow modelling, where a…

Numerical Analysis · Mathematics 2024-12-12 Anastasia Istratuca , Aretha Teckentrup

We describe a skeletonization of the spherical harmonic connection problem that reduces the storage and pre-computation to superoptimal complexities at the cost of increasing the execution time by the modest multiplicative factor of…

Numerical Analysis · Mathematics 2017-11-22 Richard Mikael Slevinsky

Kernel methods are learning algorithms that enjoy solid theoretical foundations while suffering from important computational limitations. Sketching, which consists in looking for solutions among a subspace of reduced dimension, is a well…

Machine Learning · Statistics 2023-11-07 Tamim El Ahmad , Pierre Laforgue , Florence d'Alché-Buc

The multilevel Monte Carlo (MLMC) method is highly efficient for estimating expectations of a functional of a solution to a stochastic differential equation (SDE). However, MLMC estimators may be unstable and have a poor (noncanonical)…

Computational Finance · Quantitative Finance 2024-05-07 Christian Bayer , Chiheb Ben Hammouda , Raul Tempone

Reformulating computer vision problems over Riemannian manifolds has demonstrated superior performance in various computer vision applications. This is because visual data often forms a special structure lying on a lower dimensional space…

Computer Vision and Pattern Recognition · Computer Science 2015-09-21 Kun Zhao , Azadeh Alavi , Arnold Wiliem , Brian C. Lovell

To cluster data that are not linearly separable in the original feature space, $k$-means clustering was extended to the kernel version. However, the performance of kernel $k$-means clustering largely depends on the choice of kernel…

Machine Learning · Computer Science 2018-11-02 Yaqiang Yao , Huanhuan Chen

By adopting a Multilevel Monte Carlo (MLMC) framework, we show that only a handful of costly fine scale computations are needed to accurately estimate statistics of the failure of a composite structure, as opposed to the thousands typically…

Numerical Analysis · Mathematics 2019-07-25 T. J. Dodwell , S. Kinston , R. Butler , R. T. Haftka , Nam H. Kim , R. Scheichl