English
Related papers

Related papers: Nystr\"om-Accelerated Primal LS-SVMs: Breaking the…

200 papers

In this work, we study optimization methods that leverage the linear minimization oracle (LMO) over a norm-ball. We propose a new stochastic family of algorithms that uses the LMO to adapt to the geometry of the problem and, perhaps…

Machine Learning · Computer Science 2025-06-09 Thomas Pethick , Wanyun Xie , Kimon Antonakopoulos , Zhenyu Zhu , Antonio Silveti-Falls , Volkan Cevher

We present a simple transformation of any linear program or semidefinite program into an equivalent convex optimization problem whose only constraints are linear equations. The objective function is defined on the whole space, making…

Optimization and Control · Mathematics 2014-10-07 James Renegar

High-dimensional time series are common in many domains. Since human cognition is not optimized to work well in high-dimensional spaces, these areas could benefit from interpretable low-dimensional representations. However, most…

Machine Learning · Computer Science 2019-01-07 Vincent Fortuin , Matthias Hüser , Francesco Locatello , Heiko Strathmann , Gunnar Rätsch

Sequential neural posterior estimation (SNPE) techniques have been recently proposed for dealing with simulation-based models with intractable likelihoods. Unlike approximate Bayesian computation, SNPE techniques learn the posterior from…

Machine Learning · Statistics 2025-01-17 Yifei Xiong , Xiliang Yang , Sanguo Zhang , Zhijian He

In the last few years, due to the growing ubiquity of unlabeled data, much effort has been spent by the machine learning community to develop better understanding and improve the quality of classifiers exploiting unlabeled data. Following…

Machine Learning · Statistics 2009-09-30 Stefano Melacci , Mikhail Belkin

A general approach for anomaly detection or novelty detection consists in estimating high density regions or Minimum Volume (MV) sets. The One-Class Support Vector Machine (OCSVM) is a state-of-the-art algorithm for estimating such regions…

Machine Learning · Statistics 2015-09-01 Albert Thomas , Vincent Feuillard , Alexandre Gramfort

Neural Stochastic Differential Equations (Neural SDEs) have emerged as powerful mesh-free generative models for continuous stochastic processes, with critical applications in fields such as finance, physics, and biology. Previous…

Machine Learning · Computer Science 2025-03-28 Jianxin Zhang , Josh Viktorov , Doosan Jung , Emily Pitler

Stochastic nonconvex-concave min-max saddle point problems appear in many machine learning and control problems including distributionally robust optimization, generative adversarial networks, and adversarial learning. In this paper, we…

Optimization and Control · Mathematics 2023-09-12 Morteza Boroun , Zeinab Alizadeh , Afrooz Jalilzadeh

We introduce a novel spectral, finite-dimensional approximation of general Sobolev spaces in terms of Chebyshev polynomials. Based on this polynomial surrogate model (PSM), we realise a variational formulation, solving a vast class of…

Numerical Analysis · Mathematics 2023-01-13 Juan-Esteban Suarez Cardona , Phil-Alexander Hofmann , Michael Hecht

Neural Networks (NNs) can be used to solve Ordinary and Partial Differential Equations (ODEs and PDEs) by redefining the question as an optimization problem. The objective function to be optimized is the sum of the squares of the PDE to be…

Machine Learning · Computer Science 2021-03-17 Veronica Guidetti , Francesco Muia , Yvette Welling , Alexander Westphal

We prove that, under low noise assumptions, the support vector machine with $N\ll m$ random features (RFSVM) can achieve the learning rate faster than $O(1/\sqrt{m})$ on a training set with $m$ samples when an optimized feature map is used.…

Machine Learning · Computer Science 2019-01-09 Yitong Sun , Anna Gilbert , Ambuj Tewari

In this article, a large dimensional performance analysis of kernel least squares support vector machines (LS-SVMs) is provided under the assumption of a two-class Gaussian mixture model for the input data. Building upon recent advances in…

Machine Learning · Statistics 2021-03-18 Zhenyu Liao , Romain Couillet

We present an efficient quantum algorithm to simulate nonlinear differential equations with polynomial vector fields of arbitrary degree on quantum platforms. Models of physical systems that are governed by ordinary differential equations…

Dynamical Systems · Mathematics 2023-02-08 Amit Surana , Abeynaya Gnanasekaran , Tuhin Sahai

Democratization of machine learning requires architectures that automatically adapt to new problems. Neural Differential Equations (NDEs) have emerged as a popular modeling framework by removing the need for ML practitioners to choose the…

Machine Learning · Computer Science 2022-02-08 Avik Pal , Yingbo Ma , Viral Shah , Christopher Rackauckas

Optical neural networks offer a route to low-latency and energy-efficient inference by encoding computation in light propagation. However, most existing implementations rely on planar photonic circuits or discretely spaced diffractive…

Kernel methods are powerful tools in statistical learning, but their cubic complexity in the sample size n limits their use on large-scale datasets. In this work, we introduce a scalable framework for kernel regression with O(n log n)…

Machine Learning · Statistics 2025-09-04 Nathan Doumèche , Francis Bach , Gérard Biau , Claire Boyer

We study the performance of long short-term memory networks (LSTMs) and neural ordinary differential equations (NODEs) in learning latent-space representations of dynamical equations for an advection-dominated problem given by the viscous…

Computational Physics · Physics 2020-02-26 Romit Maulik , Arvind Mohan , Bethany Lusch , Sandeep Madireddy , Prasanna Balaprakash , Daniel Livescu

Neural operators have emerged as a promising paradigm for learning solution operators of partial differential equa- tions (PDEs) directly from data. Existing methods, such as those based on Fourier or graph techniques, make strong as-…

Machine Learning · Computer Science 2025-11-14 Noam Koren , Ralf J. J. Mackenbach , Ruud J. G. van Sloun , Kira Radinsky , Daniel Freedman

Support vector machines (SVMs) are a standard tool for binary classification, but their classical formulations are purely data-driven and offer no direct way to encode trusted benchmark models or structured preferences on selected subsets…

Machine Learning · Statistics 2026-04-29 Mohammad Jafari Jozani , Bahram Moeinianfar

The Nystr\"om method is a convenient heuristic method to obtain low-rank approximations to kernel matrices in nearly linear complexity. Existing studies typically use the method to approximate positive semidefinite matrices with low or…

Numerical Analysis · Mathematics 2023-07-13 Jianlin Xia