English
Related papers

Related papers: A Randomized Algorithm for Preconditioner Selectio…

200 papers

This paper studies the problem of selecting a minimum-size set of input nodes to guarantee stability of a networked system in the presence of uncertainties and time delays. Current approaches to input selection in networked dynamical…

Optimization and Control · Mathematics 2017-12-13 Zhipeng Liu , Yao Long , Andrew Clark , Phillip Lee , Linda Bushnell , Daniel Kirschen , Radha Poovendran

Recent research reveals that machine learning (ML) models are highly sensitive to minor changes in their training procedure, such as the inclusion or exclusion of a single data point, leading to conflicting predictions on individual data…

Machine Learning · Computer Science 2025-07-15 Falaah Arif Khan , Denys Herasymuk , Nazar Protsiv , Julia Stoyanovich

Steepest descent preconditioning is considered for the recently proposed nonlinear generalized minimal residual (N-GMRES) optimization algorithm for unconstrained nonlinear optimization. Two steepest descent preconditioning variants are…

Numerical Analysis · Mathematics 2011-07-26 Hans De Sterck

There currently exist no quantitative methods to determine the appropriate conditions for solid-state synthesis. This not only hinders the experimental realization of novel materials but also complicates the interpretation and understanding…

Consider the problem of joint parameter estimation and prediction in a Markov random field: i.e., the model parameters are estimated on the basis of an initial set of data, and then the fitted model is used to perform prediction (e.g.,…

Machine Learning · Computer Science 2007-07-13 Martin J. Wainwright

In this paper we introduce Feature Gradients, a gradient-based search algorithm for feature selection. Our approach extends a recent result on the estimation of learnability in the sublinear data regime by showing that the calculation can…

Machine Learning · Statistics 2019-08-29 Rishit Sheth , Nicolo Fusi

Stochastic First-Order (SFO) methods have been a cornerstone in addressing a broad spectrum of modern machine learning (ML) challenges. However, their efficacy is increasingly questioned, especially in large-scale applications where…

Machine Learning · Computer Science 2024-08-01 Di Zhang , Suvrajeet Sen

Gaussian processes are flexible probabilistic regression models which are widely used in statistics and machine learning. However, a drawback is their limited scalability to large data sets. To alleviate this, full-scale approximations…

Methodology · Statistics 2026-01-13 Tim Gyger , Reinhard Furrer , Fabio Sigrist

Maintaining numerical stability in machine learning models is crucial for their reliability and performance. One approach to maintain stability of a network layer is to integrate the condition number of the weight matrix as a regularizing…

Machine Learning · Computer Science 2024-10-02 Rossen Nenov , Daniel Haider , Peter Balazs

We show that preconditioners constructed by random sampling can perform well without meeting the standard requirements of iterative methods. When applied to graph Laplacians, this leads to ultra-sparsifiers that in expectation behave as the…

Data Structures and Algorithms · Computer Science 2014-01-27 Michael B. Cohen , Rasmus Kyng , Jakub W. Pachocki , Richard Peng , Anup Rao

We study the expectation propagation (EP) algorithm for symbol detection in massive multiple-input multiple-output (MIMO) systems. The EP detector shows excellent performance but suffers from a high computational complexity due to the…

Information Theory · Computer Science 2024-08-23 Luca Schmid , Dominik Sulz , Laurent Schmalen

Motivated by some applications in signal processing and machine learning, we consider two convex optimization problems where, given a cone $K$, a norm $\|\cdot\|$ and a smooth convex function $f$, we want either 1) to minimize the norm over…

Optimization and Control · Mathematics 2013-03-29 Zaid Harchaoui , Anatoli Juditsky , Arkadi Nemirovski

Stability selection is a versatile framework for structure estimation and variable selection in high-dimensional setting, primarily grounded in frequentist principles. In this paper, we propose an enhanced methodology that integrates…

Methodology · Statistics 2026-05-05 Mahdi Nouraie , Connor Smith , Samuel Muller

Deep learning solvers for partial differential equations typically have limited accuracy. We propose to overcome this problem by using them as preconditioners. More specifically, we apply discretization-invariant neural operators to learn…

Numerical Analysis · Mathematics 2024-02-09 Alexander Rudikov , Vladimir Fanaskov , Ekaterina Muravleva , Yuri M. Laevsky , Ivan Oseledets

This Paper conducts a thorough simulation study to assess the effectiveness of various acceleration techniques designed to enhance the conjugate gradient algorithm, which is used for solving large linear systems to accelerate Bayesian…

Computation · Statistics 2025-05-06 Zhihao Zhou

We introduce a class of efficient multiple right-hand side multigrid algorithm for domain wall fermions. The simultaneous solution for a modest number of right hand sides concurrently allows for a significant reduction in the time spent…

High Energy Physics - Lattice · Physics 2024-09-09 Peter A Boyle

Requirements driven search-based testing (also known as falsification) has proven to be a practical and effective method for discovering erroneous behaviors in Cyber-Physical Systems. Despite the constant improvements on the performance and…

Randomized methods are becoming increasingly popular in numerical linear algebra. However, few attempts have been made to use them in developing preconditioners. Our interest lies in solving large-scale sparse symmetric positive definite…

Numerical Analysis · Mathematics 2021-11-16 Hussam Al Daas , Tyrone Rees , Jennifer Scott

For multiparametric mixed-integer convex programming problems such as those encountered in hybrid model predictive control, we propose an algorithm for generating a feasible partition of a subset of the parameter space. The result is a…

Optimization and Control · Mathematics 2019-03-01 Danylo Malyuta , Behcet Acikmese , Martin Cacan , David S. Bayard

Quantum error correction is an essential technique for constructing a scalable quantum computer. In order to implement quantum error correction with near-term quantum devices, a fast and near-optimal decoding method is demanded. A decoder…

Quantum Physics · Physics 2020-09-16 Amarsanaa Davaasuren , Yasunari Suzuki , Keisuke Fujii , Masato Koashi
‹ Prev 1 8 9 10 Next ›