English
Related papers

Related papers: Benchmarking the Hooke-Jeeves Method, MTS-LS1, and…

200 papers

Thompson sampling (TS) has optimal regret and excellent empirical performance in multi-armed bandit problems. Yet, in Bayesian optimization, TS underperforms popular acquisition functions (e.g., EI, UCB). TS samples arms according to the…

Machine Learning · Statistics 2024-12-02 David Sweet

Extending a recent suggestion to generate new instances for numerical black-box optimization benchmarking by interpolating pairs of the well-established BBOB functions from the COmparing COntinuous Optimizers (COCO) platform, we propose in…

Machine Learning · Computer Science 2023-06-21 Diederick Vermetten , Furong Ye , Thomas Bäck , Carola Doerr

The impracticality of posterior sampling has prevented the widespread adoption of spike-and-slab priors in high-dimensional applications. To alleviate the computational burden, optimization strategies have been proposed that quickly find…

Methodology · Statistics 2021-03-30 Lizhen Nie , Veronika Ročková

Operator splitting methods solve composite optimization problems by breaking them into smaller sub-problems that can be solved sequentially or in parallel. In this paper, we propose a unified framework for certifying both linear and…

Optimization and Control · Mathematics 2019-10-25 Han Wang , Mahyar Fazlyab , Shaoru Chen , Victor M. Preciado

The stable marriage problem with incomplete lists and ties (SMTI) and the hospitals/residents problem with ties (HRT) are important in matching theory with broad practical applications. In this paper, we introduce a tie-breaking based local…

Data Structures and Algorithms · Computer Science 2025-08-26 Junyuan Qiu

Longitudinal Multiple Sclerosis Lesion Segmentation is a particularly challenging problem that involves both input and output imbalance in the data and segmentation. Therefore in order to develop models that are practical, one of the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Dayan Perera , Ting Fung Fung , Vishnu Monn

Benchmarking is a key aspect of research into optimization algorithms, and as such the way in which the most popular benchmark suites are designed implicitly guides some parts of algorithm design. One of these suites is the black-box…

Neural and Evolutionary Computing · Computer Science 2022-11-30 Fu Xing Long , Diederick Vermetten , Bas van Stein , Anna V. Kononova

In this paper, a new video super-resolution reconstruction (SRR) method with improved robustness to outliers is proposed. Although the R-LMS is one of the SRR algorithms with the best reconstruction quality for its computational cost, and…

Computer Vision and Pattern Recognition · Computer Science 2018-08-21 Ricardo Augusto Borsoi , Guilherme Holsbach Costa , José Carlos Moreira Bermudez

Tensor decompositions play a crucial role in numerous applications related to multi-way data analysis. By employing a Bayesian framework with sparsity-inducing priors, Bayesian Tensor Ring (BTR) factorization offers probabilistic estimates…

Machine Learning · Computer Science 2024-12-05 Zerui Tao , Toshihisa Tanaka , Qibin Zhao

In many hierarchical inverse problems, not only do we want to estimate high- or infinite-dimensional model parameters in the parameter-to-observable maps, but we also have to estimate hyperparameters that represent critical assumptions in…

Computation · Statistics 2020-02-18 Johnathan Bardsley , Tiangang Cui

The purpose of this work is to introduce a new idea of how to avoid the factorization of large matrices during the solution of stiff systems of ODEs. Starting from the general form of an explicit linear multistep method we suggest to…

Numerical Analysis · Mathematics 2019-08-22 Boris Faleichik

Distributional shifts pose a significant challenge to achieving robustness in contemporary machine learning. To overcome this challenge, robust satisficing (RS) seeks a robust solution to an unspecified distributional shift while achieving…

Machine Learning · Computer Science 2023-08-17 Artun Saday , Yaşar Cahit Yıldırım , Cem Tekin

Bayesian optimization (BO) is a powerful class of algorithms for optimizing expensive black-box functions, but designing effective BO algorithms remains a manual, expertise-driven task. Recent advancements in Large Language Models (LLMs)…

Machine Learning · Computer Science 2025-05-28 Wenhu Li , Niki van Stein , Thomas Bäck , Elena Raponi

Bayesian Optimization (BO) is a widely used approach for blackbox optimization that leverages a Gaussian process (GP) model and an acquisition function to guide future sampling. While effective in low-dimensional settings, BO faces…

Machine Learning · Computer Science 2025-11-26 Pavankumar Koratikere , Leifur Leifsson

Extracting bounds on BSM operators at hadron colliders can be a highly non-trivial task. It can be useful or, depending on the complexity of the event structure, even essential to employ modern analysis techniques in order to measure…

High Energy Physics - Phenomenology · Physics 2024-08-01 Philipp Englert

Multi-user schedulers are designed to achieve optimal average system utility (e.g. throughput) subject to a set of fairness criteria. In this work, scheduling under temporal fairness constraints is considered. Prior works have shown that a…

Signal Processing · Electrical Eng. & Systems 2020-01-22 Farhad Shirani , Shahram Shahsavari , Elza Erkip

Meshless methods approximate operators in a specific node as a weighted sum of values in its neighbours. Higher order approximations of derivatives provide more accurate solutions with better convergence characteristics, but they come at…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-12 Jon Vehovar , Miha Rot , Gregor Kosec

A MATLAB implementation of the More-Sorensen sequential (MSS) method is presented. The MSS method computes the minimizer of a quadratic function defined by a limited-memory BFGS matrix subject to a two-norm trust-region constraint. This…

Numerical Analysis · Mathematics 2013-07-17 Jennifer B. Erway , Roummel F. Marcia

In this paper, we consider asymptotic properties of the support vector machine (SVM) in high-dimension, low-sample-size (HDLSS) settings. We show that the hard-margin linear SVM holds a consistency property in which misclassification rates…

Machine Learning · Statistics 2017-02-28 Yugo Nakayama , Kazuyoshi Yata , Makoto Aoshima

A new feature selection method based on kernelized fuzzy rough sets (KFRS) and the memetic algorithm (MA) is proposed for transient stability assessment of power systems. Considering the possible real-time information provided by wide-area…

Signal Processing · Electrical Eng. & Systems 2018-08-29 Xueping Gu , Yang Li , Jinghua Jia