English
Related papers

Related papers: A Stochastically Evolving Non-local Search and Sol…

200 papers

Numerous practical medical problems often involve data that possess a combination of both sparse and non-sparse structures. Traditional penalized regularizations techniques, primarily designed for promoting sparsity, are inadequate to…

Methodology · Statistics 2023-11-10 Shun Yu , Yuehan Yang

In many physical situations, there appears the problem of reaching a single target that is spatially distributed. Here we analyse how stochastic resetting, also spatially distributed, can be used to improve the search process when the…

Statistical Mechanics · Physics 2023-11-22 Gregorio García-Valladares , Carlos A. Plata , Antonio Prados , Alessandro Manacorda

Long time-duration low-thrust nonlinear optimal spacecraft trajectory global search is a computationally and time expensive problem characterized by clustering patterns in locally optimal solutions. During preliminary mission design,…

Systems and Control · Electrical Eng. & Systems 2025-11-24 Jannik Graebner , Ryne Beeson

Bayesian hierarchical models can provide efficient algorithms for finding sparse solutions to ill-posed inverse problems. The models typically comprise a conditionally Gaussian prior model for the unknown which is augmented by a generalized…

Numerical Analysis · Mathematics 2025-01-09 Jonathan Lindbloom , Jan Glaubitz , Anne Gelb

In this paper a novel stochastic optimization and extremum seeking algorithm is presented, one which is based on time-delayed random perturbations and step size adaptation. For the case of a one-dimensional quadratic unconstrained…

Optimization and Control · Mathematics 2024-10-29 Naum Dimitrieski , Michael Reyer , Mohamed-Ali Belabbas , Christian Ebenbauer

We present a novel local improvement scheme for the perfectly balanced graph partitioning problem. This scheme encodes local searches that are not restricted to a balance constraint into a model allowing us to find combinations of these…

Data Structures and Algorithms · Computer Science 2012-10-02 Peter Sanders , Christian Schulz

Sparse signal recovery from a small number of random measurements is a well known NP-hard to solve combinatorial optimization problem, with important applications in signal and image processing. The standard approach to the sparse signal…

Data Analysis, Statistics and Probability · Physics 2013-04-09 M. Andrecut

Large-scale sparse multi-objective optimization problems (LSMOPs) are prevalent in real-world applications, where optimal solutions typically contain only a few nonzero variables, such as in adversarial attacks, critical node detection, and…

Neural and Evolutionary Computing · Computer Science 2026-03-13 Shuai Shao , Yuhao Sun , Xing Chen , Ye Tian , Guan Wang , Jin Li

Searching large and complex design spaces for a global optimum can be infeasible and unnecessary. A practical alternative is to iteratively refine the neighborhood of an initial design using local optimization methods such as gradient…

Machine Learning · Computer Science 2025-11-25 David Stenger , Armin Lindicke , Alexander von Rohr , Sebastian Trimpe

As the size of modern data sets exceeds the disk and memory capacities of a single computer, machine learning practitioners have resorted to parallel and distributed computing. Given that optimization is one of the pillars of machine…

Machine Learning · Statistics 2019-12-10 Biyi Fang , Diego Klabjan

While optimizing convex objective (loss) functions has been a powerhouse for machine learning for at least two decades, non-convex loss functions have attracted fast growing interests recently, due to many desirable properties such as…

Machine Learning · Statistics 2018-02-14 Chao Qu , Yan Li , Huan Xu

We derive an efficient stochastic algorithm for inverse problems that present an unknown linear forcing term and a set of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of the problem is…

Numerical Analysis · Mathematics 2019-09-17 Darko Volkov

The demand for extracting rules from high dimensional real world data is increasing in various fields. However, the possible redundancy of such data sometimes makes it difficult to obtain a good generalization ability for novel samples. To…

Disordered Systems and Neural Networks · Physics 2009-11-11 Shinsuke Uda , Yoshiyuki Kabashima

We introduce an evolutionary stochastic-local-search (SLS) algorithm for addressing a generalized version of the so-called 1/V/D/R cutting-stock problem. Cutting-stock problems are encountered often in industrial environments and the…

Neural and Evolutionary Computing · Computer Science 2017-07-28 Georgios C. Chasparis , Michael Rossbory , Verena Haunschmid

We consider the sparse optimization problem with nonlinear constraints and an objective function, which is given by the sum of a general smooth mapping and an additional term defined by the $ \ell_0 $-quasi-norm. This term is used to obtain…

Optimization and Control · Mathematics 2022-10-19 Christian Kanzow , Alexandra Schwarz , Felix Weiß

This article deals with the spatio-temporal sensors deployment in order to maximize detection probability of an intelligent and randomly moving target in an area under surveillance. Our work is based on the rare events simulation framework.…

Neural and Evolutionary Computing · Computer Science 2017-02-24 Chouchane Mathieu , Paris Sébastien , Le Gland François , Ouladsine Mustapha

We develop parallel predictive entropy search (PPES), a novel algorithm for Bayesian optimization of expensive black-box objective functions. At each iteration, PPES aims to select a batch of points which will maximize the information gain…

Machine Learning · Computer Science 2015-11-24 Amar Shah , Zoubin Ghahramani

Stochastic optimization finds a wide range of applications in operations research and management science. However, existing stochastic optimization techniques usually require the information of random samples (e.g., demands in the…

Optimization and Control · Mathematics 2019-04-18 Xi Chen , Qihang Lin , Zizhuo Wang

In this work we are interested in stochastic particle methods for multi-objective optimization. The problem is formulated using parametrized, single-objective sub-problems which are solved simultaneously. To this end a consensus based…

Optimization and Control · Mathematics 2022-08-03 Giacomo Borghi , Michael Herty , Lorenzo Pareschi

Optimisation problems are ubiquitous in particle and astrophysics, and involve locating the optimum of a complicated function of many parameters that may be computationally expensive to evaluate. We describe a number of global optimisation…