English
Related papers

Related papers: Hyper-Heuristics Can Profit From Global Variation …

200 papers

Hamiltonian Monte Carlo (HMC) is a very popular and generic collection of Markov chain Monte Carlo (MCMC) algorithms. One explanation for the popularity of HMC algorithms is their excellent performance as the dimension $d$ of the target…

Probability · Mathematics 2018-09-05 Oren Mangoubi , Natesh S. Pillai , Aaron Smith

This work studies online episodic tabular Markov decision processes (MDPs) with known transitions and develops best-of-both-worlds algorithms that achieve refined data-dependent regret bounds in the adversarial regime and variance-dependent…

Machine Learning · Computer Science 2026-02-03 Mingyi Li , Taira Tsuchiya , Kenji Yamanishi

Heuristic functions are essential to the performance of tree search algorithms such as A*, where their accuracy and efficiency directly impact search outcomes. Traditionally, such heuristics are handcrafted, requiring significant expertise.…

Artificial Intelligence · Computer Science 2026-01-28 Thomas Bömer , Nico Koltermann , Max Disselnmeyer , Bastian Amberg , Anne Meyer

We consider the problem of learning graphical models, also known as Markov random fields (MRFs) from temporally correlated samples. As in many traditional statistical settings, fundamental results in the area all assume independent samples…

Machine Learning · Computer Science 2024-11-05 Jason Gaitonde , Ankur Moitra , Elchanan Mossel

The search for traveltime parameters is a global optimization problem. Several metaheuristics have been proposed to locate the global optima to compute the least amount of their objective functions. However, the theoretical limitations…

Geophysics · Physics 2023-04-25 José Ribeiro , Nicholas Okita , Tiago A. Coimbra , Jorge H. Faccipieri

We introduce data-driven decision-making algorithms that achieve state-of-the-art \emph{dynamic regret} bounds for non-stationary bandit settings. These settings capture applications such as advertisement allocation, dynamic pricing, and…

Machine Learning · Computer Science 2021-03-19 Wang Chi Cheung , David Simchi-Levi , Ruihao Zhu

Since their introduction, anchoring methods in extragradient-type saddlepoint problems have inspired a flurry of research due to their ability to provide order-optimal rates of accelerated convergence in very general problem settings. Such…

Optimization and Control · Mathematics 2025-06-10 James Alcala , Yat Tin Chow , Mahesh Sunkula

The major difficulty in Multi-objective Optimization Evolutionary Algorithms (MOEAs) is how to find an appropriate solution that is able to converge towards the true Pareto Front with high diversity. Most existing methodologies, which have…

Optimization and Control · Mathematics 2020-04-30 Jeisson Prieto , Jonatan Gomez

In this work, we extend the hybrid Chernoff tau-leap method to the multilevel Monte Carlo (MLMC) setting. Inspired by the work of Anderson and Higham on the tau-leap MLMC method with uniform time steps, we develop a novel algorithm that is…

Numerical Analysis · Mathematics 2014-11-24 Alvaro Moraes , Raul Tempone , Pedro Vilanova

Evolutionary algorithms (EAs) serve as powerful black-box optimizers inspired by biological evolution. However, most existing EAs predominantly focus on heuristic operators such as crossover and mutation, while usually overlooking…

Neural and Evolutionary Computing · Computer Science 2026-01-21 Kaichen Ouyang , Mingyang Yu , Zong Ke , Junbo Jacob Lian , Shengwei Fu , Xiaoyang Hao , Shengju Yu , Dayu Hu

Evolutionary algorithms (EAs) are population-based general-purpose optimization algorithms, and have been successfully applied in various real-world optimization tasks. However, previous theoretical studies often employ EAs with only a…

Neural and Evolutionary Computing · Computer Science 2016-06-13 Chao Qian , Yang Yu , Zhi-Hua Zhou

The prevalence of variational methods in near-term quantum computing makes optimizer choice critical, yet selection is frequently intuition-based. We therefore present a systematic benchmark of eight classical optimization algorithms for…

Quantum Physics · Physics 2026-01-23 S. Illésová , V. Novák , T. Bezděk , C. Possel , M. Beseda

We revisit the \emph{leaderboard problem} introduced by Blum and Hardt (2015) in an effort to reduce overfitting in machine learning benchmarks. We show that a randomized version of their Ladder algorithm achieves leaderboard error…

Machine Learning · Computer Science 2017-06-12 Moritz Hardt

We study the multi-objective minimum weight base problem, an abstraction of classical NP-hard combinatorial problems such as the multi-objective minimum spanning tree problem. We prove some important properties of the convex hull of the…

Artificial Intelligence · Computer Science 2023-06-07 Anh Viet Do , Aneta Neumann , Frank Neumann , Andrew M. Sutton

We study the Hamiltonian flow for optimization (HF-opt), which simulates the Hamiltonian dynamics for some integration time and resets the velocity to $0$ to decrease the objective function; this is the optimization analogue of the…

Optimization and Control · Mathematics 2025-09-19 Qiang Fu , Andre Wibisono

Human mobility prediction is crucial for applications ranging from location-based recommendations to urban planning, which aims to forecast users' next location visits based on historical trajectories. While existing mobility prediction…

Artificial Intelligence · Computer Science 2026-03-03 Yu Wang , Junshu Dai , Yuchen Ying , Hanyang Yuan , Zunlei Feng , Tongya Zheng , Mingli Song

Metaheuristic algorithms are often nature-inspired, and they are becoming very powerful in solving global optimization problems. More than a dozen of major metaheuristic algorithms have been developed over the last three decades, and there…

Optimization and Control · Mathematics 2011-05-19 Xin-She Yang

Most of the real-world problems are multimodal in nature that consists of multiple optimum values. Multimodal optimization is defined as the process of finding multiple global and local optima (as opposed to a single solution) of a…

Neural and Evolutionary Computing · Computer Science 2022-08-24 Shatendra Singh , Aruna Tiwari

The compact Genetic Algorithm (cGA), parameterized by its hypothetical population size $K$, offers a low-memory alternative to evolving a large offspring population of solutions. It evolves a probability distribution, biasing it towards…

Neural and Evolutionary Computing · Computer Science 2024-04-19 Cella Florescu , Marc Kaufmann , Johannes Lengler , Ulysse Schaller

Theory of evolutionary computation (EC) aims at providing mathematically founded statements about the performance of evolutionary algorithms (EAs). The predominant topic in this research domain is runtime analysis, which studies the time it…

Neural and Evolutionary Computing · Computer Science 2018-12-04 Eduardo Carvalho Pinto , Carola Doerr