English
Related papers

Related papers: Fast and stable MAP-Elites in noisy domains using …

200 papers

Best subset selection is considered the `gold standard' for many sparse learning problems. A variety of optimization techniques have been proposed to attack this non-smooth non-convex problem. In this paper, we investigate the dual forms of…

Machine Learning · Computer Science 2024-12-31 Shaogang Ren , Xiaoning Qian

Dynamic graph clustering aims to detect and track time-varying clusters in dynamic graphs, revealing the evolutionary mechanisms of complex real-world dynamic systems. Matrix factorization-based methods are promising approaches for this…

Machine Learning · Computer Science 2025-02-11 Dongyuan Li , Satoshi Kosugi , Ying Zhang , Manabu Okumura , Feng Xia , Renhe Jiang

It is known that evolution strategies in continuous domains might not converge in the presence of noise. It is also known that, under mild assumptions, and using an increasing number of resamplings, one can mitigate the effect of additive…

Optimization and Control · Mathematics 2014-04-10 Marie-Liesse Cauwet

Active domain adaptation has emerged as a solution to balance the expensive annotation cost and the performance of trained models in semantic segmentation. However, existing works usually ignore the correlation between selected samples and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Shizhan Liu , Zhengkai Jiang , Yuxi Li , Jinlong Peng , Yabiao Wang , Weiyao Lin

Optimization is essential in deep learning. The foundational method upon which most optimizers are built is momentum-based stochastic gradient descent. However, it suffers from two key drawbacks. First, it has noisy and varying gradients,…

Machine Learning · Computer Science 2026-05-22 Saurabh Saini , Kapil Ahuja , Thomas Wick , Saurav Kumar

We present an empirical study of a range of evolutionary algorithms applied to various noisy combinatorial optimisation problems. There are three sets of experiments. The first looks at several toy problems, such as OneMax and other linear…

Neural and Evolutionary Computing · Computer Science 2023-04-05 Aishwaryaprajna , Jonathan E. Rowe

Label noise in training data can significantly degrade a model's generalization performance for supervised learning tasks. Here we focus on the problem that noisy labels are primarily mislabeled samples, which tend to be concentrated near…

Machine Learning · Computer Science 2021-03-16 Hao-Chiang Shao , Hsin-Chieh Wang , Weng-Tai Su , Chia-Wen Lin

Dynamic mode decomposition (DMD) is an efficient tool for decomposing spatio-temporal data into a set of low-dimensional modes, yielding the oscillation frequencies and the growth rates of physically significant modes. In this paper, we…

Dynamical Systems · Mathematics 2023-02-21 Minwoo Lee , Jongho Park

We consider distributed optimization under communication constraints for training deep learning models. We propose a new algorithm, whose parameter updates rely on two forces: a regular gradient step, and a corrective direction dictated by…

Machine Learning · Computer Science 2022-04-29 Yunfei Teng , Wenbo Gao , Francois Chalus , Anna Choromanska , Donald Goldfarb , Adrian Weller

Autonomous driving in multi-agent dynamic traffic scenarios is challenging: the behaviors of road users are uncertain and are hard to model explicitly, and the ego-vehicle should apply complicated negotiation skills with them, such as…

Robotics · Computer Science 2022-06-22 Peide Cai , Hengli Wang , Yuxiang Sun , Ming Liu

Noise on near-term quantum devices will inevitably limit the performance of Quantum Approximate Optimization Algorithm (QAOA). One significant consequence is that the performance of QAOA may fail to monotonically improve with depth. In…

Quantum Physics · Physics 2022-07-12 Yu Pan , Yifan Tong , Shibei Xue , Guofeng Zhang

High-dimensional simulation optimization is notoriously challenging. We propose a new sampling algorithm that converges to a global optimal solution and suffers minimally from the curse of dimensionality. The algorithm consists of two…

Machine Learning · Statistics 2021-07-21 Liang Ding , Rui Tuo , Xiaowei Zhang

Noise suppression (NS) models have been widely applied to enhance speech quality. Recently, Deep Learning-Based NS, which we denote as Deep Noise Suppression (DNS), became the mainstream NS method due to its excelling performance over…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-13 Yixin Wan , Yuan Zhou , Xiulian Peng , Kai-Wei Chang , Yan Lu

The design space of networked embedded systems is very large, posing challenges to the optimisation of such platforms when it comes to support applications with real-time guarantees. Recent research has shown that a number of inter-related…

Performance · Computer Science 2020-07-21 Leandro Soares Indrusiak , Robert I. Davis , Piotr Dziurzanski

Topological data analysis leverages topological features to analyze datasets, with applications in diverse fields like medical sciences and biology. A key tool of this theory is the persistence diagram, which encodes topological information…

Algebraic Topology · Mathematics 2024-10-22 Michael Etienne Van Huffel , Olympio Hacquard , Vadim Lebovici , Matteo Palo

We introduce a classical algorithm for sampling the output of shallow, noisy random circuits on two-dimensional qubit arrays. The algorithm builds on the recently-proposed "space-evolving block decimation" (SEBD) and extends it to the case…

Quantum Physics · Physics 2023-11-16 Zihan Cheng , Matteo Ippoliti

The test bench time needed for model-based calibration can be reduced with active learning methods for test design. This paper presents an improved strategy for active output selection. This is the task of learning multiple models in the…

Machine Learning · Computer Science 2021-01-12 Adrian Prochaska , Julien Pillas , Bernard Bäker

To reliably model real robot characteristics, interval linear systems of equations allow to describe families of problems that consider sets of values. This allows to easily account for typical complexities such as sets of joint states and…

Robotics · Computer Science 2021-04-02 Joshua Pickard , Vincent Padois , Milan Hladík , David Daney

Deep learning technologies have demonstrated remarkable effectiveness in a wide range of tasks, and deep learning holds the potential to advance a multitude of applications, including in edge computing, where deep models are deployed on…

Machine Learning · Computer Science 2022-08-24 Dalin Zhang , Kaixuan Chen , Yan Zhao , Bin Yang , Lina Yao , Christian S. Jensen

While stochastic gradient descent (SGD) is still the \emph{de facto} algorithm in deep learning, adaptive methods like Clipped SGD/Adam have been observed to outperform SGD across important tasks, such as attention models. The settings…

Optimization and Control · Mathematics 2020-10-26 Jingzhao Zhang , Sai Praneeth Karimireddy , Andreas Veit , Seungyeon Kim , Sashank J Reddi , Sanjiv Kumar , Suvrit Sra