English
Related papers

Related papers: Policy Manifold Search for Improving Diversity-bas…

200 papers

Neural models learn representations of high-dimensional data on low-dimensional manifolds. Multiple factors, including stochasticities in the training process, model architectures, and additional inductive biases, may induce different…

Machine Learning · Computer Science 2025-12-02 Hanlin Yu , Berfin Inal , Georgios Arvanitidis , Soren Hauberg , Francesco Locatello , Marco Fumero

Generative networks have shown remarkable success in learning complex data distributions, particularly in generating high-dimensional data from lower-dimensional inputs. While this capability is well-documented empirically, its theoretical…

Machine Learning · Computer Science 2025-04-02 Kevin Wang , Hongqian Niu , Yixin Wang , Didong Li

High-quality data accumulation is now becoming ubiquitous in the health domain. There is increasing opportunity to exploit rich data from normal subjects to improve supervised estimators in specific diseases with notorious data scarcity. We…

Machine Learning · Computer Science 2021-10-13 Marc-Andre Schulz , Bertrand Thirion , Alexandre Gramfort , Gaël Varoquaux , Danilo Bzdok

The use of deep neural networks as function approximators has led to striking progress for reinforcement learning algorithms and applications. Yet the knowledge we have on decision boundary geometry and the loss landscape of neural policies…

Machine Learning · Computer Science 2021-12-17 Ezgi Korkmaz

Neuroevolution, a field that draws inspiration from the evolution of brains in nature, harnesses evolutionary algorithms to construct artificial neural networks. It bears a number of intriguing capabilities that are typically inaccessible…

Quantum Physics · Physics 2021-11-03 Zhide Lu , Pei-Xin Shen , Dong-Ling Deng

Despite the fact that nonlinear subspace learning techniques (e.g. manifold learning) have successfully applied to data representation, there is still room for improvement in explainability (explicit mapping), generalization…

Machine Learning · Computer Science 2018-08-16 Danfeng Hong , Naoto Yokoya , Jian Xu , Xiaoxiang Zhu

In recent years, manifold learning has become increasingly popular as a tool for performing non-linear dimensionality reduction. This has led to the development of numerous algorithms of varying degrees of complexity that aim to recover man…

Machine Learning · Statistics 2013-06-03 Dominique Perraul-Joncas , Marina Meila

For applications in healthcare, physics, energy, robotics, and many other fields, designing maximally informative experiments is valuable, particularly when experiments are expensive, time-consuming, or pose safety hazards. While existing…

Machine Learning · Computer Science 2022-03-09 Vincent Lim , Ellen Novoseller , Jeffrey Ichnowski , Huang Huang , Ken Goldberg

Deep neural networks (DNNs) have achieved remarkable success in computer vision; however, training DNNs for satisfactory performance remains challenging and suffers from sensitivity to empirical selections of an optimization algorithm for…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Haichao Zhang , Kuangrong Hao , Lei Gao , Bing Wei , Xuesong Tang

Active search formalizes a specialized active learning setting where the goal is to collect members of a rare, valuable class. The state-of-the-art algorithm approximates the optimal Bayesian policy in a budget-aware manner, and has been…

Machine Learning · Computer Science 2024-05-27 Quan Nguyen , Anindya Sarkar , Roman Garnett

In this paper we present a fully Bayesian latent variable model which exploits conditional nonlinear(in)-dependence structures to learn an efficient latent representation. The latent space is factorized to represent shared and private…

Machine Learning · Computer Science 2012-06-22 Andreas Damianou , Carl Ek , Michalis Titsias , Neil Lawrence

Neuroevolutionary algorithms, automatic searches of neural network structures by means of evolutionary techniques, are computationally costly procedures. In spite of this, due to the great performance provided by the architectures which are…

Neural and Evolutionary Computing · Computer Science 2021-05-28 Unai Garciarena , Nuno Lourenço , Penousal Machado , Roberto Santana , Alexander Mendiburu

Unsupervised fault detection in multivariate time series plays a vital role in ensuring the stable operation of complex systems. Traditional methods often assume that normal data follow a single Gaussian distribution and identify anomalies…

Machine Learning · Computer Science 2025-07-01 Hong Liu , Xiuxiu Qiu , Yiming Shi , Miao Xu , Zelin Zang , Zhen Lei

We introduce a novel co-design method for autonomous moving agents' shape attributes and locomotion by combining deep reinforcement learning and evolution with user control. Our main inspiration comes from evolution, which has led to wide…

Artificial Intelligence · Computer Science 2022-05-24 Zhiquan Wang , Bedrich Benes , Ahmed H. Qureshi , Christos Mousas

Neuroevolution has greatly promoted Deep Neural Network (DNN) architecture design and its applications, while there is a lack of methods available across different DNN types concerning both their scale and performance. In this study, we…

Neural and Evolutionary Computing · Computer Science 2023-02-03 Zhenhao Shuai , Hongbo Liu , Zhaolin Wan , Wei-Jie Yu , Jun Zhang

While the field of Quality-Diversity (QD) has grown into a distinct branch of stochastic optimization, a few problems, in particular locomotion and navigation tasks, have become de facto standards. Are such benchmarks sufficient? Are they…

Machine Learning · Computer Science 2022-05-09 Achkan Salehi , Stephane Doncieux

Deep learning with Convolutional Neural Networks has shown great promise in various areas of image-based classification and enhancement but is often unsuitable for predictive modeling involving non-image based features or features without…

Machine Learning · Computer Science 2020-09-02 Omid Bazgir , Ruibo Zhang , Saugato Rahman Dhruba , Raziur Rahman , Souparno Ghosh , Ranadip Pal

We present a novel view of nonlinear manifold learning using derivative-free optimization techniques. Specifically, we propose an extension of the classical multi-dimensional scaling (MDS) method, where instead of performing gradient…

Reinforcement learning (RL) aims to find an optimal policy by interaction with an environment. Consequently, learning complex behavior requires a vast number of samples, which can be prohibitive in practice. Nevertheless, instead of…

Machine Learning · Computer Science 2021-11-23 Sarah Müller , Alexander von Rohr , Sebastian Trimpe

Reinforcement learning (RL) with sparse and deceptive rewards is challenging because non-zero rewards are rarely obtained. Hence, the gradient calculated by the agent can be stochastic and without valid information. Recent studies that…

Machine Learning · Computer Science 2024-02-08 Guojian Wang , Faguo Wu , Xiao Zhang , Jianxiang Liu