English
Related papers

Related papers: Policy Manifold Search for Improving Diversity-bas…

200 papers

In Quality-Diversity (QD) algorithms, which evolve a behaviourally diverse archive of high-performing solutions, the behaviour space is a difficult design choice that should be tailored to the target application. In QD meta-evolution, one…

Neural and Evolutionary Computing · Computer Science 2024-01-08 David M. Bossens , Danesh Tarapore

When using Quality Diversity (QD) optimization to solve hard exploration or deceptive search problems, we assume that diversity is extrinsically valuable. This means that diversity is important to help us reach an objective, but is not an…

Neural and Evolutionary Computing · Computer Science 2023-05-16 Ryan Boldi , Lee Spector

Finding different solutions to the same problem is a key aspect of intelligence associated with creativity and adaptation to novel situations. In reinforcement learning, a set of diverse policies can be useful for exploration, transfer,…

Artificial Intelligence · Computer Science 2023-02-06 Tom Zahavy , Yannick Schroecker , Feryal Behbahani , Kate Baumli , Sebastian Flennerhag , Shaobo Hou , Satinder Singh

In this work, we provide an extended discussion of a new approach to explainable Reinforcement Learning called Diverse Near-Optimal Alternatives (DNA), first proposed at L4DC 2025. DNA seeks a set of reasonable "options" for…

Machine Learning · Computer Science 2025-06-12 Noel Brindise , Vijeth Hebbar , Riya Shah , Cedric Langbort

Massive practical works addressed by Deep Q-network (DQN) algorithm have indicated that stochastic policy, despite its simplicity, is the most frequently used exploration approach. However, most existing stochastic exploration approaches…

Machine Learning · Computer Science 2022-06-22 Wenhui Huang , Cong Zhang , Jingda Wu , Xiangkun He , Jie Zhang , Chen Lv

Training generally capable agents that thoroughly explore their environment and learn new and diverse skills is a long-term goal of robot learning. Quality Diversity Reinforcement Learning (QD-RL) is an emerging research area that blends…

Machine Learning · Computer Science 2024-01-31 Sumeet Batra , Bryon Tjanaka , Matthew C. Fontaine , Aleksei Petrenko , Stefanos Nikolaidis , Gaurav Sukhatme

Quality-Diversity algorithms provide efficient mechanisms to generate large collections of diverse and high-performing solutions, which have shown to be instrumental for solving downstream tasks. However, most of those algorithms rely on a…

Neural and Evolutionary Computing · Computer Science 2022-04-22 Luca Grillotti , Antoine Cully

Quality-Diversity (QD) algorithms can discover large and complex behavioural repertoires consisting of both diverse and high-performing skills. However, the generation of behavioural repertoires has mainly been limited to simulation…

Machine Learning · Computer Science 2022-07-12 Bryan Lim , Alexander Reichenbach , Antoine Cully

Conjoint experiments randomize multidimensional profiles, offering a powerful design for recovering structural preference parameters -- including marginal rates of substitution, willingness to pay, and the distribution of preferences across…

Methodology · Statistics 2026-05-26 Avidit Acharya , Jens Hainmueller , Yiqing Xu

Precision medicine aims to tailor therapeutic decisions to individual patient characteristics. This objective is commonly formalized through dynamic treatment regimes, which use statistical and machine learning methods to derive sequential…

Machine Learning · Statistics 2026-03-23 Sophia Yazzourh , Erica E. M. Moodie

Quality-Diversity (QD) algorithms have emerged as a powerful optimization paradigm with the aim of generating a set of high-quality and diverse solutions. To achieve such a challenging goal, QD algorithms require maintaining a large archive…

Machine Learning · Computer Science 2024-06-07 Ren-Jian Wang , Ke Xue , Cong Guan , Chao Qian

Policy gradient methods hold great potential for solving complex continuous control tasks. Still, their training efficiency can be improved by exploiting structure within the optimization problem. Recent work indicates that supervised…

Machine Learning · Computer Science 2024-03-19 Jan Schneider , Pierre Schumacher , Simon Guist , Le Chen , Daniel Häufle , Bernhard Schölkopf , Dieter Büchler

Guided policy search algorithms can be used to optimize complex nonlinear policies, such as deep neural networks, without directly computing policy gradients in the high-dimensional parameter space. Instead, these methods use supervised…

Machine Learning · Computer Science 2016-07-18 William Montgomery , Sergey Levine

Deep neuroevolution and deep reinforcement learning (deep RL) algorithms are two popular approaches to policy search. The former is widely applicable and rather stable, but suffers from low sample efficiency. By contrast, the latter is more…

Machine Learning · Computer Science 2019-02-12 Aloïs Pourchot , Olivier Sigaud

Learning algorithms are being increasingly adopted in various applications. However, further expansion will require methods that work more automatically. To enable this level of automation, a more powerful solution representation is needed.…

Neural and Evolutionary Computing · Computer Science 2019-02-19 Danilo Vasconcellos Vargas , Junichi Murata

In this work we introduce a manifold learning-based method for uncertainty quantification (UQ) in systems describing complex spatiotemporal processes. Our first objective is to identify the embedding of a set of high-dimensional data…

Data Analysis, Statistics and Probability · Physics 2022-05-18 Katiana Kontolati , Dimitrios Loukrezis , Ketson R. M. dos Santos , Dimitrios G. Giovanis , Michael D. Shields

It has long been assumed that high dimensional continuous control problems cannot be solved effectively by discretizing individual dimensions of the action space due to the exponentially large number of bins over which policies would have…

Machine Learning · Computer Science 2019-06-11 Luke Metz , Julian Ibarz , Navdeep Jaitly , James Davidson

Causal inference explores the causation between actions and the consequent rewards on a covariate set. Recently deep learning has achieved a remarkable performance in causal inference, but existing statistical theories cannot well explain…

Machine Learning · Computer Science 2020-11-04 Minshuo Chen , Hao Liu , Wenjing Liao , Tuo Zhao

Deep neural policies have recently been installed in a diverse range of settings, from biotechnology to automated financial systems. However, the utilization of deep neural networks to approximate the value function leads to concerns on the…

Machine Learning · Computer Science 2024-06-26 Ezgi Korkmaz

Recent developments in experimental neuroscience make it possible to simultaneously record the activity of thousands of neurons. However, the development of analysis approaches for such large-scale neural recordings have been slower than…

Neurons and Cognition · Quantitative Biology 2022-10-18 Rufus Mitchell-Heggs , Seigfred Prado , Giuseppe P. Gava , Mary Ann Go , Simon R. Schultz