English
Related papers

Related papers: Exploring Large Action Sets with Hyperspherical Em…

200 papers

In the last decade, exponential data growth supplied machine learning-based algorithms' capacity and enabled their usage in daily-life activities. Additionally, such an improvement is partially explained due to the advent of deep learning…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Mateus Roder , Jurandy Almeida , Gustavo H. de Rosa , Leandro A. Passos , André L. D. Rossi , João P. Papa

Understanding and modeling animal behavior is essential for studying collective motion, decision-making, and bio-inspired robotics. Yet, evaluating the accuracy of behavioral models still often relies on offline comparisons to static…

Robotics · Computer Science 2026-05-20 Mathis Hocke , Andreas Gerken , David Bierbach , Jens Krause , Tim Landgraf

Machine learning is a powerful tool for extracting valuable information and making various predictions from diverse datasets. Traditional machine learning algorithms rely on well-defined input and output variables; however, there are…

Machine Learning · Computer Science 2025-02-05 Anh T. Hoang , Zsolt J. Viharos

Metric-based few-shot learning methods try to overcome the difficulty due to the lack of training examples by learning embedding to make comparison easy. We propose a novel algorithm to generate class representatives for few-shot…

Machine Learning · Computer Science 2019-06-06 Junyoung Park , Subin Yi , Yongseok Choi , Dong-Yeon Cho , Jiwon Kim

While reinforcement learning has achieved considerable successes in recent years, state-of-the-art models are often still limited by the size of state and action spaces. Model-free reinforcement learning approaches use some form of state…

Machine Learning · Computer Science 2021-08-23 Paul J. Pritz , Liang Ma , Kin K. Leung

Vertical federated learning has garnered significant attention as it allows clients to train machine learning models collaboratively without sharing local data, which protects the client's local private data. However, existing VFL methods…

Machine Learning · Computer Science 2025-07-16 Shuo Wang , Keke Gai , Jing Yu , Liehuang Zhu , Kim-Kwang Raymond Choo , Bin Xiao

Deep reinforcement learning has achieved great strides in solving challenging motion control tasks. Recently, there has been significant work on methods for exploiting the data gathered during training, but there has been less work on how…

Artificial Intelligence · Computer Science 2018-04-13 Glen Berseth , Michiel van de Panne

Although exploration in reinforcement learning is well understood from a theoretical point of view, provably correct methods remain impractical. In this paper we study the interplay between exploration and approximation, what we call…

Machine Learning · Computer Science 2019-01-25 Adrien Ali Taïga , Aaron Courville , Marc G. Bellemare

The multi-step sampling mechanism, a key feature of visual diffusion models, has significant potential to replicate the success of OpenAI's Strawberry in enhancing performance by increasing the inference computational cost. Sufficient prior…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Shitong Shao , Zikai Zhou , Lichen Bai , Haoyi Xiong , Zeke Xie

In reinforcement learning, the state of the real world is often represented by feature vectors. However, not all of the features may be pertinent for solving the current task. We propose Feature Selection Explore and Exploit (FS-EE), an…

Machine Learning · Computer Science 2017-03-13 Zhaohan Daniel Guo , Emma Brunskill

This study leverages the data representation capability of fuzzy based membership-mappings for practical secure distributed deep learning using fully homomorphic encryption. The impracticality issue of secure machine (deep) learning with…

Machine Learning · Computer Science 2022-04-13 Mohit Kumar , Weiping Zhang , Lukas Fischer , Bernhard Freudenthaler

Flow-matching-based policies have recently emerged as a promising approach for learning-based robot manipulation, offering significant acceleration in action sampling compared to diffusion-based policies. However, conventional flow-matching…

Robotics · Computer Science 2025-10-03 Xuanran Zhai , Qianyou Zhao , Qiaojun Yu , Ce Hao

We are witnessing significant progress on perception models, specifically those trained on large-scale internet images. However, efficiently generalizing these perception models to unseen embodied tasks is insufficiently studied, which will…

Robotics · Computer Science 2023-03-21 Ya Jing , Tao Kong

Learning complex robot behavior through interactions with the environment necessitates principled exploration. Effective strategies should prioritize exploring regions of the state-action space that maximize rewards, with optimistic…

Machine Learning · Computer Science 2025-03-12 Jasmine Bayrooti , Carl Henrik Ek , Amanda Prorok

This paper considers statistical estimation problems where the probability distribution of the observed random variable is invariant with respect to actions of a finite topological group. It is shown that any such distribution must satisfy…

Machine Learning · Statistics 2015-06-23 Yu-Hui Chen , Dennis Wei , Gregory Newstadt , Marc DeGraef , Jeffrey Simmons , Alfred Hero

With the rapid deployment of SCADA systems, how to effectively analyze industrial signals and detect abnormal states is an urgent need for the industry. Due to the significant heterogeneity of these signals, which we summarize as the M5…

High-dimensional observations and complex real-world dynamics present major challenges in reinforcement learning for both function approximation and exploration. We address both of these challenges with two complementary techniques: First,…

Artificial Intelligence · Computer Science 2016-03-15 David Abel , Alekh Agarwal , Fernando Diaz , Akshay Krishnamurthy , Robert E. Schapire

Reinforcement learning algorithms struggle when the reward signal is very sparse. In these cases, naive random exploration methods essentially rely on a random walk to stumble onto a rewarding state. Recent works utilize intrinsic…

Machine Learning · Computer Science 2019-06-14 Hyoungseok Kim , Jaekyeom Kim , Yeonwoo Jeong , Sergey Levine , Hyun Oh Song

Training medical image segmentation models usually requires a large amount of labeled data. By contrast, humans can quickly learn to accurately recognise anatomy of interest from medical (e.g. MRI and CT) images with some limited guidance.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Xiao Liu , Spyridon Thermos , Pedro Sanchez , Alison Q. O'Neil , Sotirios A. Tsaftaris

Flow and diffusion models are typically pre-trained on limited available data (e.g., molecular samples), covering only a fraction of the valid design space (e.g., the full molecular space). As a consequence, they tend to generate samples…

Machine Learning · Computer Science 2026-02-19 Riccardo De Santi , Kimon Protopapas , Ya-Ping Hsieh , Andreas Krause