English
Related papers

Related papers: Non-Myopic Active Feature Acquisition via Pathwise…

200 papers

Relevant and high-quality data are critical to successful development of machine learning applications. For machine learning applications on dynamic systems equipped with a large number of sensors, such as connected vehicles and robots, how…

Machine Learning · Computer Science 2021-08-31 Alp Sahin , Xiangrui Zeng

Policy Gradient (PG) algorithms are among the best candidates for the much-anticipated applications of reinforcement learning to real-world control tasks, such as robotics. However, the trial-and-error nature of these methods poses safety…

Machine Learning · Computer Science 2022-06-20 Matteo Papini , Matteo Pirotta , Marcello Restelli

Magnetic adhesion tracked wall-climbing robots face potential risks of overturning during high-altitude operations, making their stability crucial for ensuring safety. This study presents a dynamic feature selection method based on Proximal…

Robotics · Computer Science 2025-03-25 Zhen Ma , He Xu , Jielong Dou , Yi Qin , Xueyu Zhang

Solving partially observable Markov decision processes (POMDPs) remains a fundamental challenge in reinforcement learning (RL), primarily due to the curse of dimensionality induced by the non-stationarity of optimal policies. In this work,…

Optimization and Control · Mathematics 2025-10-20 Semih Cayci , Atilla Eryilmaz

Reinforcement learning considers the problem of finding policies that maximize an expected cumulative reward in a Markov decision process with unknown transition probabilities. In this paper we consider the problem of finding optimal…

Machine Learning · Computer Science 2020-10-19 Santiago Paternain , Juan Andres Bazerque , Alejandro Ribeiro

We propose a general framework for sequential and dynamic acquisition of useful information in order to solve a particular task. While our goal could in principle be tackled by general reinforcement learning, our particular setting is…

Machine Learning · Statistics 2016-02-09 He He , Paul Mineiro , Nikos Karampatziakis

Despite their success, large pretrained vision models remain vulnerable to catastrophic forgetting when adapted to new tasks in class-incremental settings. Parameter-efficient fine-tuning (PEFT) alleviates this by restricting trainable…

Machine Learning · Computer Science 2026-02-17 Yaqian Zhang , Bernhard Pfahringer , Eibe Frank , Albert Bifet

General-purpose, intelligent, learning agents cycle through sequences of observations, actions, and rewards that are complex, uncertain, unknown, and non-Markovian. On the other hand, reinforcement learning is well-developed for small…

Machine Learning · Computer Science 2009-12-30 Marcus Hutter

Learning agents that excel at sequential decision-making tasks must continuously resolve the problem of exploration and exploitation for optimal learning. However, such interactions with the environment online might be prohibitively…

Machine Learning · Computer Science 2024-12-30 Ambedkar Dukkipati , Ranga Shaarad Ayyagari , Bodhisattwa Dasgupta , Parag Dutta , Prabhas Reddy Onteru

To identify a stationary action profile for a population of competitive agents, each executing private strategies, we introduce a novel active-learning scheme where a centralized external observer (or entity) can probe the agents' reactions…

Systems and Control · Electrical Eng. & Systems 2024-10-10 Filippo Fabiani , Alberto Bemporad

Model selection is treated as a standard performance boosting step in many machine learning applications. Once all other properties of a learning problem are fixed, the model is selected by grid search on a held-out validation set. This is…

Machine Learning · Statistics 2019-06-28 Manuel Haussmann , Fred A. Hamprecht , Melih Kandemir

Recent studies reveal that Convolutional Neural Networks (CNNs) are typically vulnerable to adversarial attacks, which pose a threat to security-sensitive applications. Many adversarial defense methods improve robustness at the cost of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Tao Wang , Ruixin Zhang , Xingyu Chen , Kai Zhao , Xiaolin Huang , Yuge Huang , Shaoxin Li , Jilin Li , Feiyue Huang

We propose Adaptive Multi-Scale Goodness Aggregation (AMSGA), a novel extension of the Forward-Forward (FF) algorithm designed to improve stability, robustness, and generalization in local-learning neural networks. AMSGA addresses several…

Machine Learning · Computer Science 2026-05-20 Salar Beigzad , Vansh Verma

In recent years several learning approaches to point goal navigation in previously unseen environments have been proposed. They vary in the representations of the environments, problem decomposition, and experimental evaluation. In this…

Robotics · Computer Science 2022-12-20 Yimeng Li , Arnab Debnath , Gregory J. Stein , Jana Kosecka

Policy gradient is a generic and flexible reinforcement learning approach that generally enjoys simplicity in analysis, implementation, and deployment. In the last few decades, this approach has been extensively advanced for fully…

Machine Learning · Computer Science 2020-05-26 Kamyar Azizzadenesheli , Yisong Yue , Animashree Anandkumar

Active learning (AL) is a machine learning (ML) approach that strategically selects the most informative samples for annotation during training, aiming to minimize annotation costs. This strategy not only reduces labeling expenses but also…

Machine Learning · Computer Science 2026-03-25 Cédric Jung , Shirin Salehi , Anke Schmeink

Slow Feature Analysis is a unsupervised representation learning method that extracts slowly varying features from temporal data and can be used as a basis for subsequent reinforcement learning. Often, the behavior that generates the data on…

Machine Learning · Computer Science 2025-06-03 Merlin Schüler , Eddie Seabrook , Laurenz Wiskott

Solving partial differential equations with neural operators significantly reduces computational costs but remains bottlenecked by high training data requirements. Active learning offers a natural framework to mitigate this by selectively…

Machine Learning · Computer Science 2026-05-21 Alicja Polanska , Lorenzo Zanisi , Vignesh Gopakumar , Stanislas Pamela

The effectiveness of active learning hinges on the choice of the acquisition criterion by which a learning algorithm selects potentially informative data points whose label is subsequently queried. This paper proposes a novel gradient-based…

Machine Learning · Computer Science 2026-05-18 Mohamadsadegh Khosravani , Sandra Zilles

We study Reinforcement Learning for partially observable dynamical systems using function approximation. We propose a new \textit{Partially Observable Bilinear Actor-Critic framework}, that is general enough to include models such as…

Machine Learning · Computer Science 2022-06-27 Masatoshi Uehara , Ayush Sekhari , Jason D. Lee , Nathan Kallus , Wen Sun