English
Related papers

Related papers: Improving Robustness of AlphaZero Algorithms to Te…

200 papers

In this paper, we propose to disentangle and interpret contextual effects that are encoded in a pre-trained deep neural network. We use our method to explain the gaming strategy of the alphaGo Zero model. Unlike previous studies that…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Zenan Ling , Haotian Ma , Yu Yang , Robert C. Qiu , Song-Chun Zhu , Quanshi Zhang

While Reinforcement Learning ( RL) has made great strides towards solving increasingly complicated problems, many algorithms are still brittle to even slight environmental changes. Contextual Reinforcement Learning (cRL) provides a…

Modern agents built on frontier language models often cannot adapt their weights. What, then, remains trainable? We argue it is the agent's \emph{workspace}, the structured external substrate it reads, writes, and tests; we call its…

Artificial Intelligence · Computer Science 2026-05-12 Elad Sarafian , Gal Kaplun , Ron Banner , Daniel Soudry , Boris Ginsburg

Existing AutoML systems have advanced the automation of machine learning (ML); however, they still require substantial manual configuration and expert input, particularly when handling multimodal data. We introduce MLZero, a novel…

We propose a new framework for building and evaluating machine learning algorithms. We argue that many real-world problems require an agent which must quickly learn to respond to demands, yet can continue to perform and respond to new…

Machine Learning · Computer Science 2007-05-23 Jason E. Holt

In this work, we suggest Kernel Filtering Linear Overparameterization (KFLO), where a linear cascade of filtering layers is used during training to improve network performance in test time. We implement this cascade in a kernel filtering…

Machine Learning · Computer Science 2022-07-13 Amit Henig , Raja Giryes

Manually labeled corpora are expensive to create and often not available for low-resource languages or domains. Automatic labeling approaches are an alternative way to obtain labeled data in a quicker and cheaper way. However, these labels…

Machine Learning · Computer Science 2018-07-24 Michael A. Hedderich , Dietrich Klakow

Predicting the time to build software is a very complex task for software engineering managers. There are complex factors that can directly interfere with the productivity of the development team. Factors directly related to the complexity…

The rapid progress of large foundation models has accelerated the development of task-specialized agents across diverse domains. However, the effectiveness of agents remains tightly coupled with the quality of training data, while curating…

Artificial Intelligence · Computer Science 2026-02-04 Yeonsung Jung , Trilok Padhi , Sina Shaham , Dipika Khullar , Joonhyun Jeong , Ninareh Mehrabi , Eunho Yang

In addition to high accuracy, robustness is becoming increasingly important for machine learning models in various applications. Recently, much research has been devoted to improving the model robustness by training with noise…

Machine Learning · Computer Science 2021-03-30 Kun-Peng Ning , Lue Tao , Songcan Chen , Sheng-Jun Huang

Robust optimization methods have shown practical advantages in a wide range of decision-making applications under uncertainty. Recently, their efficacy has been extended to multi-period settings. Current approaches model uncertainty either…

Optimization and Control · Mathematics 2022-02-23 Omid Nohadani , Kartikey Sharma

The idea of decision-aware model learning, that models should be accurate where it matters for decision-making, has gained prominence in model-based reinforcement learning. While promising theoretical results have been established, the…

Machine Learning · Computer Science 2024-03-04 Claas A Voelcker , Arash Ahmadian , Romina Abachi , Igor Gilitschenski , Amir-massoud Farahmand

The combination of self-play and planning has achieved great successes in sequential games, for instance in Chess and Go. However, adapting algorithms such as AlphaZero to simultaneous games poses a new challenge. In these games, missing…

Artificial Intelligence · Computer Science 2024-06-12 Yannik Mahlau , Frederik Schubert , Bodo Rosenhahn

Machine learning frameworks adopt iterative optimizers to train neural networks. Conventional eager execution separates the updating of trainable parameters from forward and backward computations. However, this approach introduces…

Machine Learning · Computer Science 2021-04-02 Zixuan Jiang , Jiaqi Gu , Mingjie Liu , Keren Zhu , David Z. Pan

Generalization in deep reinforcement learning over unseen environment variations usually requires policy learning over a large set of diverse training variations. We empirically observe that an agent trained on many variations (a…

Machine Learning · Computer Science 2022-06-28 Zhiwei Jia , Xuanlin Li , Zhan Ling , Shuang Liu , Yiran Wu , Hao Su

Recent developments in sequential experimental design look to construct a policy that can efficiently navigate the design space, in a way that maximises the expected information gain. Whilst there is work on achieving tractable policies for…

Machine Learning · Computer Science 2025-08-20 Yasir Zubayr Barlas , Kizito Salako

Traditional approaches to training agents have generally involved a single, deterministic environment of minimal complexity to solve various tasks such as robot locomotion or computer vision. However, agents trained in static environments…

Robotics · Computer Science 2025-10-01 Kevin Godin-Dubois , Karine Miras , Anna V. Kononova

Off-policy reinforcement learning algorithms promise to be applicable in settings where only a fixed data-set (batch) of environment interactions is available and no new experience can be acquired. This property makes these algorithms…

Robust controllers ensure stability in feedback loops designed under uncertainty but at the cost of performance. Model uncertainty in time-invariant systems can be reduced by recently proposed learning-based methods, which improve the…

Systems and Control · Electrical Eng. & Systems 2023-01-18 Alexander von Rohr , Friedrich Solowjow , Sebastian Trimpe

In this paper we provide a broad framework for describing learning agents in general quantum environments. We analyze the types of classically specified environments which allow for quantum enhancements in learning, by contrasting…

Quantum Physics · Physics 2015-07-31 Vedran Dunjko , Jacob M. Taylor , Hans J. Briegel