English
Related papers

Related papers: Optimizing Automatic Differentiation with Deep Rei…

200 papers

Join query optimization is a complex task and is central to the performance of query processing. In fact it belongs to the class of NP-hard problems. Traditional query optimizers use dynamic programming (DP) methods combined with a set of…

Databases · Computer Science 2019-11-27 Jonas Heitz , Kurt Stockinger

Reinforcement learning techniques achieved human-level performance in several tasks in the last decade. However, in recent years, the need for interpretability emerged: we want to be able to understand how a system works and the reasons…

Machine Learning · Computer Science 2023-01-13 Leonardo Lucio Custode , Giovanni Iacca

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

Machine Learning · Computer Science 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

Execution algorithms are vital to modern trading, they enable market participants to execute large orders while minimising market impact and transaction costs. As these algorithms grow more sophisticated, optimising them becomes…

Computational Finance · Quantitative Finance 2025-10-28 Ollie Olby , Andreea Bacalum , Rory Baggott , Namid Stillman

Ou et al. (2022) introduce the problem of learning set functions from data generated by a so-called optimal subset oracle. Their approach approximates the underlying utility function with an energy-based model, whose parameters are…

Machine Learning · Computer Science 2024-12-18 Gözde Özcan , Chengzhi Shi , Stratis Ioannidis

This paper proposes a new reinforcement learning (RL) algorithm that enhances exploration by amplifying the imitation effect (AIE). This algorithm consists of self-imitation learning and random network distillation algorithms. We argue that…

Machine Learning · Computer Science 2019-01-18 Gyeong Taek Lee , Chang Ouk Kim

Transferring knowledge across a sequence of related tasks is an important challenge in reinforcement learning (RL). Despite much encouraging empirical evidence, there has been little theoretical analysis. In this paper, we study a class of…

Machine Learning · Computer Science 2015-09-23 Emma Brunskill , Lihong Li

We study reinforcement learning (RL) in high dimensional episodic Markov decision processes (MDP). We consider value-based RL when the optimal Q-value is a linear function of d-dimensional state-action feature representation. For instance,…

Artificial Intelligence · Computer Science 2019-09-10 Kamyar Azizzadenesheli , Animashree Anandkumar

Robotic systems must be able to quickly and robustly make decisions when operating in uncertain and dynamic environments. While Reinforcement Learning (RL) can be used to compute optimal policies with little prior knowledge about the…

Robotics · Computer Science 2016-09-13 Yunpeng Pan , Xinyan Yan , Evangelos Theodorou , Byron Boots

The outcome of Jacobian singular values regularization was studied for supervised learning problems. It also was shown that Jacobian conditioning regularization can help to avoid the ``mode-collapse'' problem in Generative Adversarial…

Machine Learning · Computer Science 2020-07-15 Arip Asadulaev , Igor Kuznetsov , Gideon Stein , Andrey Filchenkov

One of the main goals of reinforcement learning (RL) is to provide a~way for physical machines to learn optimal behavior instead of being programmed. However, effective control of the machines usually requires fine time discretization. The…

Machine Learning · Computer Science 2022-07-12 Jakub Łyskawa , Paweł Wawrzyński

Most combinatorial optimization problems can be formulated as mixed integer linear programming (MILP), in which branch-and-bound (B\&B) is a general and widely used method. Recently, learning to branch has become a hot research topic in the…

Machine Learning · Computer Science 2022-01-19 Qingyu Qu , Xijun Li , Yunfan Zhou , Jia Zeng , Mingxuan Yuan , Jie Wang , Jinhu Lv , Kexin Liu , Kun Mao

This paper presents a new algorithm for online linear regression whose efficiency guarantees satisfy the requirements of the KWIK (Knows What It Knows) framework. The algorithm improves on the complexity bounds of the current…

Machine Learning · Computer Science 2012-05-14 Thomas J. Walsh , Istvan Szita , Carlos Diuk , Michael L. Littman

Reinforcement learning (RL) is a classical tool to solve network control or policy optimization problems in unknown environments. The original Q-learning suffers from performance and complexity challenges across very large networks. Herein,…

Machine Learning · Computer Science 2024-09-02 Talha Bozkus , Urbashi Mitra

Deep reinforcement learning (RL) has achieved several high profile successes in difficult decision-making problems. However, these algorithms typically require a huge amount of data before they reach reasonable performance. In fact, their…

We consider the Markov Decision Process (MDP) of selecting a subset of items at each step, termed the Select-MDP (S-MDP). The large state and action spaces of S-MDPs make them intractable to solve with typical reinforcement learning (RL)…

Machine Learning · Computer Science 2019-09-10 Hyungseok Song , Hyeryung Jang , Hai H. Tran , Se-eun Yoon , Kyunghwan Son , Donggyu Yun , Hyoju Chung , Yung Yi

The significant components of any successful autonomous flight system are task completion and collision avoidance. Most deep learning algorithms successfully execute these aspects under the environment and conditions they are trained.…

Convex quadratic programs (QPs) are fundamental to numerous applications, including finance, engineering, and energy systems. Among the various methods for solving them, the Douglas-Rachford (DR) splitting algorithm is notable for its…

Optimization and Control · Mathematics 2025-08-19 Jinxin Xiong , Xi Gao , Linxin Yang , Jiang Xue , Xiaodong Luo , Akang Wang

This paper proposes a Deep Reinforcement Learning (DRL) approach for solving knapsack problem. The proposed method consists of a state aggregation step based on tabular reinforcement learning to extract features and construct states. The…

Neural and Evolutionary Computing · Computer Science 2020-04-28 Reza Refaei Afshar , Yingqian Zhang , Murat Firat , Uzay Kaymak

Deep Learning has become overly complicated and has enjoyed stellar success in solving several classical problems like image classification, object detection, etc. Several methods for explaining these decisions have been proposed. Black-box…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Siddhant Agarwal , Owais Iqbal , Sree Aditya Buridi , Madda Manjusha , Abir Das