English
Related papers

Related papers: Deep Learning Meets Queue-Reactive: A Framework fo…

200 papers

Robots in uncertain real-world environments must perform both goal-directed and exploratory actions. However, most deep learning-based control methods neglect exploration and struggle under uncertainty. To address this, we adopt deep active…

Robotics · Computer Science 2025-12-02 Kentaro Fujii , Shingo Murata

The uncertainties from distributed energy resources (DERs) bring significant challenges to the real-time operation of microgrids. In addition, due to the nonlinear constraints in the AC power flow equation and the nonlinearity of the…

Systems and Control · Electrical Eng. & Systems 2023-04-06 Hang Shuai , Xiaomeng Ai , Jiakun Fang , Wei Yao , Jinyu Wen

Models based on the Transformer architecture have seen widespread application across fields such as natural language processing, computer vision, and robotics, with large language models like ChatGPT revolutionizing machine understanding of…

Robotics · Computer Science 2024-07-24 Yujian Dong , Tianyu Wu , Chaoyang Song

Dense retrieval models use bi-encoder network architectures for learning query and document representations. These representations are often in the form of a vector representation and their similarities are often computed using the dot…

Information Retrieval · Computer Science 2023-05-01 Hamed Zamani , Michael Bendersky

In this extended abstract, we propose a new technique for query scheduling with the explicit goal of reducing disk reads and thus implicitly increasing query performance. We introduce SmartQueue, a learned scheduler that leverages…

Databases · Computer Science 2022-07-28 Chi Zhang , Ryan Marcus , Anat Kleiman , Olga Papaemmanouil

Parameterised actions in reinforcement learning are composed of discrete actions with continuous action-parameters. This provides a framework for solving complex domains that require combining high-level actions with flexible control. The…

Machine Learning · Computer Science 2019-05-14 Craig J. Bester , Steven D. James , George D. Konidaris

We introduce a novel Deep Reinforcement Learning (DRL) algorithm called Deep Quality-Value (DQV) Learning. DQV uses temporal-difference learning to train a Value neural network and uses this network for training a second Quality-value…

Machine Learning · Statistics 2018-10-11 Matthia Sabatelli , Gilles Louppe , Pierre Geurts , Marco A. Wiering

Market by order (MBO) data - a detailed feed of individual trade instructions for a given stock on an exchange - is arguably one of the most granular sources of microstructure information. While limit order books (LOBs) are implicitly…

Trading and Market Microstructure · Quantitative Finance 2021-07-28 Zihao Zhang , Bryan Lim , Stefan Zohren

Accurate time-series forecasting is crucial in various scientific and industrial domains, yet deep learning models often struggle to capture long-term dependencies and adapt to data distribution shifts over time. We introduce Future-Guided…

Machine Learning · Computer Science 2025-09-30 Skye Gunasekaran , Assel Kembay , Hugo Ladret , Rui-Jie Zhu , Laurent Perrinet , Omid Kavehei , Jason Eshraghian

In the framework of reduced basis methods, we recently introduced a new certified hierarchical and adaptive surrogate model, which can be used for efficient approximation of input-output maps that are governed by parametrized partial…

Numerical Analysis · Mathematics 2023-03-01 Tizian Wenzel , Bernard Haasdonk , Hendrik Kleikamp , Mario Ohlberger , Felix Schindler

Deep Q-learning Network (DQN) is a successful way which combines reinforcement learning with deep neural networks and leads to a widespread application of reinforcement learning. One challenging problem when applying DQN or other…

Machine Learning · Computer Science 2022-09-19 Zhe Zhang , Yukun Zou , Junjie Lai , Qing Xu

We present a novel statistical approach to incorporating uncertainty awareness in model-free distributional reinforcement learning involving quantile regression-based deep Q networks. The proposed algorithm, $\textit{Calibrated Evidential…

Machine Learning · Computer Science 2024-06-05 Alex Christopher Stutts , Danilo Erricolo , Theja Tulabandhula , Amit Ranjan Trivedi

Deep learning has attracted great attention recently and yielded the state of the art performance in dimension reduction and classification problems. However, it cannot effectively handle the structured output prediction, e.g. sequential…

Machine Learning · Computer Science 2015-05-05 Gang Chen , Ran Xu , Sargur Srihari

Motivated by a zero-intelligence approach, the aim of this paper is to connect the microscopic (discrete price and volume), mesoscopic (discrete price and continuous volume) and macroscopic (continuous price and volume) frameworks for the…

Mathematical Finance · Quantitative Finance 2019-06-27 Ben Hambly , Jasdeep Kalsi , James Newbury

The article describes the use of deep Q-learning models in the problems of sales time series analytics. In contrast to supervised machine learning which is a kind of passive learning using historical data, Q-learning is a kind of active…

Machine Learning · Computer Science 2022-01-07 Bohdan M. Pavlyshenko

The advent of deep reinforcement learning (DRL) has significantly advanced the field of robotics, particularly in the control and coordination of quadruped robots. However, the complexity of real-world tasks often necessitates the…

Robotics · Computer Science 2024-03-26 Ziyan Xiong , Bo Chen , Shiyu Huang , Wei-Wei Tu , Zhaofeng He , Yang Gao

Mixed-precision quantization mostly predetermines the model bit-width settings before actual training due to the non-differential bit-width sampling process, obtaining sub-optimal performance. Worse still, the conventional static…

Artificial Intelligence · Computer Science 2023-02-10 Yingchun Wang , Jingcai Guo , Song Guo , Weizhan Zhang

Learning to Rank is the problem involved with ranking a sequence of documents based on their relevance to a given query. Deep Q-Learning has been shown to be a useful method for training an agent in sequential decision making. In this…

Machine Learning · Computer Science 2020-02-19 Abhishek Sharma

Deep Reinforcement Learning (RL) has considerably advanced over the past decade. At the same time, state-of-the-art RL algorithms require a large computational budget in terms of training time to converge. Recent work has started to…

Most existing literature on supply chain and inventory management consider stochastic demand processes with zero or constant lead times. While it is true that in certain niche scenarios, uncertainty in lead times can be ignored, most…

Machine Learning · Computer Science 2022-03-10 Hardik Meisheri , Somjit Nath , Mayank Baranwal , Harshad Khadilkar