English
Related papers

Related papers: Enabling High Data Throughput Reinforcement Learni…

200 papers

Deep reinforcement learning (deep RL) research has grown significantly in recent years. A number of software offerings now exist that provide stable, comprehensive implementations for benchmarking. At the same time, recent deep RL research…

Machine Learning · Computer Science 2018-12-18 Pablo Samuel Castro , Subhodeep Moitra , Carles Gelada , Saurabh Kumar , Marc G. Bellemare

Present-day Deep Reinforcement Learning (RL) systems show great promise towards building intelligent agents surpassing human-level performance. However, the computational complexity associated with the underlying deep neural networks (DNNs)…

Machine Learning · Computer Science 2021-09-20 Adarsh Kumar Kosta , Malik Aqeel Anwar , Priyadarshini Panda , Arijit Raychowdhury , Kaushik Roy

Regular path queries (RPQs) are fundamental for path-constrained reachability analysis, and more complex variants such as conjunctive regular path queries (CRPQs) are increasingly used in graph analytics. Evaluating these queries is…

Databases · Computer Science 2026-02-25 Sungwoo Park , Seohyeon Kim , Min-Soo Kim

Edge computing facilitates deep learning in resource-constrained environments, but challenges such as resource heterogeneity and dynamic constraints persist. This paper introduces AMP4EC, an Adaptive Model Partitioning framework designed to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-07 Guilin Zhang , Wulan Guo , Ziqi Tan , Hailong Jiang

Artificial intelligence, particularly through recent advancements in deep learning, has achieved exceptional performances in many tasks in fields such as natural language processing and computer vision. In addition to desirable evaluation…

Machine Learning · Computer Science 2024-03-04 Sean Xie , Soroush Vosoughi , Saeed Hassanpour

Despite significant advances, deep networks remain highly susceptible to adversarial attack. One fundamental challenge is that small input perturbations can often produce large movements in the network's final-layer feature space. In this…

Machine Learning · Computer Science 2023-04-20 Maria-Florina Balcan , Avrim Blum , Dravyansh Sharma , Hongyang Zhang

The majority of research in both training Artificial Neural Networks (ANNs) and modeling learning in biological brains focuses on synaptic plasticity, where learning equates to changing the strength of existing connections. However, in…

Neural and Evolutionary Computing · Computer Science 2026-03-13 James C. Knight , Johanna Senk , Thomas Nowotny

Sparse-reward domains are challenging for reinforcement learning algorithms since significant exploration is needed before encountering reward for the first time. Hierarchical reinforcement learning can facilitate exploration by reducing…

Machine Learning · Computer Science 2020-11-13 Lorenzo Steccanella , Simone Totaro , Damien Allonsius , Anders Jonsson

A large-scale knowledge graph enhances reproducibility in biomedical data discovery by providing a standardized, integrated framework that ensures consistent interpretation across diverse datasets. It improves generalizability by connecting…

Methodology · Statistics 2024-10-11 Suqi Liu , Tianxi Cai , Xiaoou Li

This innovative practice category paper presents an innovative framework for teaching Reinforcement Learning (RL) at the undergraduate level. Recognizing the challenges posed by the complex theoretical foundations of the subject and the…

Computers and Society · Computer Science 2025-09-30 Muhammad Ahmed Atif , Mohammad Shahid Shaikh

Inverse Distance Weighted models (IDW) have been widely used for predicting and modeling multidimensional space in multimodal industrial processes. However, the more complex the structure of multidimensional space, the lower the performance…

Machine Learning · Computer Science 2020-08-25 Junjie Zhang , Cong Zhang , Neal N. Xiong

Leveraging Graphics Processing Units (GPUs) to accelerate scientific software has proven to be highly successful, but in order to extract more performance, GPU programmers must overcome the high latency costs associated with their use. One…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-03 Jacob Faibussowitsch , Mark F. Adams , Richard Tran Mills , Stefano Zampini , Junchao Zhang

This paper presents some of the current challenges in designing deep learning artificial intelligence (AI) and integrating it with traditional high-performance computing (HPC) simulations. We evaluate existing packages for their ability to…

Scientific research is being reshaped by AI systems that move beyond isolated assistance toward longer-horizon workflows spanning literature grounding, hypothesis generation, experimentation, validation, reporting, and revision. This shift…

Deep reinforcement learning has achieved great success in laser-based collision avoidance work because the laser can sense accurate depth information without too much redundant data, which can maintain the robustness of the algorithm when…

Robotics · Computer Science 2021-08-24 Lingping Gao , Jianchuan Ding , Wenxi Liu , Haiyin Piao , Yuxin Wang , Xin Yang , Baocai Yin

We present an implementation of model-based online reinforcement learning (RL) for continuous domains with deterministic transitions that is specifically designed to achieve low sample complexity. To achieve low sample complexity, since the…

Artificial Intelligence · Computer Science 2012-02-01 Tobias Jung , Peter Stone

Cross-workload design space exploration (DSE) is crucial in CPU architecture design. Existing DSE methods typically employ the transfer learning technique to leverage knowledge from source workloads, aiming to minimize the requirement of…

Hardware Architecture · Computer Science 2025-04-21 Runzhen Xue , Hao Wu , Mingyu Yan , Ziheng Xiao , Xiaochun Ye , Dongrui Fan

Deep learning models are vulnerable to adversarial examples which are input samples modified in order to maximize the error on the system. We introduce Spartan Networks, resistant deep neural networks that do not require input preprocessing…

Machine Learning · Computer Science 2018-12-18 François Menet , Paul Berthier , José M. Fernandez , Michel Gagnon

The field of machine learning has seen tremendous progress in recent years, with deep learning models delivering exceptional performance across a range of tasks. However, these models often come at the cost of interpretability, as they…

Machine Learning · Computer Science 2024-01-08 Shun Liu

AI's widespread integration has led to neural networks (NNs) deployment on edge and similar limited-resource platforms for safety-critical scenarios. Yet, NN's fragility raises concerns about reliable inference. Moreover, constrained…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Sawinder Kaur , Yi Xiao , Asif Salekin