English
Related papers

Related papers: Making Belady-Inspired Replacement Policies More E…

200 papers

Recent theoretical work studies sample-efficient reinforcement learning (RL) extensively in two settings: learning interactively in the environment (online RL), or learning from an offline dataset (offline RL). However, existing algorithms…

Machine Learning · Computer Science 2022-02-14 Tengyang Xie , Nan Jiang , Huan Wang , Caiming Xiong , Yu Bai

Adversarial Examples Detection (AED) is a crucial defense technique against adversarial attacks and has drawn increasing attention from the Natural Language Processing (NLP) community. Despite the surge of new AED methods, our studies show…

Computation and Language · Computer Science 2022-10-25 Fan Yin , Yao Li , Cho-Jui Hsieh , Kai-Wei Chang

Robust imitation learning using disturbance injections overcomes issues of limited variation in demonstrations. However, these methods assume demonstrations are optimal, and that policy stabilization can be learned via simple augmentations.…

Robotics · Computer Science 2022-05-10 Hirotaka Tahara , Hikaru Sasaki , Hanbit Oh , Brendan Michael , Takamitsu Matsubara

A sensing policy for the restless multi-armed bandit problem with stationary but unknown reward distributions is proposed. The work is presented in the context of cognitive radios in which the bandit problem arises when deciding which parts…

Information Theory · Computer Science 2012-11-20 Jan Oksanen , Visa Koivunen , H. Vincent Poor

We are motivated by the real challenges presented in a human-robot system to develop new designs that are efficient at data level and with performance guarantees such as stability and optimality at systems level. Existing…

Systems and Control · Electrical Eng. & Systems 2021-01-19 Xiang Gao , Jennie Si , Yue Wen , Minhan Li , He , Huang

A recent goal in the Reinforcement Learning (RL) framework is to choose a sequence of actions or a policy to maximize the reward collected or minimize the regret incurred in a finite time horizon. For several RL problems in operation…

Machine Learning · Computer Science 2016-08-18 K J Prabuchandran , Tejas Bodas , Theja Tulabandhula

Autoregressive decoding with generative Large Language Models (LLMs) on accelerators (GPUs/TPUs) is often memory-bound where most of the time is spent on transferring model parameters from high bandwidth memory (HBM) to cache. On the other…

Machine Learning · Computer Science 2024-02-15 Yashas Samaga B L , Varun Yerram , Chong You , Srinadh Bhojanapalli , Sanjiv Kumar , Prateek Jain , Praneeth Netrapalli

This study proposes a mathematical model to optimally locate a set of detectors in such a way that the expected number of casualties in a given threat area can be minimized. Detectors may not be perfectly reliable, which is often a function…

Systems and Control · Electrical Eng. & Systems 2021-01-26 Mohammad Marufuzzaman , Amin Aghalari , Randy Buchanan , Christina H. Rinaudo , Kayla M. Houte , Julekha H. Ranta

Reading and writing memory are, besides computation, the most common operations a processor performs. The correctness of these operations is therefore essential for the proper execution of any program. However, as soon as fault attacks are…

Cryptography and Security · Computer Science 2018-09-25 Robert Schilling , Mario Werner , Pascal Nasahl , Stefan Mangard

Off-policy learning from multistep returns is crucial for sample-efficient reinforcement learning, particularly in the experience replay setting now commonly used with deep neural networks. Classically, off-policy estimation bias is…

Machine Learning · Computer Science 2021-12-24 Brett Daley , Christopher Amato

Since the introduction of the GRPO algorithm, reinforcement learning (RL) has attracted increasing attention for LLM post-training, yet training efficiency remains a critical challenge. In mainstream RL frameworks, inference and training…

Machine Learning · Computer Science 2026-05-05 Jian Lu

The last level cache is vulnerable to timing based side channel attacks because it is shared by the attacker and the victim processes even if they are located on different cores. These timing attacks evict the victim cache lines using small…

Cryptography and Security · Computer Science 2019-09-30 Kartik Ramkrishnan , Antonia Zhai , Stephen McCamant , Pen Chung Yew

Training agents via off-policy deep reinforcement learning (RL) requires a large memory, named replay memory, that stores past experiences used for learning. These experiences are sampled, uniformly or non-uniformly, to create the batches…

Machine Learning · Computer Science 2022-12-27 Bumgeun Park , Taeyoung Kim , Woohyeon Moon , Luiz Felipe Vecchietti , Dongsoo Har

Learning-based model predictive control has emerged as a powerful approach for handling complex dynamics in mechatronic systems, enabling data-driven performance improvements while respecting safety constraints. However, when computational…

Systems and Control · Electrical Eng. & Systems 2025-12-19 Mark Benazet , Francesco Ricca , Dario Bralla , Melanie N. Zeilinger , Andrea Carron

Non-stationary environments are challenging for reinforcement learning algorithms. If the state transition and/or reward functions change based on latent factors, the agent is effectively tasked with optimizing a behavior that maximizes…

Machine Learning · Computer Science 2021-05-21 Lucas N. Alegre , Ana L. C. Bazzan , Bruno C. da Silva

Low-density parity-check (LDPC) codes are an important feature of several communication and storage applications, offering a flexible and effective method for error correction. These codes are computationally complex and require the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-06 Oscar Ferraz , Vitor Silva , Gabriel Falcao

This paper proposes to use a frequency based cache admission policy in order to boost the effectiveness of caches subject to skewed access distributions. Given a newly accessed item and an eviction candidate from the cache, our scheme…

Operating Systems · Computer Science 2015-12-04 Gil Einziger , Roy Friedman , Ben Manes

We consider a pursuit-evasion game [11] played between two agents, 'Blue' (the pursuer) and 'Red' (the evader), over $T$ time steps. Red aims to attack Blue's territory. Blue's objective is to intercept Red by time $T$ and thereby limit the…

Machine Learning · Computer Science 2020-10-15 Shiva Navabi , Osonde A. Osoba

This paper introduces two metrics (cycle-based and memory-based metrics), grounded on a dynamical game-theoretic solution concept called sink equilibrium, for the evaluation, ranking, and computation of policies in multi-agent learning. We…

Computer Science and Game Theory · Computer Science 2020-06-23 Rui Yan , Xiaoming Duan , Zongying Shi , Yisheng Zhong , Jason R. Marden , Francesco Bullo

Reinforcement learning algorithms are typically geared towards optimizing the expected return of an agent. However, in many practical applications, low variance in the return is desired to ensure the reliability of an algorithm. In this…

Machine Learning · Computer Science 2021-02-04 Arushi Jain , Gandharv Patil , Ayush Jain , Khimya Khetarpal , Doina Precup