English
Related papers

Related papers: Probing Routing-Conditional Calibration in Attenti…

200 papers

Deep reinforcement learning (RL) algorithms are predominantly evaluated by comparing their relative performance on a large suite of tasks. Most published results on deep RL benchmarks compare point estimates of aggregate performance such as…

Machine Learning · Computer Science 2022-01-06 Rishabh Agarwal , Max Schwarzer , Pablo Samuel Castro , Aaron Courville , Marc G. Bellemare

Clinical monitoring of functional decline in ALS relies on periodic assessments that may miss critical changes occurring between visits. To address this gap, semi-supervised regression models were developed to estimate rates of decline in a…

Machine Learning · Computer Science 2025-07-15 Noah Marchal , William E. Janes , Mihail Popescu , Xing Song

Robots operating in shared workspaces must maintain safe coordination with other agents whose behavior may change during task execution. When a collaborating agent switches strategy mid-episode, continuing under outdated assumptions can…

Robotics · Computer Science 2026-04-08 Devashri Naik , Divake Kumar , Nastaran Darabi , Amit Ranjan Trivedi

The fundamental design of wireless systems toward AI-native 6G and beyond is driven by the need for ever-increasing demand of mobile data traffic, extreme spectral efficiency, and adaptability across diverse service scenarios. To overcome…

Systems and Control · Electrical Eng. & Systems 2025-12-05 Bo Qian , Hanlin Wu , Jiacheng Chen , Yunting Xu , Xiaoyu Wang , Haibo Zhou , Yusheng Ji

Recent studies have shown that deep neural networks are not well-calibrated and often produce over-confident predictions. The miscalibration issue primarily stems from using cross-entropy in classifications, which aims to align predicted…

Machine Learning · Computer Science 2025-02-05 Daehwan Kim , Haejun Chung , Ikbeom Jang

In this paper, we study the inference accuracy of the Resistive Random Access Memory (ReRAM) neuromorphic circuit due to stuck-at faults (stuck-on, stuck-off, and stuck at a certain resistive value). A simulation framework using Python is…

Hardware Architecture · Computer Science 2024-08-16 Vedant Sawal , Hiu Yung Wong

Agentic memory enables LLMs to persist information beyond a single context window and reuse it in later decisions, but it also introduces a new vulnerability: spurious correlations, where retrieved memory carries miscorrelated evidence and…

Machine Learning · Computer Science 2026-05-12 Luoxi Tang , Rupali Rajendra Vaje , Yuqiao Meng , Sakshi Sunil Narkar , Weicheng Ma , Zeyu Ding , Dazheng Zhang , Zhaohan Xi

Post-training large language models (LLMs) often suffers from catastrophic forgetting, where improvements on a target objective degrade previously acquired capabilities. Recent evidence suggests that this phenomenon is primarily driven by…

Machine Learning · Computer Science 2026-05-07 Xinyu Wang , Changzhi Sun , Yuanbin Wu , Xiaoling Wang

Ensuring reliability in modern software systems requires rigorous pre-production testing across highly heterogeneous and evolving environments. Because exhaustive evaluation is infeasible, practitioners must decide how to allocate limited…

Software Engineering · Computer Science 2025-10-08 Yu Zhu

Virtual cell models aim to enable in silico experimentation by predicting how cells respond to genetic, chemical, or cytokine perturbations from single-cell measurements. In practice, however, large-scale perturbation prediction remains…

Machine Learning · Computer Science 2026-03-20 Shuizhou Chen , Lang Yu , Kedu Jin , Songming Zhang , Hao Wu , Wenxuan Huang , Sheng Xu , Quan Qian , Qin Chen , Lei Bai , Siqi Sun , Zhangyang Gao

Do reasoning models have "Aha!" moments? Prior work suggests that models like DeepSeek-R1-Zero undergo sudden mid-trace realizations that lead to accurate outputs, implying an intrinsic capacity for self-correction. Yet, it remains unclear…

Artificial Intelligence · Computer Science 2026-04-21 Liv G. d'Aliberti , Manoel Horta Ribeiro

Emerging deployments of Generative AI increasingly execute inference across decentralized and heterogeneous edge devices rather than on a single trusted server. In such environments, a single device failure or misbehavior can disrupt the…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-31 Chanh Nguyen , Erik Elmroth

Post-training has become essential for adapting large language models (LLMs) to complex downstream behaviors, including instruction following, preference alignment, and multi-step reasoning. Reinforcement learning with verifiable rewards…

Machine Learning · Computer Science 2026-05-20 Chengqian Zhang , Wei Zhu , Kyumin Lee

Clinical deployment of chest radiograph classifiers requires models that can be updated as new datasets become available without retraining on previously observed data or degrading validated performance. We study a task-incremental…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Muthu Subash Kavitha , Anas Zafar , Amgad Muneer , Jia Wu

Analog-Based In-Memory Computing (AIMC) inference accelerators can be used to efficiently execute Deep Neural Network (DNN) inference workloads. However, to mitigate accuracy losses, due to circuit and device non-idealities, Hardware-Aware…

Emerging Technologies · Computer Science 2025-01-30 Corey Lammie , Athanasios Vasilopoulos , Julian Büchel , Giacomo Camposampiero , Manuel Le Gallo , Malte Rasch , Abu Sebastian

Even as we engineer LLMs for alignment and safety, they often uncover biases from pre-training data's statistical regularities (from disproportionate co-occurrences to stereotypical associations mirroring human cognitive biases). This leads…

Computation and Language · Computer Science 2025-08-13 Ruixi Lin , Yang You

Meta-reinforcement learning (meta-RL) aims to learn from multiple training tasks the ability to adapt efficiently to unseen test tasks. Despite the success, existing meta-RL algorithms are known to be sensitive to the task distribution…

Machine Learning · Computer Science 2021-03-02 Zichuan Lin , Garrett Thomas , Guangwen Yang , Tengyu Ma

Low-rank structure is a common implicit assumption in many modern reinforcement learning (RL) algorithms. For instance, reward-free and goal-conditioned RL methods often presume that the successor measure admits a low-rank representation.…

Machine Learning · Computer Science 2025-11-06 Bastien Dubail , Stefan Stojanovic , Alexandre Proutière

Learning-based approaches, particularly reinforcement learning (RL), have become widely used for developing control policies for autonomous agents, such as locomotion policies for legged robots. RL training typically maximizes a predefined…

Robotics · Computer Science 2025-04-23 Dylan Khor , Bowen Weng

Adversarial training (AT) and its variants have spearheaded progress in improving neural network robustness to adversarial perturbations and common corruptions in the last few years. Algorithm design of AT and its variants are focused on…

Machine Learning · Computer Science 2022-06-15 Kaustubh Sridhar , Souradeep Dutta , Ramneet Kaur , James Weimer , Oleg Sokolsky , Insup Lee