English
Related papers

Related papers: Leakage-Resilient Hardness Equivalence to Logspace…

200 papers

Reachability analysis is at the core of many applications, from neural network verification, to safe trajectory planning of uncertain systems. However, this problem is notoriously challenging, and current approaches tend to be either too…

Systems and Control · Electrical Eng. & Systems 2020-11-10 Thomas Lew , Marco Pavone

Accurately quantifying uncertainty in large language models (LLMs) is crucial for their reliable deployment, especially in high-stakes applications. Current state-of-the-art methods for measuring semantic uncertainty in LLMs rely on strict…

Machine Learning · Computer Science 2024-10-31 Yashvir S. Grewal , Edwin V. Bonilla , Thang D. Bui

We propose a new model for augmenting algorithms with predictions by requiring that they are formally learnable and instance robust. Learnability ensures that predictions can be efficiently constructed from a reasonable amount of past data.…

Machine Learning · Computer Science 2021-07-05 Thomas Lavastida , Benjamin Moseley , R. Ravi , Chenyang Xu

Evaluating the robustness of LLMs to adversarial attacks is crucial for safe deployment, yet current red-teaming methods are often prohibitively expensive. We compare the ability of fast proxy metrics to predict the real-world robustness of…

Cryptography and Security · Computer Science 2025-02-18 Tim Beyer , Jan Schuchardt , Leo Schwinn , Stephan Günnemann

Standard probabilistic models face fundamental challenges such as data scarcity, a large hypothesis space, and poor data transparency. To address these challenges, we propose a novel probabilistic model of data-driven temporal propositional…

Artificial Intelligence · Computer Science 2025-07-08 Hiroyuki Kido

This paper develops a methodology for robust Bayesian inference through the use of disparities. Metrics such as Hellinger distance and negative exponential disparity have a long history in robust estimation in frequentist inference. We…

Methodology · Statistics 2012-11-28 Giles Hooker , Anand Vidyashankar

A basic model in sequential decision making is the Markov decision process (MDP), which is extended to Robust MDPs (RMDPs) by allowing uncertainty in transition probabilities and optimizing against the worst-case transition probabilities…

Computational Complexity · Computer Science 2026-05-11 Ali Asadi , Krishnendu Chatterjee , Alipasha Montaseri , Ali Shafiee

Efficiently reranking documents retrieved from information retrieval (IR) pipelines to enhance overall quality of Retrieval-Augmented Generation (RAG) system remains an important yet challenging problem. Recent studies have highlighted the…

Computation and Language · Computer Science 2025-11-12 Jingyu Wu , Aditya Shrivastava , Jing Zhu , Alfy Samuel , Anoop Kumar , Daben Liu

Smoothing classifiers and probability density functions with Gaussian kernels appear unrelated, but in this work, they are unified for the problem of robust classification. The key building block is approximating the $\textit{energy…

Machine Learning · Statistics 2020-05-12 Saeed Saremi , Rupesh Srivastava

In this paper, we resolve the one-pass space complexity of $L_p$ sampling for $p \in (0,2)$. Given a stream of updates (insertions and deletions) to the coordinates of an underlying vector $f \in \mathbb{R}^n$, a perfect $L_p$ sampler must…

Data Structures and Algorithms · Computer Science 2019-11-12 Rajesh Jayaram , David P. Woodruff

We consider the sample complexity of learning with adversarial robustness. Most prior theoretical results for this problem have considered a setting where different classes in the data are close together or overlapping. Motivated by some…

Machine Learning · Computer Science 2023-01-19 Robi Bhattacharjee , Somesh Jha , Kamalika Chaudhuri

This paper addresses the task of estimating a covariance matrix under a patternless sparsity assumption. In contrast to existing approaches based on thresholding or shrinkage penalties, we propose a likelihood-based method that regularizes…

Methodology · Statistics 2021-09-13 Jason Xu , Kenneth Lange

Recent advances align diffusion models with human preferences to increase aesthetic appeal and mitigate artifacts and biases. Such methods aim to maximize a conditional output distribution aligned with higher rewards whilst not drifting far…

Machine Learning · Computer Science 2026-02-23 Ratnavibusena Don Shahain Manujith , Teoh Tze Tzun , Kenji Kawaguchi , Yang Zhang

Making learners robust to adversarial perturbation at test time (i.e., evasion attacks) or training time (i.e., poisoning attacks) has emerged as a challenging task. It is known that for some natural settings, sublinear perturbations in the…

Machine Learning · Computer Science 2018-11-07 Saeed Mahloujifar , Mohammad Mahmoody

Due to the fundamental connection between next-symbol prediction and compression, modern predictive models, such as large language models (LLMs), can be combined with entropy coding to achieve compression rates that surpass those of…

Information Theory · Computer Science 2026-01-27 Cordelia Hu , Jennifer Tang

This short note highlights some links between two lines of research within the emerging topic of trustworthy machine learning: differential privacy and robustness to adversarial examples. By abstracting the definitions of both notions, we…

Machine Learning · Computer Science 2019-06-20 Rafael Pinot , Florian Yger , Cédric Gouy-Pailler , Jamal Atif

Reweighting adversarial data during training has been recently shown to improve adversarial robustness, where data closer to the current decision boundaries are regarded as more critical and given larger weights. However, existing methods…

Machine Learning · Computer Science 2022-03-18 Qizhou Wang , Feng Liu , Bo Han , Tongliang Liu , Chen Gong , Gang Niu , Mingyuan Zhou , Masashi Sugiyama

The Learning Parity with Noise (LPN) problem underlines several classic cryptographic primitives. Researchers have attempted to demonstrate the algorithmic hardness of this problem by finding reductions from the decoding problem of linear…

Information Theory · Computer Science 2025-03-19 Madhura Pathegama , Alexander Barg

In this paper we show how to achieve state-of-the-art certified adversarial robustness to 2-norm bounded perturbations by relying exclusively on off-the-shelf pretrained models. To do so, we instantiate the denoised smoothing approach of…

Machine Learning · Computer Science 2023-03-07 Nicholas Carlini , Florian Tramer , Krishnamurthy Dj Dvijotham , Leslie Rice , Mingjie Sun , J. Zico Kolter

This paper presents a novel approach to reinforcement learning (RL) for control systems that provides probabilistic stability guarantees using finite data. Leveraging Lyapunov's method, we propose a probabilistic stability theorem that…

Machine Learning · Computer Science 2026-03-03 Minghao Han , Lixian Zhang , Chenliang Liu , Zhipeng Zhou , Jun Wang , Wei Pan