English
Related papers

Related papers: Oblivious Subspace Injection Is Not Enough for Rel…

200 papers

Detection of out-of-distribution (OOD) samples is crucial for safe real-world deployment of machine learning models. Recent advances in vision language foundation models have made them capable of detecting OOD samples without requiring…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Hao Fu , Naman Patel , Prashanth Krishnamurthy , Farshad Khorrami

3D Semantic Scene Completion (SSC) can provide dense geometric and semantic scene representations, which can be applied in the field of autonomous driving and robotic systems. It is challenging to estimate the complete geometry and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Ruihang Miao , Weizhou Liu , Mingrui Chen , Zheng Gong , Weixin Xu , Chen Hu , Shuchang Zhou

A key challenge in machine learning is to explain how learning dynamics select among the many solutions that achieve identical loss values in overparameterized models - a phenomenon known as implicit bias. Controlling this bias provides a…

Machine Learning · Computer Science 2026-04-07 Nicola Aladrah , Emanuele Ballarin , Matteo Biagetti , Alessio Ansuini , Alberto d'Onofrio , Fabio Anselmi

Out-of-Distribution (OoD) detection is important for building safe artificial intelligence systems. However, current OoD detection methods still cannot meet the performance requirements for practical deployment. In this paper, we propose a…

Machine Learning · Statistics 2020-12-18 Haiwen Huang , Zhihan Li , Lulu Wang , Sishuo Chen , Bin Dong , Xinyu Zhou

Bayesian Optimization (BO) is a popular approach to optimizing expensive-to-evaluate black-box functions. Despite the success of BO, its performance may decrease exponentially as the dimensionality increases. A common framework to tackle…

Machine Learning · Computer Science 2024-12-24 Quoc-Anh Hoang Nguyen , The Hung Tran

Datasets with significant proportions of bias present threats for training a trustworthy model on NLU tasks. Despite yielding great progress, current debiasing methods impose excessive reliance on the knowledge of bias attributes.…

Computation and Language · Computer Science 2022-09-19 Ting Wu , Tao Gui

The Responsibility-Sensitive Safety (RSS) model offers provable safety for vehicle behaviors such as minimum safe following distance. However, handling worst-case variability and uncertainty may significantly lower vehicle permissiveness,…

Robotics · Computer Science 2019-11-05 Philip Koopman , Beth Osyk , Jack Weast

One-shot signatures (OSS) are a powerful and uniquely quantum cryptographic primitive which allows anyone, given common reference string, to come up with a public verification key $\mathsf{pk}$ and a secret signing state…

Quantum Physics · Physics 2025-10-14 Andrew Huang , Vinod Vaikuntanathan

We propose shifted inner-product similarity (SIPS), which is a novel yet very simple extension of the ordinary inner-product similarity (IPS) for neural-network based graph embedding (GE). In contrast to IPS, that is limited to…

Machine Learning · Statistics 2019-02-25 Akifumi Okuno , Geewook Kim , Hidetoshi Shimodaira

In this paper, we study the offline RL problem with linear function approximation. Our main structural assumption is that the MDP has low inherent Bellman error, which stipulates that linear value functions have linear Bellman backups with…

Machine Learning · Computer Science 2024-06-19 Noah Golowich , Ankur Moitra

We present a high-dimensional analysis of three popular algorithms, namely, Oja's method, GROUSE and PETRELS, for subspace estimation from streaming and highly incomplete observations. We show that, with proper time scaling, the…

Machine Learning · Computer Science 2019-01-30 Chuang Wang , Yonina C. Eldar , Yue M. Lu

We propose a novel statistical inference framework for streaming principal component analysis (PCA) using Oja's algorithm, enabling the construction of confidence intervals for individual entries of the estimated eigenvector. Most existing…

Statistics Theory · Mathematics 2025-07-22 Syamantak Kumar , Shourya Pandey , Purnamrita Sarkar

Out-of-distribution (OOD) detection is critical for ensuring the reliability of deep learning systems, particularly in safety-critical applications. Likelihood-based deep generative models have historically faced criticism for their…

Machine Learning · Computer Science 2025-07-11 Yifan Ding , Arturas Aleksandraus , Amirhossein Ahmadian , Jonas Unger , Fredrik Lindsten , Gabriel Eilertsen

Recent advances in robust semi-supervised learning (SSL) typically filter out-of-distribution (OOD) information at the sample level. We argue that an overlooked problem of robust SSL is its corrupted information on semantic level,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Yu Wang , Pengchong Qiao , Chang Liu , Guoli Song , Xiawu Zheng , Jie Chen

Out-of-distribution (OOD) detection is essential for deploying deep learning models in open-world environments. Existing approaches, such as energy-based scoring and gradient-projection methods, typically rely on high-dimensional…

Machine Learning · Statistics 2025-11-04 Zhexiao Huang , Weihao He , Shutao Deng , Junzhe Chen , Chao Yuan , Hongxin Wang , Changsheng Zhou

We consider the problem of sparse atomic optimization, where the notion of "sparsity" is generalized to meaning some linear combination of few atoms. The definition of atomic set is very broad; popular examples include the standard basis,…

Optimization and Control · Mathematics 2019-12-30 Thomas Zhang

Let X be a data matrix of rank \rho, whose rows represent n points in d-dimensional space. The linear support vector machine constructs a hyperplane separator that maximizes the 1-norm soft margin. We develop a new oblivious dimension…

Machine Learning · Computer Science 2014-04-18 Saurabh Paul , Christos Boutsidis , Malik Magdon-Ismail , Petros Drineas

Estimating the probability of rare failure events is an essential step in the reliability assessment of engineering systems. Computing this failure probability for complex non-linear systems is challenging, and has recently spurred the…

Machine Learning · Computer Science 2022-02-10 P. -R. Wagner , S. Marelli , I. Papaioannou , D. Straub , B. Sudret

Prompt injection remains a central obstacle to the safe deployment of large language models, particularly in multi-agent settings where intermediate outputs can propagate or amplify malicious instructions. Building on earlier work that…

Artificial Intelligence · Computer Science 2026-01-21 Diego Gosmar , Deborah A. Dahl

The Sum-of-Squares (SoS) hierarchy is a semi-definite programming meta-algorithm that captures state-of-the-art polynomial time guarantees for many optimization problems such as Max-$k$-CSPs and Tensor PCA. On the flip side, a SoS lower…

Computational Complexity · Computer Science 2020-09-07 Mrinalkanti Ghosh , Fernando Granha Jeronimo , Chris Jones , Aaron Potechin , Goutham Rajendran