English
Related papers

Related papers: Robust blind methods using $\ell_p$ quasi norms

200 papers

This paper explores the challenges of PAC learning in semi-enclosed environments that face persistent disruptive noise and demonstrates the weaknesses of traditional learning models based on noise-free data. We present a novel algorithm…

Machine Learning · Computer Science 2024-11-05 Shirmohammad Tavangari , Zahra Shakarami , Aref Yelghi , Asef Yelghi

This work considers the multi-channel blind deconvolution problem under the assumption that the channels are short. First, we investigate the ill-posedness issues inherent to blind deconvolution problems and sufficient and necessary…

Signal Processing · Electrical Eng. & Systems 2019-02-27 Antoine Paris , Laurent Jacques

The existence of adversarial data examples has drawn significant attention in the deep-learning community; such data are seemingly minimally perturbed relative to the original data, but lead to very different outputs from a deep-learning…

Machine Learning · Computer Science 2019-11-12 Bai Li , Changyou Chen , Wenlin Wang , Lawrence Carin

Quantifying the robustness of neural networks or verifying their safety properties against input uncertainties or adversarial attacks have become an important research area in learning-enabled systems. Most results concentrate around the…

Systems and Control · Electrical Eng. & Systems 2019-10-11 Mahyar Fazlyab , Manfred Morari , George J. Pappas

Consider the use of $\ell_{1}/\ell_{\infty}$-regularized regression for joint estimation of a $\pdim \times \numreg$ matrix of regression coefficients. We analyze the high-dimensional scaling of $\ell_1/\ell_\infty$-regularized quadratic…

Statistics Theory · Mathematics 2009-05-12 S. Negahban , M. J. Wainwright

The tremendous amount of accessible data in cyberspace face the risk of being unauthorized used for training deep learning models. To address this concern, methods are proposed to make data unlearnable for deep learning models by adding a…

Machine Learning · Computer Science 2022-03-29 Shaopeng Fu , Fengxiang He , Yang Liu , Li Shen , Dacheng Tao

Dictionary learning is a classic representation learning method that has been widely applied in signal processing and data analytics. In this paper, we investigate a family of $\ell_p$-norm ($p>2,p \in \mathbb{N}$) maximization approaches…

Machine Learning · Computer Science 2020-07-16 Yifei Shen , Ye Xue , Jun Zhang , Khaled B. Letaief , Vincent Lau

We investigate state estimation of linear systems over channels having a finite state not known by the transmitter or receiver. We show that similar to memoryless channels, zero-error capacity is the right figure of merit for achieving…

Systems and Control · Electrical Eng. & Systems 2021-10-06 Amir Saberi , Farhad Farokhi , Girish N. Nair

We study the recovery results of $\ell_p$-constrained compressive sensing (CS) with $p\geq 1$ via robust width property and determine conditions on the number of measurements for standard Gaussian matrices under which the property holds…

Information Theory · Computer Science 2017-08-28 Zhiyong Zhou , Jun Yu

We establish a theoretical link between adversarial training and operator norm regularization for deep neural networks. Specifically, we prove that $\ell_p$-norm constrained projected gradient ascent based adversarial training with an…

Machine Learning · Computer Science 2020-10-26 Kevin Roth , Yannic Kilcher , Thomas Hofmann

Existing ordinal embedding methods usually follow a two-stage routine: outlier detection is first employed to pick out the inconsistent comparisons; then an embedding is learned from the clean data. However, learning in a multi-stage manner…

Machine Learning · Computer Science 2018-12-06 Ke Ma , Qianqian Xu , Xiaochun Cao

As the hardware technology for quantum computing advances, its possible applications are actively searched and developed. However, such applications still suffer from the noise on quantum devices, in particular when using two-qubit gates…

Quantum Physics · Physics 2021-02-03 Kosuke Mitarai , Keisuke Fujii

Consider a stochastic nonlinear system controlled over a possibly noisy communication channel. An important problem is to characterize the largest class of channels for which there exist coding and control policies so that the closed-loop…

Optimization and Control · Mathematics 2021-02-11 Nicolas Garcia , Christoph Kawan , Serdar Yuksel

Recent advances (Sherman, 2017; Sidford and Tian, 2018; Cohen et al., 2021) have overcome the fundamental barrier of dimension dependence in the iteration complexity of solving $\ell_\infty$ regression with first-order methods. Yet it…

Optimization and Control · Mathematics 2025-06-18 Cedar Site Bai , Brian Bullins

Future wireless systems are expected to employ extremely large-scale multiple-input multiple-output (XL-MIMO) arrays at high carrier frequencies, where near-field propagation makes the channel depend jointly on angle and distance. The…

Signal Processing · Electrical Eng. & Systems 2026-05-27 Maral Safari , Italo Atzeni

The practice of compressed sensing suffers importantly in terms of the efficiency/accuracy trade-off when acquiring noisy signals prior to measurement. It is rather common to find results treating the noise affecting the measurements,…

Numerical Analysis · Mathematics 2014-11-25 Marco Artina , Massimo Fornasier , Steffen Peter

Recent work has shown that the hidden states of large language models contain signals useful for uncertainty estimation and hallucination detection, motivating a growing interest in efficient probe-based approaches. Yet it remains unclear…

Computation and Language · Computer Science 2026-04-14 Joe Stacey , Hadas Orgad , Kentaro Inui , Benjamin Heinzerling , Nafise Sadat Moosavi

Sparse estimation methods are aimed at using or obtaining parsimonious representations of data or models. While naturally cast as a combinatorial optimization problem, variable or feature selection admits a convex relaxation through the…

Machine Learning · Computer Science 2012-04-23 Francis Bach , Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski

Large-scale pre-trained models have achieved remarkable success in many applications, but how to leverage them to improve the prediction reliability of downstream models is undesirably under-explored. Moreover, modern neural networks have…

Machine Learning · Computer Science 2023-10-31 Peng Cui , Dan Zhang , Zhijie Deng , Yinpeng Dong , Jun Zhu

Partial Label Learning (PLL) is a type of weakly supervised learning where each training instance is assigned a set of candidate labels, but only one label is the ground-truth. However, this idealistic assumption may not always hold due to…

Machine Learning · Computer Science 2023-09-01 Yu Shi , Dong-Dong Wu , Xin Geng , Min-Ling Zhang