English
Related papers

Related papers: Robust blind methods using $\ell_p$ quasi norms

200 papers

Machine learning image classifiers are susceptible to adversarial and corruption perturbations. Adding imperceptible noise to images can lead to severe misclassifications of the machine learning model. Using $L_p$-norms for measuring the…

Machine Learning · Computer Science 2021-10-14 Tobias Wegel , Felix Assion , David Mickisch , Florens Greßner

Hybrid High-Order methods for elliptic diffusion problems have been originally formulated for loads in the Lebesgue space $L^2(\Omega)$. In this paper we devise and analyze a variant thereof, which is defined for any load in the dual…

Numerical Analysis · Mathematics 2019-05-01 Alexandre Ern , Pietro Zanotti

The practical implementation of maximum likelihood detection is limited by its high complexity as well as requiring perfect channel state information. Although conventional blind detection techniques reduce complexity, they degrade…

Signal Processing · Electrical Eng. & Systems 2019-09-12 M. A. Amirabadi

Training certifiable neural networks enables one to obtain models with robustness guarantees against adversarial attacks. In this work, we introduce a framework to bound the adversary-free region in the neighborhood of the input data by a…

Machine Learning · Computer Science 2021-09-21 Chen Liu , Mathieu Salzmann , Sabine Süsstrunk

We introduce the $\ell_0\ell_2$-norm regularization and hierarchy constraints into linear regression for the construction of cluster expansion to describe configurational disorder in materials. The approach is implemented through mixed…

Materials Science · Physics 2022-08-10 Peichen Zhong , Tina Chen , Luis Barroso-Luque , Fengyu Xie , Gerbrand Ceder

Sparsity finds applications in areas as diverse as statistics, machine learning, and signal processing. Computations over sparse structures are less complex compared to their dense counterparts, and their storage consumes less space. This…

Signal Processing · Electrical Eng. & Systems 2023-01-31 Omar M. Sleem , M. E. Ashour , N. S. Aybat , Constantino M. Lagoa

The reliability of deep learning algorithms is fundamentally challenged by the existence of adversarial examples, which are incorrectly classified inputs that are extremely close to a correctly classified input. We explore the properties of…

Machine Learning · Statistics 2021-07-23 Giacomo De Palma , Bobak T. Kiani , Seth Lloyd

Over the years, researchers have developed myriad attacks that exploit the ubiquity of adversarial examples, as well as defenses that aim to guard against the security vulnerabilities posed by such attacks. Of particular interest to this…

Machine Learning · Computer Science 2023-10-17 Ravi Mangal , Klas Leino , Zifan Wang , Kai Hu , Weicheng Yu , Corina Pasareanu , Anupam Datta , Matt Fredrikson

In this paper we provide an approach for deep learning that protects against adversarial examples in image classification-type networks. The approach relies on two mechanisms:1) a mechanism that increases robustness at the expense of…

Machine Learning · Computer Science 2021-01-07 Yuting Liang , Reza Samavi

This paper investigates the optimality conditions for characterizing the local minimizers of the constrained optimization problems involving an $\ell_p$ norm ($0<p<1$) of the variables, which may appear in either the objective or the…

Optimization and Control · Mathematics 2022-02-16 Hao Wang , Yining Gao , Jiashan Wang , Hongying Liu

We consider the problem of training a model under the presence of label noise. Current approaches identify samples with potentially incorrect labels and reduce their influence on the learning process by either assigning lower weights to…

Machine Learning · Computer Science 2019-06-04 Duc Tam Nguyen , Thi-Phuong-Nhung Ngo , Zhongyu Lou , Michael Klar , Laura Beggel , Thomas Brox

The method described here performs blind deconvolution of the beamforming output in the frequency domain. To provide accurate blind deconvolution, sparsity priors are introduced with a smooth \ell_1/\ell_2 regularization term. As the mean…

Data Analysis, Statistics and Probability · Physics 2016-04-13 Mai Quyen Pham , Benoit Oudompheng , Jérôme I. Mars , Barbara Nicolas

Oblivious low-distortion subspace embeddings are a crucial building block for numerical linear algebra problems. We show for any real $p, 1 \leq p < \infty$, given a matrix $M \in \mathbb{R}^{n \times d}$ with $n \gg d$, with constant…

Data Structures and Algorithms · Computer Science 2014-03-19 David P. Woodruff , Qin Zhang

Labelling of data for supervised learning can be costly and time-consuming and the risk of incorporating label noise in large data sets is imminent. When training a flexible discriminative model using a strictly proper loss, such noise will…

Machine Learning · Statistics 2022-05-13 Amanda Olmin , Fredrik Lindsten

The neural network with $1$-Lipschitz property based on $\ell_\infty$-dist neuron has a theoretical guarantee in certified $\ell_\infty$ robustness. However, due to the inherent difficulties in the training of the network, the certified…

Machine Learning · Computer Science 2021-07-02 Binghui Li , Shiji Xin , Qizhe Zhang

In this paper we look at a particular problem related to under-determined linear systems of equations with sparse solutions. $\ell_1$-minimization is a fairly successful polynomial technique that can in certain statistical scenarios find…

Information Theory · Computer Science 2015-07-17 Mihailo Stojnic

Massive MIMO has been regarded as a key enabling technique for 5G and beyond networks. Nevertheless, its performance is limited by the large overhead needed to obtain the high-dimensional channel information. To reduce the huge training…

Signal Processing · Electrical Eng. & Systems 2021-04-20 Ye Xue , Yifei Shen , Vincent Lau , Jun Zhang , Khaled B. Letaief

We consider classical Tsirelson-type norms of $T[A_r,\theta]$ and their modified versions on $\ell_p$ spaces. We show that for any $1<p<\infty$ there is a constant $\lambda_p$ such that considered Tsirelson-type norms do not…

Functional Analysis · Mathematics 2007-05-23 Anna Maria Pelczar

Implicit neural networks are a general class of learning models that replace the layers in traditional feedforward models with implicit algebraic equations. Compared to traditional learning models, implicit networks offer competitive…

Machine Learning · Computer Science 2021-12-13 Saber Jafarpour , Matthew Abate , Alexander Davydov , Francesco Bullo , Samuel Coogan

In this paper we investigate properties of several randomness generation protocols in the device independent framework. Using Bell-type inequalities it is possible to certify that the numbers generated by an untrusted device are indeed…

Quantum Physics · Physics 2013-09-25 Piotr Mironowicz , Marcin Pawłowski