English
Related papers

Related papers: LSDAT: Low-Rank and Sparse Decomposition for Decis…

200 papers

The task of compressing pre-trained Deep Neural Networks has attracted wide interest of the research community due to its great benefits in freeing practitioners from data access requirements. In this domain, low-rank approximation is a…

Machine Learning · Computer Science 2022-08-23 Zhewen Yu , Christos-Savvas Bouganis

It is by now well-known that small adversarial perturbations can induce classification errors in deep neural networks (DNNs). In this paper, we make the case that sparse representations of the input data are a crucial tool for combating…

Machine Learning · Statistics 2018-07-16 Soorya Gopalakrishnan , Zhinus Marzi , Upamanyu Madhow , Ramtin Pedarsani

Despite our best efforts, deep learning models remain highly vulnerable to even tiny adversarial perturbations applied to the inputs. The ability to extract information from solely the output of a machine learning model to craft adversarial…

Machine Learning · Computer Science 2023-03-27 Viet Quoc Vo , Ehsan Abbasnejad , Damith C. Ranasinghe

Deep learning models have achieved remarkable success in computer vision but remain vulnerable to adversarial attacks, particularly in black-box settings where model details are unknown. Existing adversarial attack methods(even those works…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Kimia haghjooei , Mansoor Rezghi

Herein, security of deep neural network against adversarial attack is considered. Existing compressive sensing based defence schemes assume that adversarial perturbations are usually on high frequency components, whereas recently it has…

Image and Video Processing · Electrical Eng. & Systems 2021-10-12 Akash Kumar Gupta , Arpan Chattopadhyay , Darpan Kumar Yadav

Adversarial images aim to change a target model's decision by minimally perturbing a target image. In the black-box setting, the absence of gradient information often renders this search problem costly in terms of query complexity. In this…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Chuan Guo , Jared S. Frank , Kilian Q. Weinberger

Sparse-view computed tomography (CT) is known as a widely used approach to reduce radiation dose while accelerating imaging through lowered projection views and correlated calculations. However, its severe imaging noise and streaking…

Image and Video Processing · Electrical Eng. & Systems 2021-01-20 Yitong Liu , Ken Deng , Chang Sun , Hongwen Yang

High-dimensional linear regression model is the most popular statistical model for high-dimensional data, but it is quite a challenging task to achieve a sparse set of regression coefficients. In this paper, we propose a simple heuristic…

Machine Learning · Computer Science 2022-11-29 Xue Yu , Yifan Sun , Haijun Zhou

Deep neural networks often suffer from poor generalization due to complex and non-convex loss landscapes. Sharpness-Aware Minimization (SAM) is a popular solution that smooths the loss landscape by minimizing the maximized change of…

Artificial Intelligence · Computer Science 2023-07-03 Peng Mi , Li Shen , Tianhe Ren , Yiyi Zhou , Tianshuo Xu , Xiaoshuai Sun , Tongliang Liu , Rongrong Ji , Dacheng Tao

Detecting moving objects from ground-based videos is commonly achieved by using background subtraction techniques. Low-rank matrix decomposition inspires a set of state-of-the-art approaches for this task. It is integrated with structured…

Computer Vision and Pattern Recognition · Computer Science 2020-04-22 Junpeng Zhang , Xiuping Jia , Jiankun Hu

Neural networks have been proven to be vulnerable to a variety of adversarial attacks. From a safety perspective, highly sparse adversarial attacks are particularly dangerous. On the other hand the pixelwise perturbations of sparse attacks…

Machine Learning · Computer Science 2019-09-12 Francesco Croce , Matthias Hein

Adversarial black-box attacks aim to craft adversarial perturbations by querying input-output pairs of machine learning models. They are widely used to evaluate the robustness of pre-trained models. However, black-box attacks often suffer…

Machine Learning · Computer Science 2020-11-11 Lu Wang , Huan Zhang , Jinfeng Yi , Cho-Jui Hsieh , Yuan Jiang

This work studies sparse adversarial perturbations, including both unstructured and structured ones. We propose a framework based on a white-box PGD-like attack method named Sparse-PGD to effectively and efficiently generate such…

Machine Learning · Computer Science 2025-11-21 Xuyang Zhong , Chen Liu

We present a novel approach to the formulation and the resolution of sparse Linear Discriminant Analysis (LDA). Our proposal, is based on penalized Optimal Scoring. It has an exact equivalence with penalized LDA, contrary to the multi-class…

Machine Learning · Computer Science 2012-07-03 Luis Francisco Sanchez Merchante , Yves Grandvalet , Gerrad Govaert

Data characterized by high dimensionality and sparsity are commonly used to describe real-world node interactions. Low-rank representation (LR) can map high-dimensional sparse (HDS) data to low-dimensional feature spaces and infer node…

Machine Learning · Computer Science 2024-08-30 Qicong Hu , Hao Wu

We propose an adversarial defense method that achieves state-of-the-art performance among attack-agnostic adversarial defense methods while also maintaining robustness to input resolution, scale of adversarial perturbation, and scale of…

Computer Vision and Pattern Recognition · Computer Science 2019-06-24 Bo Sun , Nian-hsuan Tsai , Fangchen Liu , Ronald Yu , Hao Su

Truncated singular value decomposition (SVD), also known as the best low-rank matrix approximation, has been successfully applied to many domains such as biology, healthcare, and others, where high-dimensional datasets are prevalent. To…

Optimization and Control · Mathematics 2022-08-09 Yongchun Li , Weijun Xie

Compressed sensing is an important problem in many fields of science and engineering. It reconstructs signals by finding sparse solutions to underdetermined linear equations. In this work we propose a deterministic and non-parametric…

Signal Processing · Electrical Eng. & Systems 2017-12-19 Mutian Shen , Pan Zhang , Hai-Jun Zhou

In recent year, the compact representations based on activations of Convolutional Neural Network (CNN) achieve remarkable performance in image retrieval. However, retrieval of some interested object that only takes up a small part of the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-01 Jian Xu , Chunheng Wang , Cunzhao Shi , Baihua Xiao

Deep neural networks (DNNs) have been showed to be highly vulnerable to imperceptible adversarial perturbations. As a complementary type of adversary, patch attacks that introduce perceptible perturbations to the images have attracted the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Zhaoyu Chen , Bo Li , Shuang Wu , Shouhong Ding , Wenqiang Zhang