English
Related papers

Related papers: Feature-level analysis and adversarial transfer in…

200 papers

Transfer learning is a powerful technique for knowledge-sharing between different tasks. Recent work has found that the representations of models with certain invariances, such as to adversarial input perturbations, achieve higher…

Machine Learning · Computer Science 2024-07-08 Till Speicher , Vedant Nanda , Krishna P. Gummadi

Machine learning is used for inference and decision making in wearable sensor systems. However, recent studies have found that machine learning algorithms are easily fooled by the addition of adversarial perturbations to their inputs. What…

Machine Learning · Computer Science 2021-07-16 Ramesh Kumar Sah , Hassan Ghasemzadeh

The rapid increase in the volume of data increased the size and complexity of the deep learning models. These models are now more resource-intensive and time-consuming for training than ever. This paper presents a quantum transfer learning…

Quantum Physics · Physics 2024-09-04 Sounak Bhowmik , Himanshu Thapliyal

Quantized neural networks (QNNs) are increasingly used for efficient deployment of deep learning models on resource-constrained platforms, such as mobile devices and edge computing systems. While quantization reduces model size and…

Cryptography and Security · Computer Science 2025-02-26 Amira Guesmi , Bassem Ouni , Muhammad Shafique

Security-critical machine-learning (ML) systems, such as face-recognition systems, are susceptible to adversarial examples, including real-world physically realizable attacks. Various means to boost ML's adversarial robustness have been…

Machine Learning · Computer Science 2026-01-21 Haneen Najjar , Eyal Ronen , Mahmood Sharif

Given the apparent difficulty of learning models that are robust to adversarial perturbations, we propose tackling the simpler problem of developing adversarially robust features. Specifically, given a dataset and metric of interest, the…

Machine Learning · Computer Science 2024-08-27 Shivam Garg , Vatsal Sharan , Brian Hu Zhang , Gregory Valiant

Deep Learning models hold state-of-the-art performance in many fields, but their vulnerability to adversarial examples poses threat to their ubiquitous deployment in practical settings. Additionally, adversarial inputs generated on one…

Machine Learning · Computer Science 2021-03-31 Deepak Ravikumar , Sangamesh Kodge , Isha Garg , Kaushik Roy

Extensive work has demonstrated that equivariant neural networks can significantly improve sample efficiency and generalization by enforcing an inductive bias in the network architecture. These applications typically assume that the domain…

Machine Learning · Computer Science 2023-02-13 Dian Wang , Jung Yeon Park , Neel Sortur , Lawson L. S. Wong , Robin Walters , Robert Platt

With the emergence of large-scale pre-trained neural networks, methods to adapt such "foundation" models to data-limited downstream tasks have become a necessity. Fine-tuning, preference optimization, and transfer learning have all been…

Machine Learning · Statistics 2025-07-09 Javan Tahir , Surya Ganguli , Grant M. Rotskoff

A significant obstacle in the development of robust machine learning models is covariate shift, a form of distribution shift that occurs when the input distributions of the training and test sets differ while the conditional label…

Machine Learning · Statistics 2021-11-17 Nilesh Tripuraneni , Ben Adlam , Jeffrey Pennington

Knowledge transferability, or transfer learning, has been widely adopted to allow a pre-trained model in the source domain to be effectively adapted to downstream tasks in the target domain. It is thus important to explore and understand…

Machine Learning · Computer Science 2021-07-12 Kaizhao Liang , Jacky Y. Zhang , Boxin Wang , Zhuolin Yang , Oluwasanmi Koyejo , Bo Li

Transfer learning has become a common practice for training deep learning models with limited labeled data in a target domain. On the other hand, deep models are vulnerable to adversarial attacks. Though transfer learning has been widely…

Machine Learning · Computer Science 2020-08-26 Yinghua Zhang , Yangqiu Song , Jian Liang , Kun Bai , Qiang Yang

Feature selection eliminates redundancy among features to improve downstream task performance while reducing computational overhead. Existing methods often struggle to capture intricate feature interactions and adapt across diverse…

Machine Learning · Computer Science 2026-03-02 Rui Liu , Tao Zhe , Yanjie Fu , Feng Xia , Ted Senator , Dongjie Wang

Variational quantum algorithms are the leading candidate for advantage on near-term quantum hardware. When training a parametrized quantum circuit in this setting to solve a specific problem, the choice of ansatz is one of the most…

Quantum Physics · Physics 2023-04-25 Andrea Skolik , Michele Cattelan , Sheir Yarkoni , Thomas Bäck , Vedran Dunjko

Although group convolutional networks are able to learn powerful representations based on symmetry patterns, they lack explicit means to learn meaningful relationships among them (e.g., relative positions and poses). In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 David W. Romero , Erik J. Bekkers , Jakub M. Tomczak , Mark Hoogendoorn

Transfer-based attacks pose a significant threat to real-world applications by directly targeting victim models with adversarial examples generated on surrogate models. While numerous approaches have been proposed to enhance adversarial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Bohan Liu , Xiaosen Wang

Increasing use of ML technologies in privacy-sensitive domains such as medical diagnoses, lifestyle predictions, and business decisions highlights the need to better understand if these ML technologies are introducing leakages of sensitive…

Cryptography and Security · Computer Science 2020-12-08 Shagufta Mehnaz , Ninghui Li , Elisa Bertino

Machine learning, deep learning, has been accelerating computational physics, which has been used to simulate systems on a lattice. Equivariance is essential to simulate a physical system because it imposes a strong induction bias for the…

High Energy Physics - Lattice · Physics 2023-10-23 Akio Tomiya , Yuki Nagai

A machine learning model is traditionally considered robust if its prediction remains (almost) constant under input perturbations with small norm. However, real-world tasks like molecular property prediction or point cloud segmentation have…

Machine Learning · Computer Science 2024-01-17 Jan Schuchardt , Yan Scholten , Stephan Günnemann

Deep learning-based discriminative classifiers, despite their remarkable success, remain vulnerable to adversarial examples that can mislead model predictions. While adversarial training can enhance robustness, it fails to address the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Chunheng Zhao , Pierluigi Pisu , Gurcan Comert , Negash Begashaw , Varghese Vaidyan , Nina Christine Hubig