English
Related papers

Related papers: Robust Weight Signatures: Gaining Robustness as Ea…

200 papers

Neural network pruning has traditionally focused on weight-based criteria to achieve model compression, frequently overlooking the crucial balance between adversarial robustness and accuracy. Existing approaches often fail to preserve…

Machine Learning · Computer Science 2025-03-20 Lincen Bai , Hedi Tabia , Raúl Santos-Rodríguez

The behaviour of gene regulatory networks (GRNs) is typically analysed using simulation-based statistical testing-like methods. In this paper, we demonstrate that we can replace this approach by a formal verification-like method that gives…

Computational Engineering, Finance, and Science · Computer Science 2015-01-19 Mirco Giacobbe , Calin C. Guet , Ashutosh Gupta , Thomas A. Henzinger , Tiago Paixao , Tatjana Petrov

Time series forecasting is an important and forefront task in many real-world applications. However, most of time series forecasting techniques assume that the training data is clean without anomalies. This assumption is unrealistic since…

Machine Learning · Computer Science 2024-02-06 Hao Cheng , Qingsong Wen , Yang Liu , Liang Sun

Robust Reversible Watermarking (RRW) enables perfect recovery of cover images and watermarks in lossless channels while ensuring robust watermark extraction in lossy channels. Existing RRW methods, mostly non-deep learning-based, face…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Jiale Chen , Wei Wang , Chongyang Shi , Li Dong , Yuanman Li , Xiping Hu

Effectively scaling up deep reinforcement learning models has proven notoriously difficult due to network pathologies during training, motivating various targeted interventions such as periodic reset and architectural advances such as layer…

Machine Learning · Computer Science 2025-06-23 Guozheng Ma , Lu Li , Zilin Wang , Li Shen , Pierre-Luc Bacon , Dacheng Tao

Latent diffusion models achieve state-of-the-art performance on a variety of generative tasks, such as image synthesis and image editing. However, the robustness of latent diffusion models is not well studied. Previous works only focus on…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Jianping Zhang , Zhuoer Xu , Shiwen Cui , Changhua Meng , Weibin Wu , Michael R. Lyu

Most networks encountered in nature, society, and technology have weighted edges, representing the strength of the interaction/association between their vertices. Randomizing the structure of a network is a classic procedure used to…

Physics and Society · Physics 2025-10-29 Filipi N. Silva , Sadamori Kojaku , Alessandro Flammini , Filippo Radicchi , Santo Fortunato

The literature on provable robustness in machine learning has primarily focused on static prediction problems, such as image classification, in which input samples are assumed to be independent and model performance is measured as an…

Machine Learning · Computer Science 2023-03-30 Aounon Kumar , Vinu Sankar Sadasivan , Soheil Feizi

We present weight normalization: a reparameterization of the weight vectors in a neural network that decouples the length of those weight vectors from their direction. By reparameterizing the weights in this way we improve the conditioning…

Machine Learning · Computer Science 2016-06-07 Tim Salimans , Diederik P. Kingma

Robustness to natural distribution shifts has seen remarkable progress thanks to recent pre-training strategies combined with better fine-tuning methods. However, such fine-tuning assumes access to large amounts of labelled data, and the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Aaditya Singh , Kartik Sarangmath , Prithvijit Chattopadhyay , Judy Hoffman

Consider a scenario where we have access to train data with both covariates and outcomes while test data only contains covariates. In this scenario, our primary aim is to predict the missing outcomes of the test data. With this objective in…

Methodology · Statistics 2024-10-29 Masahiro Kato , Kota Matsui , Ryo Inokuchi

In machine learning models, the estimation of errors is often complex due to distribution bias, particularly in spatial data such as those found in environmental studies. We introduce an approach based on the ideas of importance sampling to…

Machine Learning · Computer Science 2023-09-15 Boris Prokhorov , Diana Koldasbayeva , Alexey Zaytsev

As machine learning (ML) systems become pervasive, safeguarding their security is critical. However, recently it has been demonstrated that motivated adversaries are able to mislead ML systems by perturbing test data using semantic…

Machine Learning · Computer Science 2021-11-17 Linyi Li , Maurice Weber , Xiaojun Xu , Luka Rimanic , Bhavya Kailkhura , Tao Xie , Ce Zhang , Bo Li

When considering a model architecture, there are several ways to reduce its memory footprint. Historically, popular approaches included selecting smaller architectures and creating sparse networks through pruning. More recently, randomized…

Machine Learning · Computer Science 2023-10-19 Aditya Desai , Anshumali Shrivastava

Many systems in nature, society and technology can be described as networks, where the vertices are the system's elements and edges between vertices indicate the interactions between the corresponding elements. Edges may be weighted if the…

Physics and Society · Physics 2011-04-18 Filippo Radicchi , José J. Ramasco , Santo Fortunato

There exist many problem domains where the interpretability of neural network models is essential for deployment. Here we introduce a recurrent architecture composed of input-switched affine transformations - in other words an RNN without…

Artificial Intelligence · Computer Science 2017-06-14 Jakob N. Foerster , Justin Gilmer , Jan Chorowski , Jascha Sohl-Dickstein , David Sussillo

Convolutional neural network training can suffer from diverse issues like exploding or vanishing gradients, scaling-based weight space symmetry and covariant-shift. In order to address these issues, researchers develop weight regularization…

Computer Vision and Pattern Recognition · Computer Science 2021-03-12 Theodoros Georgiou , Sebastian Schmitt , Thomas Bäck , Wei Chen , Michael Lew

Detector-based and detector-free matchers are only applicable within their respective sparsity ranges. To improve adaptability of existing matchers, this paper introduces a novel probabilistic reweighting method. Our method is applicable to…

Image and Video Processing · Electrical Eng. & Systems 2025-04-08 Ya Fan , Rongling Lang

Transferability of adversarial examples is a well-known property that endangers all classification models, even those that are only accessible through black-box queries. Prior work has shown that an ensemble of models is more resilient to…

Machine Learning · Computer Science 2024-10-08 Ali Ebrahimpour-Boroojeny , Hari Sundaram , Varun Chandrasekaran

Robustness, the insensitivity of some of a biological system's functionalities to a set of distinct conditions, is intimately linked to fitness. Recent studies suggest that it may also play a vital role in enabling the evolution of species.…

Adaptation and Self-Organizing Systems · Physics 2011-12-15 James M Whitacre , Axel Bender