English
Related papers

Related papers: Enhancing Adversarial Transferability via Informat…

200 papers

Information Bottleneck (IB) is a technique to extract information about one target random variable through another relevant random variable. This technique has garnered significant interest due to its broad applications in information…

Information Theory · Computer Science 2024-04-09 Lingyi Chen , Shitong Wu , Jiachuan Ye , Huihui Wu , Wenyi Zhang , Hao Wu

We extend BeamAttack, an adversarial attack algorithm designed to evaluate the robustness of text classification systems through word-level modifications guided by beam search. Our extensions include support for word deletions and the…

Computation and Language · Computer Science 2025-07-04 Arnisa Fazla , Lucas Krauter , David Guzman Piedrahita , Andrianos Michail

Deep neural networks (DNNs) are highly susceptible to adversarial examples--subtle perturbations applied to inputs that are often imperceptible to humans yet lead to incorrect model predictions. In black-box scenarios, however, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Qing Wan , Shilong Deng , Xun Wang

Multi-agent reinforcement learning systems deployed in real-world robotics applications face severe communication constraints that significantly impact coordination effectiveness. We present a framework that combines information bottleneck…

Robotics · Computer Science 2026-02-03 Ahmad Farooq , Kamran Iqbal

The vulnerability of deep neural networks (DNNs) to black-box adversarial attacks is one of the most heated topics in trustworthy AI. In such attacks, the attackers operate without any insider knowledge of the model, making the cross-model…

Machine Learning · Computer Science 2025-01-08 Mingyuan Fan , Cen Chen , Wenmeng Zhou , Yinggui Wang

espite being widely used in network intrusion detection systems (NIDSs), machine learning (ML) has proven to be highly vulnerable to adversarial attacks. White-box and black-box adversarial attacks of NIDS have been explored in several…

Cryptography and Security · Computer Science 2024-01-22 Hangsheng Zhang , Dongqi Han , Yinlong Liu , Zhiliang Wang , Jiyan Sun , Shangyuan Zhuang , Jiqiang Liu , Jinsong Dong

The vulnerability of deep neural networks to adversarial examples has drawn tremendous attention from the community. Three approaches, optimizing standard objective functions, exploiting attention maps, and smoothing decision surfaces, are…

Machine Learning · Computer Science 2022-05-27 Yi Huang , Adams Wai-Kin Kong

Information Bottleneck (IB) based multi-view learning provides an information theoretic principle for seeking shared information contained in heterogeneous data descriptions. However, its great success is generally attributed to estimate…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Xudong Tian , Zhizhong Zhang , Cong Wang , Wensheng Zhang , Yanyun Qu , Lizhuang Ma , Zongze Wu , Yuan Xie , Dacheng Tao

The muti-layer information bottleneck (IB) problem, where information is propagated (or successively refined) from layer to layer, is considered. Based on information forwarded by the preceding layer, each stage of the network is required…

Machine Learning · Statistics 2017-11-15 Qianqian Yang , Pablo Piantanida , Deniz Gündüz

In generating adversarial examples, the conventional black-box attack methods rely on sufficient feedback from the to-be-attacked models by repeatedly querying until the attack is successful, which usually results in thousands of trials…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Renyang Liu , Wei Zhou , Xin Jin , Song Gao , Yuanyu Wang , Ruxin Wang

Mixup augmentation has been widely integrated to generate adversarial examples with superior adversarial transferability when immigrating from a surrogate model to other models. However, the underlying mechanism influencing the mixup's…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Xiaosen Wang , Zeyuan Yin

Lossy compression and clustering fundamentally involve a decision about what features are relevant and which are not. The information bottleneck method (IB) by Tishby, Pereira, and Bialek formalized this notion as an information-theoretic…

Neurons and Cognition · Quantitative Biology 2017-02-23 DJ Strouse , David J Schwab

Crowdsourced data used in machine learning services might carry sensitive information about attributes that users do not want to share. Various methods have been proposed to minimize the potential information leakage of sensitive attributes…

Machine Learning · Computer Science 2020-10-27 Han Zhao , Jianfeng Chi , Yuan Tian , Geoffrey J. Gordon

While large-scale pretrained language models have obtained impressive results when fine-tuned on a wide variety of tasks, they still often suffer from overfitting in low-resource scenarios. Since such models are general-purpose feature…

Computation and Language · Computer Science 2021-06-11 Rabeeh Karimi Mahabadi , Yonatan Belinkov , James Henderson

Variational quantum algorithms are leading candidates for near-term advantage, yet their scalability is fundamentally limited by the ``Barren Plateau'' phenomenon. While traditionally attributed to geometric concentration of measure, I…

Quantum Physics · Physics 2025-12-23 Jun Liang Tan

In many applications, it is desirable to extract only the relevant aspects of data. A principled way to do this is the information bottleneck (IB) method, where one seeks a code that maximizes information about a 'relevance' variable, Y,…

Machine Learning · Statistics 2016-10-27 Matthew Chalk , Olivier Marre , Gasper Tkacik

Deep neural networks are vulnerable to adversarial examples, which are crafted by adding human-imperceptible perturbations to original images. Most existing adversarial attack methods achieve nearly 100% attack success rates under the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Guoqiu Wang , Huanqian Yan , Ying Guo , Xingxing Wei

Transferability of adversarial examples is of critical importance to launch black-box adversarial attacks, where attackers are only allowed to access the output of the target model. However, under such a challenging but practical setting,…

Machine Learning · Computer Science 2022-03-01 Mingyuan Fan , Wenzhong Guo , Shengxing Yu , Zuobin Ying , Ximeng Liu

Extracting relevant information from data is crucial for all forms of learning. The information bottleneck (IB) method formalizes this, offering a mathematically precise and conceptually appealing framework for understanding learning…

Machine Learning · Computer Science 2021-10-27 Vudtiwat Ngampruetikorn , David J. Schwab

The advent of large language models (LLMs) has revolutionized the field of natural language processing, yet they might be attacked to produce harmful content. Despite efforts to ethically align LLMs, these are often fragile and can be…

Computation and Language · Computer Science 2024-10-11 Zichuan Liu , Zefan Wang , Linjie Xu , Jinyu Wang , Lei Song , Tianchun Wang , Chunlin Chen , Wei Cheng , Jiang Bian