English
Related papers

Related papers: Semantic-Preserving Adversarial Code Comprehension

200 papers

Recent works have empirically shown that there exist adversarial examples that can be hidden from neural network interpretability (namely, making network interpretation maps visually similar), or interpretability is itself susceptible to…

Machine Learning · Computer Science 2020-10-23 Akhilan Boopathy , Sijia Liu , Gaoyuan Zhang , Cynthia Liu , Pin-Yu Chen , Shiyu Chang , Luca Daniel

Generating high-quality and interpretable adversarial examples in the text domain is a much more daunting task than it is in the image domain. This is due partly to the discrete nature of text, partly to the problem of ensuring that the…

Machine Learning · Computer Science 2019-05-31 Samuel Barham , Soheil Feizi

An adversarial example is a modified input image designed to cause a Machine Learning (ML) model to make a mistake; these perturbations are often invisible or subtle to human observers and highlight vulnerabilities in a model's ability to…

Cryptography and Security · Computer Science 2024-11-04 Ehsan Ganjidoost , Jeff Orchard

Adversarial attacks constitute a notable threat to machine learning systems, given their potential to induce erroneous predictions and classifications. However, within real-world contexts, the essential specifics of the deployed model are…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Jingwen Ye , Ruonan Yu , Songhua Liu , Xinchao Wang

This work considers supervised contrastive learning for semantic segmentation. We apply contrastive learning to enhance the discriminative power of the multi-scale features extracted by semantic segmentation networks. Our key methodological…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Theodoros Pissas , Claudio S. Ravasio , Lyndon Da Cruz , Christos Bergeles

Spatially-adaptive normalization is remarkably successful recently in conditional semantic image synthesis, which modulates the normalized activation with spatially-varying transformations learned from semantic layouts, to preserve the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Zhentao Tan , Dongdong Chen , Qi Chu , Menglei Chai , Jing Liao , Mingming He , Lu Yuan , Nenghai Yu

Recent research efforts on 3D point cloud semantic segmentation (PCSS) have achieved outstanding performance by adopting neural networks. However, the robustness of these complex models have not been systematically analyzed. Given that PCSS…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Jiacen Xu , Zhe Zhou , Boyuan Feng , Yufei Ding , Zhou Li

We present evidence that language models (LMs) of code can learn to represent the formal semantics of programs, despite being trained only to perform next-token prediction. Specifically, we train a Transformer model on a synthetic corpus of…

Machine Learning · Computer Science 2024-08-06 Charles Jin , Martin Rinard

Reinforcement learning (RL) has made a lot of advances for solving a single problem in a given environment; but learning policies that generalize to unseen variations of a problem remains challenging. To improve sample efficiency for…

Machine Learning · Computer Science 2021-12-07 Theresa Eimer , André Biedenkapp , Frank Hutter , Marius Lindauer

Despite pre-trained language models have proven useful for learning high-quality semantic representations, these models are still vulnerable to simple perturbations. Recent works aimed to improve the robustness of pre-trained models mainly…

Computation and Language · Computer Science 2021-07-02 Dong Wang , Ning Ding , Piji Li , Hai-Tao Zheng

Text classifiers are vulnerable to adversarial examples -- correctly-classified examples that are deliberately transformed to be misclassified while satisfying acceptability constraints. The conventional approach to finding adversarial…

Computation and Language · Computer Science 2024-05-21 Tom Roth , Inigo Jauregi Unanue , Alsharif Abuadbba , Massimo Piccardi

Large Language Models for Code (code LLMs) have demonstrated remarkable performance across various software engineering (SE) tasks, increasing the application of code LLMs in software development. Despite the success of code LLMs, there…

Software Engineering · Computer Science 2024-07-08 Thu-Trang Nguyen , Thanh Trong Vu , Hieu Dinh Vo , Son Nguyen

Recent recommender systems increasingly leverage embeddings from large pre-trained language models (PLMs). However, such embeddings exhibit two key limitations: (1) PLMs are not explicitly optimized to produce structured and discriminative…

Computation and Language · Computer Science 2026-01-19 Guy Hadad , Neomi Rabaev , Bracha Shapira

Unlike the flow structure of natural languages, programming languages have an inherent rigidity in structure and grammar.However, existing detection methods based on pre-trained models typically treat code as a natural language sequence,…

Software Engineering · Computer Science 2024-11-11 Ziliang Wang , Ge Li , Jia Li , Yihong Dong , Yingfei Xiong , Zhi Jin

Communication technologies like voice over IP operate under constrained real-time conditions, with voice packets being subject to delays and losses from the network. In such cases, the packet loss concealment (PLC) algorithm reconstructs…

Sound · Computer Science 2021-07-09 Santiago Pascual , Joan Serrà , Jordi Pons

Research on adversarial attacks are becoming widely popular in the recent years. One of the unexplored areas where prior research is lacking is the effect of adversarial attacks on code-mixed data. Therefore, in the present work, we have…

Computation and Language · Computer Science 2021-11-02 Sourya Dipta Das , Ayan Basak , Soumil Mandal , Dipankar Das

Transformers rely on both content-based and position-based addressing mechanisms to make predictions, but existing positional encoding techniques often diminish the effectiveness of position-based addressing. Many current methods enforce…

Computation and Language · Computer Science 2025-08-22 Jiajun Zhu , Peihao Wang , Ruisi Cai , Jason D. Lee , Pan Li , Zhangyang Wang

Over-parameterized neural language models (LMs) can memorize and recite long sequences of training data. While such memorization is normally associated with undesired properties such as overfitting and information leaking, our work casts…

Computation and Language · Computer Science 2023-10-17 Samuel Stevens , Yu Su

Deep neural networks have been shown to exhibit an intriguing vulnerability to adversarial input images corrupted with imperceptible perturbations. However, the majority of adversarial attacks assume global, fine-grained control over the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Ameya Joshi , Amitangshu Mukherjee , Soumik Sarkar , Chinmay Hegde

As the foundation of current natural language processing methods, pre-trained language model has achieved excellent performance. However, the black-box structure of the deep neural network in pre-trained language models seriously limits the…

Computation and Language · Computer Science 2023-06-28 Fanyu Wang , Zhenping Xie