English
Related papers

Related papers: Enhancing targeted transferability via feature spa…

200 papers

The utilization of large foundational models has a dilemma: while fine-tuning downstream tasks from them holds promise for making use of the well-generalized knowledge in practical applications, their open accessibility also poses threats…

Machine Learning · Computer Science 2025-04-22 Song Xia , Wenhan Yang , Yi Yu , Xun Lin , Henghui Ding , Ling-Yu Duan , Xudong Jiang

Existing transfer learning-based beam prediction approaches primarily rely on simple fine-tuning. When there is a significant difference in data distribution between the target domain and the source domain, simple fine-tuning limits the…

Information Theory · Computer Science 2025-09-26 Zhiqiang Xiao , Yuwen Cao , Mondher Bouazizi , Tomoaki Ohtsuki , Shahid Mumtaz

Recent works found that fine-tuning and joint training---two popular approaches for transfer learning---do not always improve accuracy on downstream tasks. First, we aim to understand more about when and why fine-tuning and joint training…

Machine Learning · Computer Science 2020-11-04 Hong Liu , Jeff Z. HaoChen , Colin Wei , Tengyu Ma

There is an increasing number of pre-trained deep neural network models. However, it is still unclear how to effectively use these models for a new task. Transfer learning, which aims to transfer knowledge from source tasks to a target…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Yunhui Guo , Yandong Li , Liqiang Wang , Tajana Rosing

Transfer-learning methods aim to improve performance in a data-scarce target domain using a model pretrained on a data-rich source domain. A cost-efficient strategy, linear probing, involves freezing the source model and training a new…

Machine Learning · Computer Science 2022-07-27 Utku Evci , Vincent Dumoulin , Hugo Larochelle , Michael C. Mozer

The transferability of adversarial examples allows the deception on black-box models, and transfer-based targeted attacks have attracted a lot of interest due to their practical applicability. To maximize the transfer success rate,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Junyoung Byun , Seungju Cho , Myung-Joon Kwon , Hee-Seon Kim , Changick Kim

In recent years, the topic of explainable machine learning (ML) has been extensively researched. Up until now, this research focused on regular ML users use-cases such as debugging a ML model. This paper takes a different posture and show…

Cryptography and Security · Computer Science 2022-06-02 Ishai Rosenberg , Shai Meir , Jonathan Berrebi , Ilay Gordon , Guillaume Sicard , Eli David

Although great progress has been made on adversarial attacks for deep neural networks (DNNs), their transferability is still unsatisfactory, especially for targeted attacks. There are two problems behind that have been long overlooked: 1)…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Lianli Gao , Qilong Zhang , Jingkuan Song , Heng Tao Shen

Adversarial examples pose significant threats to deep neural networks (DNNs), and their property of transferability in the black-box setting has led to the emergence of transfer-based attacks, making it feasible to target real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Yuyang Luo , Xiaosen Wang , Zhijin Ge , Yingzhe He

Consider the problem of improving the estimation of conditional average treatment effects (CATE) for a target domain of interest by leveraging related information from a source domain with a different feature space. This heterogeneous…

Machine Learning · Computer Science 2022-10-13 Ioana Bica , Mihaela van der Schaar

Parameter-efficient fine-tuning (PEFT) has become a common method for fine-tuning large language models, where a base model can serve multiple users through PEFT module switching. To enhance user experience, base models require periodic…

Computation and Language · Computer Science 2025-06-10 Naibin Gu , Peng Fu , Xiyu Liu , Ke Ma , Zheng Lin , Weiping Wang

Adversarial examples, characterized by imperceptible perturbations, pose significant threats to deep neural networks by misleading their predictions. A critical aspect of these examples is their transferability, allowing them to deceive…

Cryptography and Security · Computer Science 2025-04-22 Yi Yu , Song Xia , Xun Lin , Chenqi Kong , Wenhan Yang , Shijian Lu , Yap-Peng Tan , Alex C. Kot

Adversarial fine-tuning methods enhance adversarial robustness via fine-tuning the pre-trained model in an adversarial training manner. However, we identify that some specific latent features of adversarial samples are confused by…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Nuoyan Zhou , Dawei Zhou , Decheng Liu , Nannan Wang , Xinbo Gao

Style transfer has been an important topic both in computer vision and graphics. Since the seminal work of Gatys et al. first demonstrates the power of stylization through optimization in the deep feature space, quite a few approaches have…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Zhijie Wu , Chunjin Song , Yang Zhou , Minglun Gong , Hui Huang

We investigate if the random feature selection approach proposed in [1] to improve the robustness of forensic detectors to targeted attacks, can be extended to detectors based on deep learning features. In particular, we study the…

Cryptography and Security · Computer Science 2019-12-30 Mauro Barni , Ehsan Nowroozi , Benedetta Tondi , Bowen Zhang

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

AI-based sensing at wireless edge devices has the potential to significantly enhance Artificial Intelligence (AI) applications, particularly for vision and perception tasks such as in autonomous driving and environmental monitoring. AI…

Information Theory · Computer Science 2026-01-29 Mohamed Seif , Malcolm Egan , Andrea J. Goldsmith , H. Vincent Poor

The emergence of Deep Neural Networks (DNNs) has revolutionized various domains by enabling the resolution of complex tasks spanning image recognition, natural language processing, and scientific problem-solving. However, this progress has…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Jindong Gu , Xiaojun Jia , Pau de Jorge , Wenqain Yu , Xinwei Liu , Avery Ma , Yuan Xun , Anjun Hu , Ashkan Khakzar , Zhijiang Li , Xiaochun Cao , Philip Torr

Deep Neural Networks have been found vulnerable re-cently. A kind of well-designed inputs, which called adver-sarial examples, can lead the networks to make incorrectpredictions. Depending on the different scenarios, goalsand capabilities,…

Machine Learning · Computer Science 2022-06-14 Junde Wu , Rao Fu

Transfer learning is a critical technique in training deep neural networks for the challenging medical image segmentation task that requires enormous resources. With the abundance of medical image data, many research institutions release…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yuncheng Yang , Meng Wei , Junjun He , Jie Yang , Jin Ye , Yun Gu