中文
相关论文

相关论文: Domain Adversarial Fine-Tuning as an Effective Reg…

200 篇论文

Effective regularization techniques are highly desired in deep learning for alleviating overfitting and improving generalization. This work proposes a new regularization scheme, based on the understanding that the flat local minima of the…

机器学习 · 计算机科学 2021-05-10 Yaowei Zheng , Richong Zhang , Yongyi Mao

Unsupervised domain adaptation, which involves transferring knowledge from a label-rich source domain to an unlabeled target domain, can be used to substantially reduce annotation costs in the field of object detection. In this study, we…

计算机视觉与模式识别 · 计算机科学 2024-10-28 Kazuma Fujii , Hiroshi Kera , Kazuhiko Kawamoto

The rise of pre-trained language models has yielded substantial progress in the vast majority of Natural Language Processing (NLP) tasks. However, a generic approach towards the pre-training procedure can naturally be sub-optimal in some…

计算与语言 · 计算机科学 2021-09-03 Entony Lekhtman , Yftah Ziser , Roi Reichart

Adversarial attacks on machine learning-based classifiers, along with defense mechanisms, have been widely studied in the context of single-label classification problems. In this paper, we shift the attention to multi-label classification,…

Adversarial training (AT) has proven to be one of the most effective ways to defend Deep Neural Networks (DNNs) against adversarial attacks. However, the phenomenon of robust overfitting, i.e., the robustness will drop sharply at a certain…

机器学习 · 计算机科学 2022-05-25 Shudong Zhang , Haichang Gao , Tianwei Zhang , Yunyi Zhou , Zihui Wu

Domain adaptation (DA) mitigates the domain shift problem when transferring knowledge from one annotated domain to another similar but different unlabeled domain. However, existing models often utilize one of the ImageNet models as the…

计算机视觉与模式识别 · 计算机科学 2021-05-04 Youshan Zhang , Brian D. Davison

Adversarial Reprogramming has demonstrated success in utilizing pre-trained neural network classifiers for alternative classification tasks without modification to the original network. An adversary in such an attack scenario trains an…

机器学习 · 计算机科学 2019-08-16 Paarth Neekhara , Shehzeen Hussain , Shlomo Dubnov , Farinaz Koushanfar

While deep learning techniques have shown promising results in many natural language processing (NLP) tasks, it has not been widely applied to the clinical domain. The lack of large datasets and the pervasive use of domain-specific language…

计算与语言 · 计算机科学 2019-06-20 Jiin Nam , Seunghyun Yoon , Kyomin Jung

The progress in the last decade has enabled machine learning models to achieve impressive performance across a wide range of tasks in Computer Vision. However, a plethora of works have demonstrated the susceptibility of these models to…

机器学习 · 计算机科学 2020-02-06 B. S. Vivek , R. Venkatesh Babu

We present a new paradigm for fine-tuning large-scale visionlanguage pre-trained models on downstream task, dubbed Prompt Regularization (ProReg). Different from traditional fine-tuning which easily overfits to the downstream task data,…

计算机视觉与模式识别 · 计算机科学 2025-08-14 Beier Zhu , Yulei Niu , Saeil Lee , Minhoe Hur , Hanwang Zhang

Language-conditioned robotic learning has significantly enhanced robot adaptability by enabling a single model to execute diverse tasks in response to verbal commands. Despite these advancements, security vulnerabilities within this domain…

机器学习 · 计算机科学 2024-11-26 Ke Zhao , Huayang Huang , Miao Li , Yu Wu

Language models pretrained on text from a wide variety of sources form the foundation of today's NLP. In light of the success of these broad-coverage models, we investigate whether it is still helpful to tailor a pretrained model to the…

计算与语言 · 计算机科学 2020-05-07 Suchin Gururangan , Ana Marasović , Swabha Swayamdipta , Kyle Lo , Iz Beltagy , Doug Downey , Noah A. Smith

Underpinning the success of deep learning is effective regularizations that allow a variety of priors in data to be modeled. For example, robustness to adversarial perturbations, and correlations between multiple modalities. However, most…

机器学习 · 计算机科学 2020-06-16 Mao Li , Yingyi Ma , Xinhua Zhang

With the abundance of large-scale deep learning models, it has become possible to repurpose pre-trained networks for new tasks. Recent works on adversarial reprogramming have shown that it is possible to repurpose neural networks for…

人工智能 · 计算机科学 2021-10-26 Paarth Neekhara , Shehzeen Hussain , Jinglong Du , Shlomo Dubnov , Farinaz Koushanfar , Julian McAuley

As powerful Large Language Models (LLMs) are now widely used for numerous practical applications, their safety is of critical importance. While alignment techniques have significantly improved overall safety, LLMs remain vulnerable to…

机器学习 · 计算机科学 2024-10-28 Samuel Jacob Chacko , Sajib Biswas , Chashi Mahiul Islam , Fatema Tabassum Liza , Xiuwen Liu

Classical model-based imaging methods for ultrasound elasticity inverse problem require prior constraints about the underlying elasticity patterns, while finding the appropriate hand-crafted prior for each tissue type is a challenge. In…

图像与视频处理 · 电气工程与系统科学 2021-06-16 Narges Mohammadi , Marvin M. Doyley , Mujdat Cetin

Recently, a multitude of methods for image-to-image translation have demonstrated impressive results on problems such as multi-domain or multi-attribute transfer. The vast majority of such works leverages the strengths of adversarial…

计算机视觉与模式识别 · 计算机科学 2021-02-02 James Oldfield , Yannis Panagakis , Mihalis A. Nicolaou

Transfer learning has emerged as a powerful methodology for adapting pre-trained deep neural networks on image recognition tasks to new domains. This process consists of taking a neural network pre-trained on a large feature-rich source…

机器学习 · 计算机科学 2021-04-27 Francisco Utrera , Evan Kravitz , N. Benjamin Erichson , Rajiv Khanna , Michael W. Mahoney

Deep neural networks (DNNs) have set benchmarks on a wide array of supervised learning tasks. Trained DNNs, however, often lack robustness to minor adversarial perturbations to the input, which undermines their true practicality. Recent…

机器学习 · 计算机科学 2018-11-20 Farzan Farnia , Jesse M. Zhang , David Tse

To train a deep neural network to mimic the outcomes of processing sequences, a version of Conditional Generalized Adversarial Network (CGAN) can be used. It has been observed by others that CGAN can help to improve the results even for…