中文
相关论文

相关论文: Adversarial Contrastive Learning for LLM Quantizat…

200 篇论文

Contrastive learning (CL) continuously achieves significant breakthroughs across multiple domains. However, the most common InfoNCE-based methods suffer from some dilemmas, such as \textit{uniformity-tolerance dilemma} (UTD) and…

机器学习 · 计算机科学 2023-06-13 Zizheng Huang , Haoxing Chen , Ziqi Wen , Chao Zhang , Huaxiong Li , Bo Wang , Chunlin Chen

The rapid growth of Large Language Models (LLMs) usage has highlighted the importance of gradient-free in-context learning (ICL). However, interpreting their inner workings remains challenging. This paper introduces a novel multimodal…

计算与语言 · 计算机科学 2024-08-26 Yosuke Miyanishi , Minh Le Nguyen

Click-through rate (CTR) prediction becomes indispensable in ubiquitous web recommendation applications. Nevertheless, the current methods are struggling under the cold-start scenarios where the user interactions are extremely sparse. We…

信息检索 · 计算机科学 2021-09-30 Yujie Pan , Jiangchao Yao , Bo Han , Kunyang Jia , Ya Zhang , Hongxia Yang

Contrastive Learning (CL) has emerged as a dominant technique for unsupervised representation learning which embeds augmented versions of the anchor close to each other (positive samples) and pushes the embeddings of other samples…

人工智能 · 计算机科学 2022-06-15 Jun Xia , Lirong Wu , Ge Wang , Jintao Chen , Stan Z. Li

Domain adaptation is one of the most crucial techniques to mitigate the domain shift problem, which exists when transferring knowledge from an abundant labeled sourced domain to a target domain with few or no labels. Partial domain…

计算机视觉与模式识别 · 计算机科学 2020-09-22 Youshan Zhang , Brian D. Davison

Contrastive Learning (CL) enhances the training of sequential recommendation (SR) models through informative self-supervision signals. Existing methods often rely on data augmentation strategies to create positive samples and promote…

信息检索 · 计算机科学 2026-04-06 Zhikai Wang , Yanyan Shen , Zexi Zhang , Li He , Yichun Li , Hao Gu , Yinghua Zhang

Safety-aligned large language models (LLMs) often generate refusal responses to harmless queries due to the over-refusal problem. However, existing methods for mitigating over-refusal cannot maintain a low refusal ratio for harmless queries…

计算与语言 · 计算机科学 2026-04-21 Yupeng Qi , Ziyu Lyu , Lixin Cui , Lu Bai , Feng Xia

Indoor localization has become increasingly vital for many applications from tracking assets to delivering personalized services. Yet, achieving pinpoint accuracy remains a challenge due to variations across indoor environments and devices…

机器学习 · 计算机科学 2023-11-14 Danish Gufran , Sudeep Pasricha

Meta-learning enables a model to learn from very limited data to undertake a new task. In this paper, we study the general meta-learning with adversarial samples. We present a meta-learning algorithm, ADML (ADversarial Meta-Learner), which…

机器学习 · 计算机科学 2020-06-23 Chengxiang Yin , Jian Tang , Zhiyuan Xu , Yanzhi Wang

Although pre-trained language models (PrLMs) have achieved significant success, recent studies demonstrate that PrLMs are vulnerable to adversarial attacks. By generating adversarial examples with slight perturbations on different levels…

计算与语言 · 计算机科学 2022-08-23 Jiayi Wang , Rongzhou Bao , Zhuosheng Zhang , Hai Zhao

In real life, adversarial attack to deep learning models is a fatal security issue. However, the issue has been rarely discussed in a widely used class-incremental continual learning (CICL). In this paper, we address problems of applying…

机器学习 · 计算机科学 2023-05-24 Minchan Kwon , Kangil Kim

Recently, unsupervised adversarial training (AT) has been highlighted as a means of achieving robustness in models without any label information. Previous studies in unsupervised AT have mostly focused on implementing self-supervised…

机器学习 · 计算机科学 2023-10-27 Minseon Kim , Hyeonjeong Ha , Sooel Son , Sung Ju Hwang

Large language models (LLMs) can often be made to behave in undesirable ways that they are explicitly fine-tuned not to. For example, the LLM red-teaming literature has produced a wide variety of 'jailbreaking' techniques to elicit harmful…

Large Language Model (LLM) agents can leverage tools such as Google Search to complete complex tasks. However, this tool usage introduces the risk of indirect prompt injections, where malicious instructions hidden in tool outputs can…

Hard negative mining has shown effective in enhancing self-supervised contrastive learning (CL) on diverse data types, including graph CL (GCL). The existing hardness-aware CL methods typically treat negative instances that are most similar…

机器学习 · 计算机科学 2024-01-09 Chaoxi Niu , Guansong Pang , Ling Chen

Security alignment enables the Large Language Model (LLM) to gain the protection against malicious queries, but various jailbreak attack methods reveal the vulnerability of this security mechanism. Previous studies have isolated LLM…

密码学与安全 · 计算机科学 2025-08-07 Xiaohu Li , Yunfeng Ning , Zepeng Bao , Mayi Xu , Jianhao Chen , Tieyun Qian

Large Language Models (LLMs) have demonstrated impressive capabilities in natural language tasks, but their safety and morality remain contentious due to their training on internet text corpora. To address these concerns, alignment…

计算与语言 · 计算机科学 2024-08-06 Mohammad Bahrami Karkevandi , Nishant Vishwamitra , Peyman Najafirad

The rapid expansion of research on Large Language Model (LLM) safety and robustness has produced a fragmented and oftentimes buggy ecosystem of implementations, datasets, and evaluation methods. This fragmentation makes reproducibility and…

人工智能 · 计算机科学 2025-11-07 Tim Beyer , Jonas Dornbusch , Jakob Steimle , Moritz Ladenburger , Leo Schwinn , Stephan Günnemann

In this paper, we present a new form of backdoor attack against Large Language Models (LLMs): lingual-backdoor attacks. The key novelty of lingual-backdoor attacks is that the language itself serves as the trigger to hijack the infected…

密码学与安全 · 计算机科学 2025-05-07 Zihan Wang , Hongwei Li , Rui Zhang , Wenbo Jiang , Kangjie Chen , Tianwei Zhang , Qingchuan Zhao , Guowen Xu

Contrastive learning (CL) methods effectively learn data representations in a self-supervision manner, where the encoder contrasts each positive sample over multiple negative samples via a one-vs-many softmax cross-entropy loss. By…