English
Related papers

Related papers: Self-Comparison for Dataset-Level Membership Infer…

200 papers

Over the past year, the field of Natural Language Generation (NLG) has experienced an exponential surge, largely due to the introduction of Large Language Models (LLMs). These models have exhibited the most effective performance in a range…

Computation and Language · Computer Science 2024-04-22 Lasal Jayawardena , Prasan Yapa

In this work, we develop a specialized dataset aimed at enhancing the evaluation and fine-tuning of large language models (LLMs) specifically for wireless communication applications. The dataset includes a diverse set of multi-hop…

Machine Learning · Computer Science 2025-01-17 Yushen Lin , Ruichen Zhang , Wenqi Huang , Kaidi Wang , Zhiguo Ding , Daniel K. C. So , Dusit Niyato

Vision-language models (VLMs) extend the conventional large language models by integrating visual data, enabling richer multimodal reasoning and significantly broadens the practical applications of AI. However, including visual inputs also…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Daulet Toibazar , Kesen Wang , Sherif Mohamed , Abdulaziz Al-Badawi , Abdulrahman Alfulayt , Pedro J. Moreno

Large Reasoning Models (LRMs) have rapidly gained prominence for their strong performance in solving complex tasks. Many modern black-box LRMs expose the intermediate reasoning traces through APIs to improve transparency (e.g., Gemini-2.5…

Cryptography and Security · Computer Science 2026-01-21 Ruihan Hu , Yu-Ming Shang , Wei Luo , Ye Tao , Xi Zhang

Large vision-language models (LVLMs) have achieved impressive results in visual question-answering and reasoning tasks through vision instruction tuning on specific datasets. However, there remains significant room for improvement in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Xiyao Wang , Jiuhai Chen , Zhaoyang Wang , Yuhang Zhou , Yiyang Zhou , Huaxiu Yao , Tianyi Zhou , Tom Goldstein , Parminder Bhatia , Furong Huang , Cao Xiao

Large Language Models (LLMs) have demonstrated impressive capabilities in generating diverse and contextually rich text. However, concerns regarding copyright infringement arise as LLMs may inadvertently produce copyrighted material. In…

Autoregressive language models (ARMs) have been shown to memorize and occasionally reproduce training data verbatim, raising concerns about privacy and copyright liability. Diffusion language models (DLMs) have recently emerged as a…

Computation and Language · Computer Science 2026-03-04 Xiaoyu Luo , Wenrui Yu , Qiongxiu Li , Johannes Bjerva

Large Language Models (LLMs) have demonstrated impressive performance on a wide range of natural language processing (NLP) tasks, primarily through in-context learning (ICL). In ICL, the LLM is provided with examples that represent a given…

Computation and Language · Computer Science 2025-02-19 Abdellah El Mekki , Muhammad Abdul-Mageed

Large language models (LLMs) learn a vast amount of knowledge during pretraining, but they are often oblivious to the source(s) of such knowledge. We investigate the problem of intrinsic source citation, where LLMs are required to cite the…

Computation and Language · Computer Science 2024-08-14 Muhammad Khalifa , David Wadden , Emma Strubell , Honglak Lee , Lu Wang , Iz Beltagy , Hao Peng

Federated Learning (FL) is an emerging solution to the data scarcity problem for training deep learning models in hardware assurance. While FL is designed to enhance privacy by not sharing raw data, it remains vulnerable to Membership…

Cryptography and Security · Computer Science 2026-04-23 Gijung Lee , Wavid Bowman , Olivia P. Dizon-Paradis , Reiner N. Dizon-Paradis , Ronald Wilson , Damon L. Woodard , Domenic Forte

Automatic speech recognition (ASR) systems have achieved strong performance on general transcription tasks. However, they continue to struggle with recognizing rare named entities and adapting to domain mismatches. In contrast, large…

Computation and Language · Computer Science 2025-08-21 Shaoshi Ling , Guoli Ye

In the age of agentic AI, the growing deployment of multi-modal models (MMs) has introduced new attack vectors that can leak sensitive training data in MMs, causing privacy leakage. This paper investigates a black-box privacy attack, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 David Amebley , Sayanton Dibbo

Recent studies have highlighted the significant potential of Large Language Models (LLMs) as zero-shot relevance rankers. These methods predominantly utilize prompt learning to assess the relevance between queries and documents by…

Information Retrieval · Computer Science 2024-11-08 Dezhi Ye , Junwei Hu , Jiabin Fan , Bowen Tian , Jie Liu , Haijin Liang , Jin Ma

Semiparametric language models (LMs) have shown promise in continuously learning from new text data by combining a parameterized neural LM with a growable non-parametric memory for memorizing new content. However, conventional…

Computation and Language · Computer Science 2023-03-03 Guangyue Peng , Tao Ge , Si-Qing Chen , Furu Wei , Houfeng Wang

Membership inference (MI) determines if a sample was part of a victim model training set. Recent development of MI attacks focus on record-level membership inference which limits their application in many real-world scenarios. For example,…

Machine Learning · Computer Science 2022-04-27 Guoyao Li , Shahbaz Rezaei , Xin Liu

As Large Language Models (LLMs) are increasingly applied to document-based tasks - such as document summarization, question answering, and information extraction - where user requirements focus on retrieving information from provided…

Information Retrieval · Computer Science 2025-05-13 Vipula Rawte , Ryan A. Rossi , Franck Dernoncourt , Nedim Lipka

Large Language Models (LLMs) herald a transformative era in artificial intelligence (AI). However, the expansive scale of data and parameters of LLMs requires high-demand computational and memory resources, restricting their accessibility…

Machine Learning · Computer Science 2024-11-26 Shengwen Ding , Chenhui Hu

Despite significant advancements in vision-language models (VLMs), there lacks effective approaches to enhance response quality by scaling inference-time computation. This capability is known to be a core step towards the self-improving…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Xiyao Wang , Zhengyuan Yang , Linjie Li , Hongjin Lu , Yuancheng Xu , Chung-Ching Lin , Kevin Lin , Furong Huang , Lijuan Wang

Context: The emergence of Large Language Models (LLMs) has significantly transformed Software Engineering (SE) by providing innovative methods for analyzing software repositories. Objectives: Our objective is to establish a practical…

Software Engineering · Computer Science 2024-12-13 Vincenzo de Martino , Joel Castaño , Fabio Palomba , Xavier Franch , Silverio Martínez-Fernández

This work adapts and studies the gradient-based Membership Inference Test (gMINT) to the classification of text based on LLMs. MINT is a general approach intended to determine if given data was used for training machine learning models, and…

Computation and Language · Computer Science 2025-03-14 Gonzalo Mancera , Daniel DeAlcala , Julian Fierrez , Ruben Tolosana , Aythami Morales