中文
相关论文

相关论文: Addressing Topic Leakage in Cross-Topic Evaluation…

200 篇论文

This paper is our attempt at answering a twofold question covering the areas of ethics and authorship analysis. Firstly, since the methods used for performing authorship analysis imply that an author can be recognized by the content he or…

计算与语言 · 计算机科学 2022-07-20 Jagna Nieuwazny , Karol Nowakowski , Michal Ptaszynski , Fumito Masui

Topic modelling is a text mining technique for identifying salient themes from a number of documents. The output is commonly a set of topics consisting of isolated tokens that often co-occur in such documents. Manual effort is often…

计算与语言 · 计算机科学 2024-04-26 Lowri Williams , Eirini Anthi , Laura Arman , Pete Burnap

Cultural-scale models of full text documents are prone to over-interpretation by researchers making unintentionally strong socio-linguistic claims (Pechenick et al., 2015) without recognizing that even large digital libraries are merely…

数字图书馆 · 计算机科学 2017-02-14 Jaimie Murdock , Jiaan Zeng , Colin Allen

This paper proposes a Hadith-inspired multi-axis trust modeling framework, motivated by a structurally analogous problem in classical Hadith scholarship: assessing the trustworthiness of information sources using interpretable,…

人工智能 · 计算机科学 2026-03-17 Mohammad AL-Smadi

As large language models (LLMs) rapidly advance and integrate into daily life, the privacy risks they pose are attracting increasing attention. We focus on a specific privacy risk where LLMs may help identify the authorship of anonymous…

计算与语言 · 计算机科学 2024-11-21 Zichen Wen , Dadi Guo , Huishuai Zhang

Existing topic modeling and text segmentation methodologies generally require large datasets for training, limiting their capabilities when only small collections of text are available. In this work, we reexamine the inter-related problems…

信息检索 · 计算机科学 2021-05-26 Qiong Wu , Adam Hare , Sirui Wang , Yuwei Tu , Zhenming Liu , Christopher G. Brinton , Yanhua Li

We propose two models for a special case of authorship verification problem. The task is to investigate whether the two documents of a given pair are written by the same author. We consider the authorship verification problem for both small…

计算与语言 · 计算机科学 2018-03-20 Marjan Hosseinia , Arjun Mukherjee

Open Large Language Model (LLM) benchmarks, such as HELM and BIG-Bench, provide standardized and transparent evaluation protocols that support comparative analysis, reproducibility, and systematic progress tracking in Language Model (LM)…

Responsible use of Authorship Verification (AV) systems not only requires high accuracy but also interpretable solutions. More importantly, for systems to be used to make decisions with real-world consequences requires the model's…

Detecting "toxic" language in internet content is a pressing social and technical challenge. In this work, we focus on PERSPECTIVE from Jigsaw, a state-of-the-art tool that promises to score the "toxicity" of text, with a recent model…

计算与语言 · 计算机科学 2023-01-06 Lorena Piedras , Lucas Rosenblatt , Julia Wilkins

Topic modelling is a pivotal unsupervised machine learning technique for extracting valuable insights from large document collections. Existing neural topic modelling methods often encode contextual information of documents, while ignoring…

计算与语言 · 计算机科学 2025-02-07 Yanan Ma , Chenghao Xiao , Chenhan Yuan , Sabine N van der Veer , Lamiece Hassan , Chenghua Lin , Goran Nenadic

Despite decades of research on authorship attribution (AA) and authorship verification (AV), inconsistent dataset splits/filtering and mismatched evaluation methods make it difficult to assess the state of the art. In this paper, we present…

计算与语言 · 计算机科学 2022-10-06 Jacob Tyo , Bhuwan Dhingra , Zachary C. Lipton

Fake reviews and review manipulation are growing problems on online marketplaces globally. Review Hijacking is a new review manipulation tactic in which unethical sellers "hijack" an existing product page (usually one with many positive…

计算与语言 · 计算机科学 2021-09-27 Monika Daryani , James Caverlee

Authorship analysis (AA) is the study of unveiling the hidden properties of authors from a body of exponentially exploding textual data. It extracts an author's identity and sociolinguistic characteristics based on the reflected writing…

计算与语言 · 计算机科学 2016-06-06 Steven H. H. Ding , Benjamin C. M. Fung , Farkhund Iqbal , William K. Cheung

Machine learning models are increasingly used for software security tasks. These models are commonly trained and evaluated on large Internet-derived datasets, which often contain duplicated or highly similar samples. When such samples are…

密码学与安全 · 计算机科学 2026-02-02 Farnaz Soltaniani , Mohammad Ghafari

We propose an unsupervised solution to the Authorship Verification task that utilizes pre-trained deep language models to compute a new metric called DV-Distance. The proposed metric is a measure of the difference between the two authors…

计算与语言 · 计算机科学 2021-03-15 Yifan Zhang , Dainis Boumber , Marjan Hosseinia , Fan Yang , Arjun Mukherjee

In our work, we propose to represent HTM as a set of flat models, or layers, and a set of topical hierarchies, or edges. We suggest several quality measures for edges of hierarchical models, resembling those proposed for flat models. We…

信息检索 · 计算机科学 2018-11-08 Anton Belyy

Adversarial attack perturbs an image with an imperceptible noise, leading to incorrect model prediction. Recently, a few works showed inherent bias associated with such attack (robustness bias), where certain subgroups in a dataset (e.g.…

计算机视觉与模式识别 · 计算机科学 2022-05-06 Gaurav Kumar Nayak , Ruchit Rawal , Rohit Lal , Himanshu Patil , Anirban Chakraborty

The DarkWeb represents a hotbed for illicit activity, where users communicate on different market forums in order to exchange goods and services. Law enforcement agencies benefit from forensic tools that perform authorship analysis, in…

计算与语言 · 计算机科学 2022-11-02 Andrei Manolache , Florin Brad , Antonio Barbalau , Radu Tudor Ionescu , Marius Popescu

We present a novel evaluation paradigm for AI text detectors that prioritizes real-world and equitable assessment. Current approaches predominantly report conventional metrics like AUROC, overlooking that even modest false positive rates…

计算与语言 · 计算机科学 2025-07-22 Navid Ayoobi , Sadat Shahriar , Arjun Mukherjee