English
Related papers

Related papers: Addressing Topic Leakage in Cross-Topic Evaluation…

200 papers

Large Language Models (LLMs) have demonstrated remarkable proficiency in a wide range of NLP tasks. However, when it comes to authorship verification (AV) tasks, which involve determining whether two given texts share the same authorship,…

Computation and Language · Computer Science 2024-07-19 Yujia Hu , Zhiqiang Hu , Chun-Wei Seah , Roy Ka-Wei Lee

This paper investigates the relationships among key elements of the scientific research network, namely articles, researchers, and journals. We introduce a novel approach to use semantic information through the HITS algorithm-based…

Social and Information Networks · Computer Science 2024-11-22 Mehmet Emre Akbulut , Yusuf Erdem Nacar

Topic models are typically evaluated with respect to the global topic distributions that they generate, using metrics such as coherence, but without regard to local (token-level) topic assignments. Token-level assignments are important for…

Information Retrieval · Computer Science 2019-05-31 Jeffrey Lund , Piper Armstrong , Wilson Fearn , Stephen Cowley , Courtni Byun , Jordan Boyd-Graber , Kevin Seppi

Existing research on Authorship Attribution (AA) focuses on texts for which a lot of data is available (e.g novels), mainly in English. We approach AA via Authorship Verification on short Italian texts in two novel datasets, and analyze the…

Computation and Language · Computer Science 2020-11-17 Gaetana Ruggiero , Albert Gatt , Malvina Nissim

The promise of increased road safety is a key motivator for the development of automated vehicles (AV). Yet, demonstrating that an AV is as safe as, or even safer than, a human-driven vehicle has proven to be challenging. Should an AV be…

Robotics · Computer Science 2022-11-07 Max Winkelmann , Constantin Vasconi , Steffen Müller

We analyze data leakage in visual datasets. Data leakage refers to images in evaluation benchmarks that have been seen during training, compromising fair model evaluation. Given that large-scale datasets are often sourced from the internet,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Patrick Ramos , Ryan Ramos , Noa Garcia

Topic model evaluation, like evaluation of other unsupervised methods, can be contentious. However, the field has coalesced around automated estimates of topic coherence, which rely on the frequency of word co-occurrences in a reference…

Computation and Language · Computer Science 2021-10-29 Alexander Hoyle , Pranav Goel , Denis Peskov , Andrew Hian-Cheong , Jordan Boyd-Graber , Philip Resnik

Text classification methods have been widely investigated as a way to detect content of low credibility: fake news, social media bots, propaganda, etc. Quite accurate models (likely based on deep neural networks) help in moderating public…

Computation and Language · Computer Science 2026-03-04 Piotr Przybyła , Alexander Shvets , Horacio Saggion

This thesis advances the computational understanding and manipulation of text styles through three interconnected pillars: (1) Text Style Transfer (TST), which alters stylistic properties (e.g., sentiment, formality) while preserving…

Computation and Language · Computer Science 2025-07-23 Zhiqiang Hu

Online reviews provide viewpoints on the strengths and shortcomings of products/services, influencing potential customers' purchasing decisions. However, the proliferation of non-credible reviews -- either fake (promoting/ demoting an…

Artificial Intelligence · Computer Science 2017-05-09 Subhabrata Mukherjee , Sourav Dutta , Gerhard Weikum

In recent years, fully automated content analysis based on probabilistic topic models has become popular among social scientists because of their scalability. The unsupervised nature of the models makes them suitable for exploring topics in…

Computation and Language · Computer Science 2023-02-06 Shusei Eshima , Kosuke Imai , Tomoya Sasaki

Authorship verification (AV) is a fundamental task in natural language processing (NLP) and computational linguistics, with applications in forensic analysis, plagiarism detection, and identification of deceptive content. Existing AV…

Computation and Language · Computer Science 2023-10-13 Chia-Yu Hung , Zhiqiang Hu , Yujia Hu , Roy Ka-Wei Lee

Retrieving indexed documents, not by their topical content but their writing style opens the door for a number of applications in information retrieval (IR). One application is to retrieve textual content of a certain author X, where the…

Information Retrieval · Computer Science 2019-01-03 Oren Halvani , Christian Winter , Lukas Graner

Authorship analysis is an important subject in the field of natural language processing. It allows the detection of the most likely writer of articles, news, books, or messages. This technique has multiple uses in tasks related to…

Online learning systems have multiple data repositories in the form of transcripts, books and questions. To enable ease of access, such systems organize the content according to a well defined taxonomy of hierarchical nature…

Computation and Language · Computer Science 2022-08-11 Venktesh Viswanathan , Mukesh Mohania , Vikram Goyal

Over the years, topic models have provided an efficient way of extracting insights from text. However, while many models have been proposed, none are able to model topic temporality and hierarchy jointly. Modelling time provide more precise…

Information Retrieval · Computer Science 2023-01-25 Judicael Poumay , Ashwin Ittoo

Sensitive information leakage in code repositories has emerged as a critical security challenge. Traditional detection methods that rely on regular expressions, fingerprint features, and high-entropy calculations often suffer from high…

Cryptography and Security · Computer Science 2025-12-10 Bin Wang , Hui Li , Liyang Zhang , Qijia Zhuang , Ao Yang , Dong Zhang , Xijun Luo , Bing Lin

A high degree of topical diversity is often considered to be an important characteristic of interesting text documents. A recent proposal for measuring topical diversity identifies three elements for assessing diversity: words, topics, and…

Information Retrieval · Computer Science 2017-01-17 Hosein Azarbonyad , Mostafa Dehghani , Tom Kenter , Maarten Marx , Jaap Kamps , Maarten de Rijke

Incorporating the side information of text corpus, i.e., authors, time stamps, and emotional tags, into the traditional text mining models has gained significant interests in the area of information retrieval, statistical natural language…

Machine Learning · Statistics 2015-03-31 Junyu Xuan , Jie Lu , Guangquan Zhang , Richard Yi Da Xu , Xiangfeng Luo

To combat the potential misuse of Natural Language Generation (NLG) technology, a variety of algorithms have been developed for the detection of AI-generated texts. Traditionally, this task is treated as a binary classification problem.…

Computation and Language · Computer Science 2023-12-22 Yi-Fan Zhang , Zhang Zhang , Liang Wang , Tieniu Tan , Rong Jin