English
Related papers

Related papers: Reliably Bounding False Positives: A Zero-Shot Mac…

200 papers

Large Language Models (LLMs) have demonstrated a powerful ability for text generation. However, achieving optimal results with a given prompt or instruction can be challenging, especially for billion-sized models. Additionally, undesired…

Computation and Language · Computer Science 2024-10-07 Lifu Tu , Semih Yavuz , Jin Qu , Jiacheng Xu , Rui Meng , Caiming Xiong , Yingbo Zhou

Quantifying uncertainty in automatically generated text is important for letting humans check potential hallucinations and making systems more reliable. Conformal prediction is an attractive framework to provide predictions imbued with…

Computation and Language · Computer Science 2024-02-02 Dennis Ulmer , Chrysoula Zerva , André F. T. Martins

High-quality text generation capability of recent Large Language Models (LLMs) causes concerns about their misuse (e.g., in massive generation/spread of disinformation). Machine-generated text (MGT) detection is important to cope with such…

Conformal Prediction (CP) is a distribution-free uncertainty estimation framework that constructs prediction sets guaranteed to contain the true answer with a user-specified probability. Intuitively, the size of the prediction set encodes a…

Machine Learning · Computer Science 2025-02-18 Alvaro H. C. Correia , Fabio Valerio Massoli , Christos Louizos , Arash Behboodi

The effective detection and governance of Large Language Model (LLM) generated content has become increasingly critical due to the growing risk of misuse. Despite the impressive performance of existing detectors, their reliability and…

Computation and Language · Computer Science 2026-05-20 Junchao Wu , Yefeng Liu , Chenyu Zhu , Hao Zhang , Zeyu Wu , Tianqi Shi , Yichao Du , Longyue Wang , Weihua Luo , Jinsong Su , Derek F. Wong

The proliferation of fake news, i.e., news intentionally spread for misinformation, poses a threat to individuals and society. Despite various fact-checking websites such as PolitiFact, robust detection techniques are required to deal with…

Computation and Language · Computer Science 2021-05-20 Bimal Bhattarai , Ole-Christoffer Granmo , Lei Jiao

We present recent advances in formal verification and control for autonomous systems with practical safety guarantees enabled by conformal prediction (CP), a statistical tool for uncertainty quantification. This survey is particularly…

Systems and Control · Electrical Eng. & Systems 2025-08-19 Lars Lindemann , Yiqi Zhao , Xinyi Yu , George J. Pappas , Jyotirmoy V. Deshmukh

Increased dependence on networked, software based control has escalated the vulnerabilities of Cyber Physical Systems (CPSs). Detection and monitoring components developed leveraging dynamical systems theory are often employed as…

Cryptography and Security · Computer Science 2026-02-17 Ipsita Koley , Sunandan Adhikary , Soumyajit Dey

Recent ubiquity and disruptive impacts of large language models (LLMs) have raised concerns about their potential to be misused (.i.e, generating large-scale harmful and misleading content). To combat this emerging risk of LLMs, we propose…

Computation and Language · Computer Science 2023-10-25 Jason Lucas , Adaku Uchendu , Michiharu Yamashita , Jooyoung Lee , Shaurya Rohatgi , Dongwon Lee

Aiming at the problems of computational inefficiency and insufficient interpretability faced by large models in complex tasks such as multi-round reasoning and multi-modal collaboration, this study proposes a three-layer collaboration…

Computation and Language · Computer Science 2025-09-23 Luyan Zhang

Scene text detection remains a grand challenge due to the variation in text curvatures, orientations, and aspect ratios. One of the hardest problems in this task is how to represent text instances of arbitrary shapes. Although many methods…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Tao Sheng , Jie Chen , Zhouhui Lian

We propose a multi-scale extension of conformal prediction, an approach that constructs prediction sets with finite-sample coverage guarantees under minimal statistical assumptions. Classic conformal prediction relies on a single notion of…

Statistics Theory · Mathematics 2025-02-11 Ali Baheri , Marzieh Amiri Shahbazi

In a controllable text generation dataset, there exist unannotated attributes that could provide irrelevant learning signals to models that use it for training and thus degrade their performance. We propose focused prefix tuning(FPT) to…

Computation and Language · Computer Science 2023-06-13 Congda Ma , Tianyu Zhao , Makoto Shing , Kei Sawada , Manabu Okumura

The possibility of errors in human-engineered formal verification software, such as model checkers, poses a serious threat to the purpose of these tools. An established approach to mitigate this problem are certificates -- lightweight,…

Logic in Computer Science · Computer Science 2025-01-22 Krishnendu Chatterjee , Tim Quatmann , Maximilian Schäffeler , Maximilian Weininger , Tobias Winkler , Daniel Zilken

Large-scale multiple testing is a fundamental problem in high dimensional statistical inference. It is increasingly common that various types of auxiliary information, reflecting the structural relationship among the hypotheses, are…

Methodology · Statistics 2021-10-07 Hongyuan Cao , Jun Chen , Xianyang Zhang

High-quality paraphrases are easy to produce using instruction-tuned language models or specialized paraphrasing models. Although this capability has a variety of benign applications, paraphrasing attacks$\unicode{x2013}$paraphrases applied…

Computation and Language · Computer Science 2025-03-21 Rafael Rivera Soto , Barry Chen , Nicholas Andrews

In this paper, we analyze failure cases of state-of-the-art detectors and observe that most hard false positives result from classification instead of localization and they have a large negative impact on the performance of object…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Bowen Cheng , Yunchao Wei , Rogerio Feris , Jinjun Xiong , Wen-mei Hwu , Thomas Huang , Humphrey Shi

False positives in pedestrian detection remain a challenge that has yet to be effectively resolved. To address this issue, this paper proposes a Full-stage Refined Proposal (FRP) algorithm aimed at eliminating these false positives within a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Qiang Guo , Rubo Zhang , Bingbing Zhang , Junjie Liu , Jianqing Liu

The conformalClassification package implements Transductive Conformal Prediction (TCP) and Inductive Conformal Prediction (ICP) for classification problems. Conformal Prediction (CP) is a framework that complements the predictions of…

Machine Learning · Statistics 2018-04-17 Niharika Gauraha , Ola Spjuth

Large language models (LLMs) have demonstrated remarkable capability to generate fluent responses to a wide variety of user queries. However, this has also raised concerns about the potential misuse of such texts in journalism, education,…