English
Related papers

Related papers: Are Generative Models Underconfident? Better Quali…

200 papers

We propose a likelihood-free method for comparing two distributions given samples from each, with the goal of assessing the quality of generative models. The proposed approach, PQMass, provides a statistically rigorous method for assessing…

In real-world question-answering (QA) systems, ill-formed questions, such as wrong words, ill word order, and noisy expressions, are common and may prevent the QA systems from understanding and answering them accurately. In order to…

Information Retrieval · Computer Science 2019-10-10 Ye Liu , Chenwei Zhang , Xiaohui Yan , Yi Chang , Philip S. Yu

Recent work has shown that the hidden states of large language models contain signals useful for uncertainty estimation and hallucination detection, motivating a growing interest in efficient probe-based approaches. Yet it remains unclear…

Computation and Language · Computer Science 2026-04-14 Joe Stacey , Hadas Orgad , Kentaro Inui , Benjamin Heinzerling , Nafise Sadat Moosavi

We define a novel concept called extended word alignment in order to improve post-editing assistance efficiency. Based on extended word alignment, we further propose a novel task called refined word-level QE that outputs refined tags and…

Computation and Language · Computer Science 2022-09-26 Yizhen Wei , Takehito Utsuro , Masaaki Nagata

Model explanations can be valuable for interpreting and debugging predictive models. We study a specific kind called Concept Explanations, where the goal is to interpret a model using human-understandable concepts. Although popular for…

Machine Learning · Computer Science 2024-04-08 Vihari Piratla , Juyeon Heo , Katherine M. Collins , Sukriti Singh , Adrian Weller

Despite empirical risk minimization (ERM) is widely applied in the machine learning community, its performance is limited on data with spurious correlation or subpopulation that is introduced by hidden attributes. Existing literature…

Machine Learning · Computer Science 2024-12-18 Hongyu Shen , Zhizhen Zhao

Despite the tremendous success of diffusion generative models in text-to-image generation, replicating this success in the domain of image compression has proven difficult. In this paper, we demonstrate that diffusion can significantly…

Image and Video Processing · Electrical Eng. & Systems 2024-03-11 Emiel Hoogeboom , Eirikur Agustsson , Fabian Mentzer , Luca Versari , George Toderici , Lucas Theis

QA models based on pretrained language mod-els have achieved remarkable performance on various benchmark datasets.However, QA models do not generalize well to unseen data that falls outside the training distribution, due to distributional…

Computation and Language · Computer Science 2021-06-25 Seanie Lee , Minki Kang , Juho Lee , Sung Ju Hwang

Many classification models produce a probability distribution as the outcome of a prediction. This information is generally compressed down to the single class with the highest associated probability. In this paper, we argue that part of…

Machine Learning · Statistics 2021-03-30 Gabriele N. Tornetta

Quality estimation aims to measure the quality of translated content without access to a reference translation. This is crucial for machine translation systems in real-world scenarios where high-quality translation is needed. While many…

Computation and Language · Computer Science 2021-02-09 Yi-Lin Tuan , Ahmed El-Kishky , Adithya Renduchintala , Vishrav Chaudhary , Francisco Guzmán , Lucia Specia

Generative molecular design has moved from proof-of-concept to real-world applicability, as marked by the surge in very recent papers reporting experimental validation. Key challenges in explainability and sample efficiency present…

Biomolecules · Quantitative Biology 2024-03-05 Jeff Guo , Philippe Schwaller

Advances in generative models have led to significant interest in image synthesis, demonstrating the ability to generate high-quality images for a diverse range of text prompts. Despite this progress, most studies ignore the presence of…

Artificial Intelligence · Computer Science 2024-07-02 Nila Masrourisaadat , Nazanin Sedaghatkish , Fatemeh Sarshartehrani , Edward A. Fox

A highly accurate but overconfident model is ill-suited for deployment in critical applications such as healthcare and autonomous driving. The classification outcome should reflect a high uncertainty on ambiguous in-distribution samples…

Machine Learning · Computer Science 2022-10-25 Sumedha Singla , Nihal Murali , Forough Arabshahi , Sofia Triantafyllou , Kayhan Batmanghelich

This paper investigates two complementary paradigms for predicting machine translation (MT) quality: source-side difficulty prediction and candidate-side quality estimation (QE). The rapid adoption of Large Language Models (LLMs) into MT…

Computation and Language · Computer Science 2026-03-05 Malik Marmonier , Benoît Sagot , Rachel Bawden

Quantum machine learning is among the most exciting potential applications of quantum computing. However, the vulnerability of quantum information to environmental noises and the consequent high cost for realizing fault tolerance has…

Methods such as chain-of-thought prompting and self-consistency have pushed the frontier of language model reasoning performance with no additional training. To further improve performance, we propose a prompt ensembling method for large…

Computation and Language · Computer Science 2023-04-13 Silviu Pitis , Michael R. Zhang , Andrew Wang , Jimmy Ba

Conditional discrete generative models struggle to faithfully compose multiple input conditions. To address this, we derive a theoretically-grounded formulation for composing discrete probabilistic generative processes, with masked…

Machine Learning · Computer Science 2026-04-08 Jamie Stirling , Noura Al-Moubayed , Chris G. Willcocks , Hubert P. H. Shum

Conditional discrete generative models struggle to faithfully compose multiple input conditions. To address this, we derive a theoretically-grounded formulation for composing discrete probabilistic generative processes, with masked…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Jamie Stirling , Noura Al-Moubayed , Chris G. Willcocks , Hubert P. H. Shum

Our paper deals with inferring simulator-based statistical models given some observed data. A simulator-based model is a parametrized mechanism which specifies how data are generated. It is thus also referred to as generative model. We…

Machine Learning · Statistics 2016-01-01 Michael U. Gutmann , Jukka Corander

In this paper, we introduce a quantum-enhanced algorithm for simulation-based optimization. Simulation-based optimization seeks to optimize an objective function that is computationally expensive to evaluate exactly, and thus, is…

Quantum Physics · Physics 2021-03-08 Julien Gacon , Christa Zoufal , Stefan Woerner