English
Related papers

Related papers: Maximum entropy and quantized metric models for ab…

200 papers

We consider the problem of mean estimation assuming only finite variance. We study a new class of mean estimators constructed by integrating over random noise applied to a soft-truncated empirical mean estimator. For appropriate choices of…

Statistics Theory · Mathematics 2019-06-26 Matthew J. Holland

Statistical evaluation aims to estimate the generalization performance of a model using held-out i.i.d.\ test data sampled from the ground-truth distribution. In supervised learning settings such as classification, performance metrics such…

Machine Learning · Computer Science 2026-04-08 Shashaank Aiyer , Yishay Mansour , Shay Moran , Han Shao

In a world where more decisions are made using artificial intelligence, it is of utmost importance to ensure these decisions are well-grounded. Neural networks are the modern building blocks for artificial intelligence. Modern neural…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Mohamad Al Shaar , Nils Ekström , Gustav Gille , Reza Rezvan , Ivan Wely

With the rapid advancement of Multi-modal Large Language Models (MLLMs), MLLM-based Image Quality Assessment (IQA) methods have shown promising performance in linguistic quality description. However, current methods still fall short in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhiyuan You , Xin Cai , Jinjin Gu , Tianfan Xue , Chao Dong

A new class of general exponential ranking models is introduced which we label angle-based models for ranking data. A consensus score vector is assumed, which assigns scores to a set of items, where the scores reflect a consensus view of…

Methodology · Statistics 2017-12-27 Hang Xu , Mayer Alvo , Philip L. H. Yu

We address the problem of image color quantization using a Maximum Entropy based approach. Focusing on pixel mapping we argue that adding thermal noise to the system yields better visual impressions than that obtained from a simple energy…

Statistical Mechanics · Physics 2023-03-15 Samy Lakhal , Alexandre Darmon , Michael Benzaquen

Entropy measures quantify the amount of information and correlation present in a quantum system. In practice, when the quantum state is unknown and only copies thereof are available, one must resort to the estimation of such entropy…

Quantum Physics · Physics 2024-03-27 Ziv Goldfeld , Dhrumil Patel , Sreejith Sreekumar , Mark M. Wilde

This paper introduces a unified framework for the detection of a source with a sensor array in the context where the noise variance and the channel between the source and the sensors are unknown at the receiver. The Generalized Maximum…

Probability · Mathematics 2010-06-16 Pascal Bianchi , Merouane Debbah , Mylène Maïda , Jamal Najim

In meta-analysis with continuous outcomes, the use of effect sizes based on the means is the most common. It is often found, however, that only the quantile summary measures are reported in some studies, and in certain scenarios, a…

Methodology · Statistics 2024-11-19 Alysha M De Livera , Luke Prendergast , Udara Kumaranathunga

There are strong incentives to build models that demonstrate outstanding predictive performance on various datasets and benchmarks. We believe these incentives risk a narrow focus on models and on the performance metrics used to evaluate…

Machine Learning · Computer Science 2022-06-07 David Lovell , Dimity Miller , Jaiden Capra , Andrew Bradley

Assessing model generalization under distribution shift is essential for real-world deployment, particularly when labeled test data is unavailable. This paper presents a unified and practical framework for unsupervised model evaluation and…

Machine Learning · Computer Science 2025-10-06 Weijian Deng , Weijie Tu , Ibrahim Radwan , Mohammad Abu Alsheikh , Stephen Gould , Liang Zheng

This paper introduces a comprehensive framework for complex-valued probability measures and explores their novel applications in information theory and statistical analysis. We define a complex probability measure as a phase-modulated…

Information Theory · Computer Science 2026-03-16 Siang Cheng , Hejun Xu , Tianxiao Pang

We demonstrate the implementation of a novel machine learning framework for probability density estimation and classification using quantum circuits. The framework maps a training data set or a single data sample to the quantum state of a…

Quantum Physics · Physics 2022-06-28 Vladimir Vargas-Calderón , Fabio A. González , Herbert Vinck-Posada

The maximum entropy principle is a powerful tool for solving underdetermined inverse problems. This paper considers the problem of discretizing a continuous distribution, which arises in various applied fields. We obtain the approximating…

Numerical Analysis · Mathematics 2020-08-05 Ken'ichiro Tanaka , Alexis Akira Toda

We address the problem of uncertainty quantification and propose measures of total, aleatoric, and epistemic uncertainty based on a known decomposition of (strictly) proper scoring rules, a specific type of loss function, into a divergence…

Machine Learning · Computer Science 2025-05-29 Paul Hofman , Yusuf Sale , Eyke Hüllermeier

In this paper we present an exploratory research on quantifying the impact that data distribution has on the performance and evaluation of NLP models. We propose an automated framework that measures the data point distribution across 6…

Computation and Language · Computer Science 2024-04-02 Venelin Kovatchev , Matthew Lease

Classification is a machine learning method used in many practical applications: text mining, handwritten character recognition, face recognition, pattern classification, scene labeling, computer vision, natural langage processing. A…

Machine Learning · Computer Science 2025-11-05 Doulaye Dembélé

Artificial intelligence (AI) has significantly improved medical screening accuracy, particularly in cancer detection and risk assessment. However, traditional classification metrics often fail to account for imbalanced data, varying…

Machine Learning · Computer Science 2025-10-28 Longfei Wei , Fang Sheng , Jianfei Zhang

We propose a new approach for estimating the parameters of a probability distribution. It consists on combining two new methods of estimation. The first is based on the definition of a new distance measuring the difference between…

Methodology · Statistics 2008-12-30 Ahmed Guellil , Tewfik Kernane

Deep learning has been shown to be highly effective for automatic modulation classification (AMC), which is a pivotal technology for next-generation cognitive communications. Yet, existing deep learning methods for AMC often lack robust…

Signal Processing · Electrical Eng. & Systems 2025-12-03 Huian Yang , Rajeev Sahay