English
Related papers

Related papers: Statistical Foundations of DIME: Risk Estimation f…

200 papers

Image registration is an ill-posed dense vision task, where multiple solutions achieve similar loss values, motivating probabilistic inference. Variational inference has previously been employed to capture these distributions, however…

Image and Video Processing · Electrical Eng. & Systems 2026-03-19 Ivor J. A. Simpson , Neill D. F. Campbell

Fr\'echet Inception Distance (FID) is widely used to evaluate image generators, yet lower FID does not always correspond to better sample quality. We show that this mismatch depends in part on the geometry of the reference dataset. In a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yunghee Lee , Byeonghyun Pak

Density ratio estimation (DRE) is a paramount task in machine learning, for its broad applications across multiple domains, such as covariate shift adaptation, causal inference, independence tests and beyond. Parametric methods for…

Machine Learning · Statistics 2025-06-03 Meilin Wang , Wei Huang , Mingming Gong , Zheng Zhang

Recent advances in Deep Neural Networks (DNNs) have demonstrated outstanding performance across various domains. However, their large size is a challenge for deployment on resource-constrained devices such as mobile, edge, and IoT…

Machine Learning · Computer Science 2024-10-10 Divya Jyoti Bajpai , Manjesh Kumar Hanawal

In an era of data abundance, statistical evidence is increasingly critical for business and policy decisions. Yet, organizations lack empirical tools to assess the value of evidence-based decision making (EBDM), optimize statistical…

In medicine, treatments often influence multiple, interdependent outcomes, such as primary endpoints, complications, adverse events, or other secondary endpoints. Hence, to make optimal treatment decisions, clinicians are interested in…

Machine Learning · Computer Science 2025-06-03 Yuchen Ma , Jonas Schweisthal , Hengrui Zhang , Stefan Feuerriegel

The exploration of complex physical or technological processes usually requires exploiting available information from different sources: (i) physical laws often represented as a family of parameter dependent partial differential equations…

Numerical Analysis · Mathematics 2020-02-04 Albert Cohen , Wolfgang Dahmen , Ron DeVore

Given a database of bit strings $A_1,\ldots,A_m\in \{0,1\}^n$, a fundamental data structure task is to estimate the distances between a given query $B\in \{0,1\}^n$ with all the strings in the database. In addition, one might further want…

Data Structures and Algorithms · Computer Science 2024-11-11 Jerry Yao-Chieh Hu , Erzhi Liu , Han Liu , Zhao Song , Lichen Zhang

To model modern large-scale datasets, we need efficient algorithms to infer a set of $P$ unknown model parameters from $N$ noisy measurements. What are fundamental limits on the accuracy of parameter inference, given finite signal-to-noise…

Machine Learning · Statistics 2016-09-07 Madhu Advani , Surya Ganguli

Given a set of points $P\subset \mathbb{R}^{d}$ and a kernel $k$, the Kernel Density Estimate at a point $x\in\mathbb{R}^{d}$ is defined as $\mathrm{KDE}_{P}(x)=\frac{1}{|P|}\sum_{y\in P} k(x,y)$. We study the problem of designing a data…

Data Structures and Algorithms · Computer Science 2018-09-03 Moses Charikar , Paris Siminelakis

Estimating the true rank of a noisy data matrix is a fundamental problem underlying techniques such as principal component analysis, matrix completion, etc. Existing rank estimation criteria, including information-based and cross-validation…

Methodology · Statistics 2025-10-23 Subhrajyoty Roy , Abhik Ghosh , Ayanendranath Basu

Semantic text representation is a fundamental task in the field of natural language processing. Existing text embedding (e.g., SimCSE and LLM2Vec) have demonstrated excellent performance, but the values of each dimension are difficult to…

Computation and Language · Computer Science 2025-05-19 Yile Wang , Zhanyu Shen , Hui Huang

The leap in performance in state-of-the-art computer vision methods is attributed to the development of deep neural networks. However it often comes at a computational price which may hinder their deployment. To alleviate this limitation,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Edouard Yvinec , Arnaud Dapogny , Matthieu Cord , Kevin Bailly

In the era of dense retrieval, document indexing and retrieval is largely based on encoding models that transform text documents into embeddings. The efficiency of retrieval is directly proportional to the number of documents and the size…

Information Retrieval · Computer Science 2024-12-16 Federico Siciliano , Francesca Pezzuti , Nicola Tonellotto , Fabrizio Silvestri

Estimating mutual information between continuous random variables is often intractable and extremely challenging for high-dimensional data. Recent progress has leveraged neural networks to optimize variational lower bounds on mutual…

Machine Learning · Computer Science 2020-12-01 Ruizhi Liao , Daniel Moyer , Polina Golland , William M. Wells

While dense biomedical embeddings achieve strong performance, their black-box nature limits their utility in clinical decision-making. Recent question-based interpretable embeddings represent text as binary answers to natural-language…

Computation and Language · Computer Science 2026-03-04 Yixuan Tang , Zhenghong Lin , Yandong Sun , Wynne Hsu , Mong Li Lee , Anthony K. H. Tung

A fundamental goal of search engines is to identify, given a query, documents that have relevant text. This is intrinsically difficult because the query and the document may use different vocabulary, or the document may contain query words…

Information Retrieval · Computer Science 2016-02-04 Bhaskar Mitra , Eric Nalisnick , Nick Craswell , Rich Caruana

With the enourmous popularity of large language models, many researchers have raised ethical concerns regarding social biases incorporated in such models. Several methods to measure social bias have been introduced, but apparently these…

Computation and Language · Computer Science 2024-09-13 Sarah Schröder , Alexander Schulz , Barbara Hammer

Dense embedding models have become critical for modern information retrieval, particularly in RAG pipelines, but their performance often degrades when applied to specialized corpora outside their pre-training distribution. To address thi we…

Information Retrieval · Computer Science 2025-10-29 Nathan Paull

In this work we present strategies for (optimal) measurement selection in model-based sequential diagnosis. In particular, assuming a set of leading diagnoses being given, we show how queries (sets of measurements) can be computed and…

Artificial Intelligence · Computer Science 2017-05-30 Patrick Rodler , Wolfgang Schmid , Konstantin Schekotihin