English
Related papers

Related papers: On data analysis and variable selection: the minim…

200 papers

Online controlled experiments (A/B testing) are fundamental to data-driven decision-making in many companies. Improving the sensitivity of these experiments under fixed sample size constraints requires reducing the variance of the average…

Methodology · Statistics 2026-03-24 Zhexiao Lin , Pablo Crespo

We introduce a new incremental preference elicitation procedure able to deal with noisy responses of a Decision Maker (DM). The originality of the contribution is to propose a Bayesian approach for determining a preferred solution in a…

Artificial Intelligence · Computer Science 2020-07-30 Nadjet Bourdache , Patrice Perny , Olivier Spanjaard

Modern materials science has historically been founded on combining restricted subsets of the periodic table, favoring high-purity, few-element systems. However, the demands of an emerging circular economy, together with the need to…

Materials Science · Physics 2026-03-02 Anton Bochkarev , Yury Lysogorskiy , Aparna Subramanyam , Ralf Drautz , Danny Perez

We describe a method to computationally estimate the probability density function of a univariate random variable by applying the maximum entropy principle with some local conditions given by Gaussian functions. The estimation errors and…

Statistics Theory · Mathematics 2012-06-21 Mihail-Ioan Pop

The concept of entropy connects the number of possible configurations with the number of variables in large stochastic systems. Independent or weakly interacting variables render the number of configurations scale exponentially with the…

Statistical Mechanics · Physics 2020-06-25 Sámuel G. Balogh , Gergely Palla , Péter Pollner , Dániel Czégel

We consider dynamical systems evolving near an equilibrium statistical state where the interest is in modelling long term behavior that is consistent with thermodynamic constraints. We adjust the distribution using an entropy-optimizing…

Fluid Dynamics · Physics 2014-11-25 Keith Myerscough , Jason Frank , Benedict Leimkuhler

A main goal of data-driven materials research is to find optimal low-dimensional descriptors, allowing us to predict a physical property, and to interpret them in a human-understandable way. In this work, we advance methods to identify…

Materials Science · Physics 2022-12-14 Benedikt Hoock , Santiago Rigamonti , Claudia Draxl

We propose two approaches for selecting variables in latent class analysis (i.e.,mixture model assuming within component independence), which is the common model-based clustering method for mixed data. The first approach consists in…

Computation · Statistics 2017-03-08 Matthieu Marbac , Mohammed Sedki

A principled approach to cyclicality and intransitivity in paired comparison data is developed. The proposed methodology enables more precise estimation of the underlying preference profile and facilitates the identification of all cyclic…

Methodology · Statistics 2025-10-08 Rahul Singh , Ori Davidov

The major problem in information theoretic analysis of neural responses and other biological data is the reliable estimation of entropy--like quantities from small samples. We apply a recently introduced Bayesian entropy estimator to…

Data Analysis, Statistics and Probability · Physics 2009-09-29 Ilya Nemenman , William Bialek , Rob de Ruyter van Steveninck

Motivated by the poor performance of cross-validation in settings where data are scarce, we propose a novel estimator of the out-of-sample performance of a policy in data-driven optimization.Our approach exploits the optimization problem's…

Optimization and Control · Mathematics 2022-08-04 Vishal Gupta , Michael Huang , Paat Rusmevichientong

Not all real-world data are labeled, and when labels are not available, it is often costly to obtain them. Moreover, as many algorithms suffer from the curse of dimensionality, reducing the features in the data to a smaller set is often of…

Machine Learning · Computer Science 2022-05-19 Chiara Balestra , Florian Huber , Andreas Mayr , Emmanuel Müller

We investigate the memory properties of discrete sequences built upon a finite number of states. We find that the block entropy can reliably determine the memory for systems modeled as Markov chains of arbitrary finite order. Further, we…

Statistical Mechanics · Physics 2022-11-21 Juan De Gregorio , David Sanchez , Raul Toral

For the estimation of cumulative link models for ordinal data, the bias-reducing adjusted score equations in \citet{firth:93} are obtained, whose solution ensures an estimator with smaller asymptotic bias than the maximum likelihood…

Methodology · Statistics 2018-02-16 Ioannis Kosmidis

Estimating prevalence, the fraction of a population with a certain medical condition, is fundamental to epidemiology. Traditional methods rely on classification of test samples taken at random from a population. Such approaches to…

Methodology · Statistics 2022-03-25 Paul Patrone , Anthony Kearsley

Incorporating graph side information into recommender systems has been widely used to better predict ratings, but relatively few works have focused on theoretical guarantees. Ahn et al. (2018) firstly characterized the optimal sample…

Information Theory · Computer Science 2021-09-09 Changhun Jo , Kangwook Lee

The paper is concerned with various ways of analysing the subjective assessment of displaying digital signage content. In the beginning the brief description of the signage system evolution is described and next, the carried out ex-periment…

Human-Computer Interaction · Computer Science 2012-11-29 Jerzy Grobelny , Rafal Michalski

Turbulent dynamical systems characterized by both a high-dimensional phase space and a large number of instabilities are ubiquitous among many complex systems in science and engineering. The existence of a strange attractor in the turbulent…

Fluid Dynamics · Physics 2018-02-23 Andrew J. Majda , Di Qi

Contamination can severely distort an estimator unless the estimation procedure is suitably robust. This is a well-known issue and has been addressed in Robust Statistics, however, the relation of contamination and distorted variable…

Statistics Theory · Mathematics 2022-07-15 Tino Werner

The use of machine learning algorithms to predict behaviors of complex systems is booming. However, the key to an effective use of machine learning tools in multi-physics problems, including combustion, is to couple them to physical and…