English
Related papers

Related papers: On data analysis and variable selection: the minim…

200 papers

Statistical mechanics relies on the complete though probabilistic description of a system in terms of all the microscopic variables. Its object is to derive therefrom static and dynamic properties involving some reduced set of variables.…

Statistical Mechanics · Physics 2009-10-31 R. Balian

This paper addresses the challenge of identifying a minimal subset of discrete, independent variables that best predicts a binary class. We propose an efficient iterative method that sequentially selects variables based on which one…

Computation · Statistics 2025-11-03 María del Carmen Romero , Mariana del Fresno , Alejandro Clausse

Finding parameters that minimise a loss function is at the core of many machine learning methods. The Stochastic Gradient Descent algorithm is widely used and delivers state of the art results for many problems. Nonetheless, Stochastic…

Machine Learning · Computer Science 2018-09-26 Yao Zhang , Andrew M. Saxe , Madhu S. Advani , Alpha A. Lee

In this letter we propose the use of physics techniques for entropy determination on constrained parameter optimization problems. The main feature of such techniques, the construction of an unbiased walk on energy space, suggests their use…

Statistical Mechanics · Physics 2009-11-07 A. R. Lima , M. Argollo de Menezes

Variable selection for optimal treatment regime in a clinical trial or an observational study is getting more attention. Most existing variable selection techniques focused on selecting variables that are important for prediction, therefore…

Methodology · Statistics 2014-05-22 Ailin Fan , Wenbin Lu , Rui Song

In this paper a data mining approach for variable selection and knowledge extraction from datasets is presented. The approach is based on unguided symbolic regression (every variable present in the dataset is treated as the target variable…

Neural and Evolutionary Computing · Computer Science 2013-09-24 Michael Kommenda , Gabriel Kronberger , Christoph Feilmayr , Michael Affenzeller

The construction of an efficient portfolio with a good level of return and minimal risk depends on selecting the optimal combination of stocks. This paper introduces a novel decision-making framework for stock selection based on fractional…

Statistics Theory · Mathematics 2025-07-04 Poulami Paul , Chanchal Kundu

The maximum entropy principle can be used to assign utility values when only partial information is available about the decision maker's preferences. In order to obtain such utility values it is necessary to establish an analogy between…

Statistical Finance · Quantitative Finance 2009-11-13 Andreia Dionisio , A. Heitor Reis

We propose a general framework for solving quantum state estimation problems using the minimum relative entropy criterion. A convex optimization approach allows us to decide the feasibility of the problem given the data and, whenever…

Quantum Physics · Physics 2013-01-29 Mattia Zorzi , Francesco Ticozzi , Augusto Ferrante

We introduce a temporal scheme for data sampling, based on a variable delay between two successive data acquisitions. The scheme is designed so as to reduce the average data flow rate, while still retaining the information on the data…

Soft Condensed Matter · Physics 2016-08-06 A. Philippe , S. Aime , V. Roger , R. Jelinek , G. Prévot , L. Berthier , L. Cipelletti

Variable selection is an important problem in statistics and machine learning. Copula Entropy (CE) is a mathematical concept for measuring statistical independence and has been applied to variable selection recently. In this paper we…

Methodology · Statistics 2022-09-07 Jian Ma

We study the approximability of instances of the minimum entropy set cover problem, parameterized by the average frequency of a random element in the covering sets. We analyze an algorithm combining a greedy approach with another one biased…

Data Structures and Algorithms · Computer Science 2012-08-01 Cosmin Bonchis , Gabriel Istrate

In many real world problems, optimization decisions have to be made with limited information. The decision maker may have no a priori or posteriori data about the often nonconvex objective function except from on a limited number of points…

Optimization and Control · Mathematics 2011-11-10 Tansu Alpcan

Entropy is a measure of heterogeneity widely used in applied sciences, often when data are collected over space. Recently, a number of approaches has been proposed to include spatial information in entropy. The aim of entropy is to…

Statistics Theory · Mathematics 2019-11-12 Linda Altieri , Daniela Cocchi , Giulia Roli

Maximum entropy models are increasingly being used to describe the collective activity of neural populations with measured mean neural activities and pairwise correlations, but the full space of probability distributions consistent with…

Biological Physics · Physics 2017-08-22 Badr F. Albanna , Christopher Hillar , Jascha Sohl-Dickstein , Michael R. DeWeese

This paper deals with the estimation of the modes of an univariate mixture when the number of components is known and when the component density are well separated. We propose an algorithm based on the minimization of the "kp" criterion we…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Nicolas Paul , Luc Fety , Michel Terre

Recommendations based on behavioral data may be faced with ambiguous statistical evidence. We consider the case of association rules, relevant e.g.~for query and product recommendations. For example: Suppose that a customer belongs to…

Databases · Computer Science 2015-01-12 Rasmus Pagh , Morten Stöckel

The scientific method relies on the iterated processes of inference and inquiry. The inference phase consists of selecting the most probable models based on the available data; whereas the inquiry phase consists of using what is known about…

Machine Learning · Statistics 2015-05-19 N. K. Malakar , K. H. Knuth

We consider an approximation scheme for multivariate information assuming that synergistic information only appearing in higher order joint distributions is suppressed, which may hold in large classes of systems. Our approximation scheme…

Methodology · Statistics 2020-09-03 Masahiro Takimoto

The thermodynamic entropy of coarse-grained (CG) models stands as one of the most important properties for quantifying the missing information during the CG process and for establishing transferable (or extendible) CG interactions. However,…

Chemical Physics · Physics 2024-04-10 Jaehyeok Jin , David R. Reichman