English
Related papers

Related papers: Consistency of weighted majority votes

200 papers

In this study, we introduce a new approach to statistical decision theory. Without using a loss function, we select good decision rules to choice between two hypotheses. We call them "experts". They are globally unbiased but also…

Statistics Theory · Mathematics 2007-06-13 Guy Morel

A central issue of many statistical learning problems is to select an appropriate model from a set of candidate models. Large models tend to inflate the variance (or overfitting), while small models tend to cause biases (or underfitting)…

Statistics Theory · Mathematics 2020-12-25 Jie Ding , Enmao Diao , Jiawei Zhou , Vahid Tarokh

We study the matrix completion problem when the observation pattern is deterministic and possibly non-uniform. We propose a simple and efficient debiased projection scheme for recovery from noisy observations and analyze the error under a…

Information Theory · Computer Science 2019-10-31 Simon Foucart , Deanna Needell , Reese Pathak , Yaniv Plan , Mary Wootters

Collective decision-making requires aggregating multiple noisy information channels about an unknown state of the world. Classical epistemic justifications of majority rule rely on homogeneity assumptions often violated when individual…

General Economics · Economics 2026-04-09 Enrico Manfredi

The Condorcet Jury Theorem or the Miracle of Aggregation are frequently invoked to ensure the competence of some aggregate decision-making processes. In this article we explore an estimation of the prior probability of the thesis predicted…

Theoretical Economics · Economics 2022-06-22 Álvaro Romaniega

We present a novel analysis of the expected risk of weighted majority vote in multiclass classification. The analysis takes correlation of predictions by ensemble members into account and provides a bound that is amenable to efficient…

Machine Learning · Computer Science 2020-12-18 Andrés R. Masegosa , Stephan S. Lorenzen , Christian Igel , Yevgeny Seldin

We investigate a stochastic counterpart of majority votes over finite ensembles of classifiers, and study its generalization properties. While our approach holds for arbitrary distributions, we instantiate it with Dirichlet distributions:…

Machine Learning · Computer Science 2021-10-20 Valentina Zantedeschi , Paul Viallard , Emilie Morvant , Rémi Emonet , Amaury Habrard , Pascal Germain , Benjamin Guedj

Complex decision-making systems rarely have direct access to the current state of the world and they instead rely on opinions to form an understanding of what the ground truth could be. Even in problems where experts provide opinions…

Artificial Intelligence · Computer Science 2023-08-22 Noyan C. Sevuktekin , Andrew C. Singer

In the impartial selection problem, a subset of agents up to a fixed size $k$ among a group of $n$ is to be chosen based on votes cast by the agents themselves. A selection mechanism is impartial if no agent can influence its own chance of…

Computer Science and Game Theory · Computer Science 2024-08-06 Javier Cembrano , Svenja M. Griesbach , Maximilian J. Stahlberg

We study a variant of decision-theoretic online learning in which the set of experts that are available to Learner can shrink over time. This is a restricted version of the well-studied sleeping experts problem, itself a generalization of…

Machine Learning · Computer Science 2019-10-31 Hamid Shayestehmanesh , Sajjad Azami , Nishant A. Mehta

The problem of simple $M-$ary hypothesis testing under a generic performance criterion that depends on arbitrary functions of error probabilities is considered. Using results from convex analysis, it is proved that an optimal decision rule…

Signal Processing · Electrical Eng. & Systems 2019-07-26 Berkan Dulek , Cuneyd Ozturk , Sinan Gezici

We consider the problem of estimating a smooth functional of an unknown signal with discontinuity from Gaussian observations. The signal is a known function that depends on an unknown parameter. This problem is closely related to the famous…

Statistics Theory · Mathematics 2011-12-19 Farida Enikeeva

Voting systems typically treat all voters equally. We argue that perhaps they should not: Voters who have supported good choices in the past should be given higher weight than voters who have supported bad ones. To develop a formal…

Computer Science and Game Theory · Computer Science 2017-03-16 Nika Haghtalab , Ritesh Noothigattu , Ariel D. Procaccia

Aiming at the group decision - making problem with multi - objective attributes, this study proposes a group decision - making system that integrates fuzzy inference and Bayesian network. A fuzzy rule base is constructed by combining…

Artificial Intelligence · Computer Science 2025-05-01 Shui-jin Rong , Wei Guo , Da-qing Zhang

We study the problem of estimating the covariance parameters of a one-dimensional Gaussian process with exponential covariance function under fixed-domain asymptotics. We show that the weighted pairwise maximum likelihood estimator of the…

Statistics Theory · Mathematics 2019-07-15 François Bachoc , Moreno Bevilacqua , Daira Velandia

We examine the problem of construction of confidence intervals within the basic single-parameter, single-iteration variation of the method of quasi-optimal weights. Two kinds of distortions of such intervals due to insufficiently large…

Data Analysis, Statistics and Probability · Physics 2020-05-27 A. D. Morozov , A. V. Lokhov , F. V. Tkachov

We study a stochastically perturbed version of the well-known Krasnoselski--Mann iteration for computing fixed points of nonexpansive maps in finite dimensional normed spaces. We discuss sufficient conditions on the stochastic noise and…

Optimization and Control · Mathematics 2023-04-04 Mario Bravo , Roberto Cominetti

In this paper we examine the properties of the Wilson score interval, used for inferences for an unknown binomial proportion parameter. We examine monotonicity and consistency properties of the interval and we generalise it to give two…

Statistics Theory · Mathematics 2021-09-28 Ben O'Neill

A weighted recursive tree is an evolving tree in which vertices are assigned random vertex-weights and new vertices connect to a predecessor with a probability proportional to its weight. Here, we study the maximum degree and near-maximum…

Probability · Mathematics 2023-01-31 Laura Eslava , Bas Lodewijks , Marcel Ortgiese

In perpetual voting, multiple decisions are made at different moments in time. Taking the history of previous decisions into account allows us to satisfy properties such as proportionality over periods of time. In this paper, we consider…

Computer Science and Game Theory · Computer Science 2025-01-07 Alexander Kozachinskiy , Alexander Shen , Tomasz Steifer