English
Related papers

Related papers: Conditional bias reduction can be dangerous: a key…

200 papers

An adjustable algorithm of exclusion of conditional equations with excessive residuals is proposed. The criteria applied in the algorithm use variable exclusion limits which decrease as the number of equations goes down. The algorithm is…

Methodology · Statistics 2013-06-25 I. I. Nikiforov

The power prior and its variations have been proven to be a useful class of informative priors in Bayesian inference due to their flexibility in incorporating the historical information by raising the likelihood of the historical data to a…

Methodology · Statistics 2022-04-14 Zifei Han , Keying Ye , Min Wang

In this paper, we obtain fundamental $\mathcal{L}_{p}$ bounds in sequential prediction and recursive algorithms via an entropic analysis. Both classes of problems are examined by investigating the underlying entropic relationships of the…

Machine Learning · Computer Science 2021-05-12 Song Fang , Quanyan Zhu

Large language models often lose previously aligned safety behaviors when fine-tuned on benign data, a phenomenon known as catastrophic forgetting. Prior work shows that adding random safety examples can mitigate this effect, but it remains…

Computation and Language · Computer Science 2025-10-28 Anh Pham , Mihir Thalanki , Michael Sun , Aditya Chaloo , Ankita Gupta , Tian Xia , Aditya Mate , Ehimwenma Nosakhare , Soundararajan Srinivasan

We show that in language learning, contrary to received wisdom, keeping exceptional training instances in memory can be beneficial for generalization accuracy. We investigate this phenomenon empirically on a selection of benchmark natural…

Computation and Language · Computer Science 2007-05-23 Walter Daelemans , Antal van den Bosch , Jakub Zavrel

When evaluating causal influence from one time series to another in a multivariate dataset it is necessary to take into account the conditioning effect of the other variables. In the presence of many variables, and possibly of a reduced…

Data Analysis, Statistics and Probability · Physics 2012-03-26 Daniele Marinazzo , Mario Pellicoro , Sebastiano Stramaglia

Machine learning models are often personalized with categorical attributes that are protected, sensitive, self-reported, or costly to acquire. In this work, we show models that are personalized with group attributes can reduce performance…

Machine Learning · Statistics 2023-07-25 Vinith M. Suriyakumar , Marzyeh Ghassemi , Berk Ustun

Quantum readout error mitigation is essential for noisy intermediate-scale quantum devices to achieve reliable data. The conventional approaches, conflating initialization errors with measurement errors, not only suppress the influence of…

Learning under one-sided feedback (i.e., where we only observe the labels for examples we predicted positively on) is a fundamental problem in machine learning -- applications include lending and recommendation systems. Despite this, there…

Machine Learning · Computer Science 2020-10-14 Heinrich Jiang , Qijia Jiang , Aldo Pacchiano

In many learning tasks, certain requirements on the processing of individual data samples should arguably be formalized as strict constraints in the underlying optimization problem, rather than by means of arbitrary penalties. We show that,…

Machine Learning · Computer Science 2026-01-26 Francesca Lanzillotta , Chiara Albisani , Davide Pucci , Daniele Baracchi , Alessandro Piva , Matteo Lapucci

Although researchers have found evidence contextual bias in forensic science, the discussion of contextual bias is currently qualitative. We formalize years of empirical research and extend this research by showing quantitatively how biases…

Applications · Statistics 2021-11-09 Maria Cuellar , Jacqueline Mauro , Amanda Luby

In clinical trials, inferences on clinical outcomes are often made conditional on specific selective processes. For instance, only when a treatment demonstrates a significant effect on the primary outcome, further analysis is conducted to…

Methodology · Statistics 2025-04-15 Tianyu Pan , Vivek Charu , Ying Lu , Lu Tian

Conditional quantiles provide a natural tool for reporting results from regression analyses based on semiparametric transformation models. We consider their estimation and construction of confidence sets in the presence of censoring.

Statistics Theory · Mathematics 2007-06-13 Dorota M. Dabrowska

Causal effects are commonly defined as comparisons of the potential outcomes under treatment and control, but this definition is threatened by the possibility that the treatment or control condition is not well-defined, existing instead in…

Methodology · Statistics 2019-04-26 Raiden B. Hasegawa , Sameer K. Deshpande , Dylan S. Small , Paul R. Rosenbaum

Causal inference is best understood using potential outcomes. This use is particularly important in more complex settings, that is, observational studies or randomized experiments with complications such as noncompliance. The topic of this…

Statistics Theory · Mathematics 2007-06-13 Donald B. Rubin

In this paper, starting from a generalized coherent (i.e. avoiding uniform loss) intervalvalued probability assessment on a finite family of conditional events, we construct conditional probabilities with quasi additive classes of…

Artificial Intelligence · Computer Science 2012-10-19 Giuseppe Sanfilippo

This paper shows that sequential statistical analysis techniques can be generalised to the problem of selecting between alternative forecasting methods using scoring rules. A return to basic principles is necessary in order to show that…

Statistics Theory · Mathematics 2025-05-15 David T. Frazier , Donald S. Poskitt

Adapting the final sample size of a trial to the evidence accruing during the trial is a natural way to address planning uncertainty. Designs with adaptive sample size need to account for their optional stopping to guarantee strict type-I…

Because human preferences are too complex to codify, AIs operate with misspecified objectives. Optimizing such objectives often produces undesirable outcomes; this phenomenon is known as reward hacking. Such outcomes are not necessarily…

Artificial Intelligence · Computer Science 2026-04-27 Henrik Marklund , Alex Infanger , Benjamin Van Roy

Group sequential designs in clinical trials allow for interim efficacy and futility monitoring. Adjustment for baseline covariates can increase power and precision of estimated effects. However, inconsistently applying covariate adjustment…

Methodology · Statistics 2023-08-11 Marlena S. Bannick , Sonya L. Heltshe , Noah Simon