English
Related papers

Related papers: Conservative Likelihood Ratio Estimator for Infreq…

200 papers

In natural language processing (NLP), the likelihood ratios (LRs) of N-grams are often estimated from the frequency information. However, a corpus contains only a fraction of the possible N-grams, and most of them occur infrequently. Hence,…

Computation and Language · Computer Science 2022-04-15 Masato Kikuchi , Mitsuo Yoshida , Kyoji Umemura , Tadachika Ozono

There are several estimators of conditional probability from observed frequencies of features. In this paper, we propose using the lower limit of confidence interval on posterior distribution determined by the observed frequencies to…

Information Theory · Computer Science 2017-09-26 Masato Kikuchi , Eiko Yamamoto , Mitsuo Yoshida , Masayuki Okabe , Kyoji Umemura

Likelihood ratios (LRs), which are commonly used for probabilistic data processing, are often estimated based on the frequency counts of individual elements obtained from samples. In natural language processing, an element can be a…

Computation and Language · Computer Science 2021-10-05 Masato Kikuchi , Kento Kawakami , Kazuho Watanabe , Mitsuo Yoshida , Kyoji Umemura

The likelihood ratio (LR) measures the relative weight of forensic data regarding two hypotheses. Several levels of uncertainty arise if frequentist methods are chosen for its assessment: the assumed population model only approximates the…

Applications · Statistics 2016-12-26 Giulia Cereda

Sequential estimators are proposed for the relative risk, odds ratio, log relative risk or log odds ratio of a dichotomous attribute in two populations. The estimators take the same number of observations from each population, and guarantee…

Methodology · Statistics 2026-04-07 Luis Mendo

Probability estimation is an elementary building block of every statistical data compression algorithm. In practice probability estimation is often based on relative letter frequencies which get scaled down, when their sum is too large.…

Information Theory · Computer Science 2015-01-12 Christopher Mattern

The universal-set naive Bayes classifier (UNB)~\cite{Komiya:13}, defined using likelihood ratios (LRs), was proposed to address imbalanced classification problems. However, the LR estimator used in the UNB overestimates LRs for…

Machine Learning · Computer Science 2022-10-31 Masato Kikuchi , Tadachika Ozono

This article deals with adaptive nonparametric estimation for L\'evy processes observed at low frequency. For general linear functionals of the L\'evy measure, we construct kernel estimators, provide upper risk bounds and derive rates of…

Statistics Theory · Mathematics 2014-07-15 Johanna Kappus

We consider the estimation of rare-event probabilities using sample proportions output by naive Monte Carlo or collected data. Unlike using variance reduction techniques, this naive estimator does not have a priori relative efficiency…

Methodology · Statistics 2025-02-19 Yuanlu Bai , Henry Lam

Statistical prediction plays an important role in many decision processes such as university budgeting (depending on the number of students who will enroll), capital budgeting (depending on the remaining lifetime of a fleet of systems), the…

Methodology · Statistics 2021-10-14 Qinglong Tian , Daniel J. Nordman , William Q. Meeker

Estimating the probability of rare channel conditions is a central challenge in ultra-reliable wireless communication, where random events, such as deep fades, can cause sudden variations in the channel quality. This paper proposes a…

Signal Processing · Electrical Eng. & Systems 2024-07-08 Tobias Kallehauge , Anders E. Kalør , Pablo Ramírez-Espinosa , Christophe Biscio , Petar Popovski

In many industrial applications, signals with short periodic pulses, caused by repeated steps in the manufacturing process, are present, and their fundamental frequency or period may be of interest. Fundamental frequency estimation is in…

We propose a sigmoidal approximation for the value-at-risk (that we call SigVaR) and we use this approximation to tackle nonlinear programs (NLPs) with chance constraints. We prove that the approximation is conservative and that the level…

Optimization and Control · Mathematics 2020-04-07 Yankai Cao , Victor M. Zavala

The likelihood ratio is a crucial quantity for statistical inference in science that enables hypothesis testing, construction of confidence intervals, reweighting of distributions, and more. Many modern scientific applications, however,…

High Energy Physics - Phenomenology · Physics 2024-12-11 Shahzar Rizvi , Mariel Pettee , Benjamin Nachman

Multiple comparison procedures that control a family-wise error rate or false discovery rate provide an achieved error rate as the adjusted p-value for each hypothesis tested. However, since such p-values are not probabilities that the null…

Methodology · Statistics 2013-09-03 David R. Bickel

Frequency estimation from measurements corrupted by noise is a fundamental challenge across numerous engineering and scientific fields. Among the pivotal factors shaping the resolution capacity of any frequency estimation technique are…

Signal Processing · Electrical Eng. & Systems 2024-09-23 Sampath Kumar Dondapati , Omkar Nitsure , Satish Mulleti

Learning-to-rank (LTR) algorithms are ubiquitous and necessary to explore the extensive catalogs of media providers. To avoid the user examining all the results, its preferences are used to provide a subset of relatively small size. The…

The estimation of parameters in the frequency spectrum of a seasonally persistent stationary stochastic process is addressed. For seasonal persistence associated with a pole in the spectrum located away from frequency zero, a new…

Methodology · Statistics 2007-09-04 Emma J. McCoy , Sofia C. Olhede , David A. Stephens

Certifiable, adaptive uncertainty estimates for unknown quantities are an essential ingredient of sequential decision-making algorithms. Standard approaches rely on problem-dependent concentration results and are limited to a specific…

Machine Learning · Computer Science 2023-11-09 Nicolas Emmenegger , Mojmír Mutný , Andreas Krause

In this letter, we analyze the achievable rate of ultra-reliable low-latency communications (URLLC) in a randomly modeled wireless network. We use two mathematical tools to properly characterize the considered system: i) stochastic geometry…

Information Theory · Computer Science 2019-10-31 Jeonghun Park
‹ Prev 1 2 3 10 Next ›