English
Related papers

Related papers: Linear-time Minimum Bayes Risk Decoding with Refer…

200 papers

This paper describes a method for a model-based analysis of clinical safety data called multivariate Bayesian logistic regression (MBLR). Parallel logistic regression models are fit to a set of medically related issues, or response…

Methodology · Statistics 2012-10-02 William DuMouchel

In this paper, we first introduce the concept of elementary linear subspace, which has similar properties to those of a set of coordinates. We then use elementary linear subspaces to derive properties of maximum rank distance (MRD) codes…

Information Theory · Computer Science 2008-03-03 Maximilien Gadouleau , Zhiyuan Yan

We determine the critical noise level for decoding low density parity check error correcting codes based on the magnetization enumerator ($\cM$), rather than on the weight enumerator ($\cW$) employed in the information theory literature.…

Disordered Systems and Neural Networks · Physics 2013-05-29 J. van Mourik , D. Saad , Y. Kabashima

Minimum error rate training (MERT) is a widely used training procedure for statistical machine translation. A general problem of this approach is that the search space is easy to converge to a local optimum and the acquired weight set is…

Computation and Language · Computer Science 2014-05-13 Chen Lijiang

In this paper, we introduce the increasing belief criterion in association rule mining. The criterion uses a recursive application of Bayes' theorem to compute a rule's belief. Extracted rules are required to have their belief increase with…

Artificial Intelligence · Computer Science 2020-01-15 Luis Ignacio Lopera González , Adrian Derungs , Oliver Amft

Computing the marginal likelihood or evidence is one of the core challenges in Bayesian analysis. While there are many established methods for estimating this quantity, they predominantly rely on using a large number of posterior samples…

Computation · Statistics 2021-02-26 Eric Chuu , Debdeep Pati , Anirban Bhattacharya

In this paper, we propose a new stochastic optimization algorithm for Bayesian inference based on multilevel Monte Carlo (MLMC) methods. In Bayesian statistics, biased estimators of the model evidence have been often used as stochastic…

Machine Learning · Statistics 2021-02-26 Kei Ishikawa , Takashi Goda

Error correction at short blocklengths remains a challenge for low-density parity-check (LDPC) codes, as belief propagation (BP) decoding is suboptimal compared to maximum-likelihood decoding (MLD). While BP rarely makes errors, it often…

Information Theory · Computer Science 2025-07-08 Ahmad Ismail , Raphaël Le Bidan , Elsa Dupraz , Charbel Abdel Nour

We address the sparse signal recovery problem in the context of multiple measurement vectors (MMV) when elements in each nonzero row of the solution matrix are temporally correlated. Existing algorithms do not consider such temporal…

Machine Learning · Statistics 2011-08-18 Zhilin Zhang , Bhaskar D. Rao

Reed-Muller (RM) codes are known for their good maximum likelihood (ML) performance in the short block-length regime. Despite being one of the oldest classes of channel codes, finding a low complexity soft-input decoding scheme is still an…

Information Theory · Computer Science 2021-07-19 Marvin Geiselhart , Ahmed Elkelesh , Moustafa Ebada , Sebastian Cammerer , Stephan ten Brink

We aim to investigate the performance of current OCR systems on low resource languages and low resource scripts. We introduce and make publicly available a novel benchmark, OCR4MT, consisting of real and synthetic data, enriched with noise,…

Computation and Language · Computer Science 2022-03-15 Oana Ignat , Jean Maillard , Vishrav Chaudhary , Francisco Guzmán

Reed-Muller codes encode an $m$-variate polynomial of degree $r$ by evaluating it on all points in $\{0,1\}^m$. We denote this code by $RM(m,r)$. The minimal distance of $RM(m,r)$ is $2^{m-r}$ and so it cannot correct more than half that…

Information Theory · Computer Science 2015-08-28 Ramprasad Saptharishi , Amir Shpilka , Ben Lee Volk

It is often of interest to estimate regression functions non-parametrically. Penalized regression (PR) is one statistically-effective, well-studied solution to this problem. Unfortunately, in many cases, finding exact solutions to PR…

Methodology · Statistics 2021-12-08 Brayan Ortiz , Noah Simon

The model averaging problem is to average multiple models to achieve a prediction accuracy not much worse than that of the best single model in terms of mean squared error. It is known that if the models are misspecified, model averaging is…

Statistics Theory · Mathematics 2018-02-28 Dong Dai , Lei Han , Ting Yang , Tong Zhang

Binary observations are often repeated to improve data quality, creating technical replicates. Several scoring methods are commonly used to infer the actual individual state and obtain a probability for each state. The common practice of…

Methodology · Statistics 2025-01-24 Manuela Royer-Carenzi , Hadrien Lorenzo , Pierre Pudlo

Regularized risk minimization with the binary hinge loss and its variants lies at the heart of many machine learning problems. Bundle methods for regularized risk minimization (BMRM) and the closely related SVMStruct are considered the best…

Machine Learning · Computer Science 2009-09-09 Ankan Saha , Xinhua Zhang , S. V. N. Vishwanathan

his study presents a novel technique to estimate the computational complexity of sequential decoding using the Berry-Esseen theorem. Unlike the theoretical bounds determined by the conventional central limit theorem argument, which often…

Information Theory · Computer Science 2007-08-20 Po-Ning Chen , Yunghsiang S. Han , Carlos R. P. Hartmann , Hong-Bin Wu

In decoding linear block codes, it was shown that noticeable reliability gains can be achieved by introducing learnable parameters to the Belief Propagation (BP) decoder. Despite the success of these methods, there are two key open…

Information Theory · Computer Science 2023-04-13 Sravan Kumar Ankireddy , Hyeji Kim

Medical coding (MC) is an essential pre-requisite for reliable data retrieval and reporting. Given a free-text reported term (RT) such as "pain of right thigh to the knee", the task is to identify the matching lowest-level term (LLT) - in…

Information Retrieval · Computer Science 2025-01-08 Angelo Ziletti , Alan Akbik , Christoph Berns , Thomas Herold , Marion Legler , Martina Viell

We consider the problem of signal reconstruction from quadratic measurements that are encoded as +1 or -1 depending on whether they exceed a predetermined positive threshold or not. Binary measurements are fast to acquire and inexpensive in…

Information Theory · Computer Science 2018-03-14 Subhadip Mukherjee , Chandra Sekhar Seelamantula