English
Related papers

Related papers: On Prediction Using Variable Order Markov Models

200 papers

We present new MCMC algorithms for computing the posterior distributions and expectations of the unknown variables in undirected graphical models with regular structure. For demonstration purposes, we focus on Markov Random Fields (MRFs).…

Computation · Statistics 2012-07-19 Firas Hamze , Nando de Freitas

In this paper, we evaluate the capability of transformer-based language models in making inferences over uncertain text that includes uncertain rules of reasoning. We cover both Pre-trained Language Models (PLMs) and generative Large…

Computation and Language · Computer Science 2024-02-12 Aliakbar Nafar , Kristen Brent Venable , Parisa Kordjamshidi

The idea of this project is to study the protein structure and sequence relationship using the hidden markov model and artificial neural network. In this context we have assumed two hidden markov models. In first model we have taken protein…

Machine Learning · Computer Science 2012-06-18 Saurabh Sarkar , Prateek Malhotra , Virender Guman

Partially observable Markov decision processes (POMDPs) with continuous state and observation spaces have powerful flexibility for representing real-world decision and control problems but are notoriously difficult to solve. Recent online…

Machine Learning · Computer Science 2023-06-06 Michael H. Lim , Claire J. Tomlin , Zachary N. Sunberg

Molecular Property Prediction (MPP) is a fundamental problem in drug discovery that has recently attracted growing attention. Large Language Models (LLMs), known for their impressive proficiency across domains, show promise as generalist…

Machine Learning · Computer Science 2026-05-28 Khiem Le , Sreejata Dey , Marcos Martínez Galindo , Vanessa Lopez , Ting Hua , Nitesh V. Chawla , Hoang Thanh Lam

This paper describes a data reduction technique in case of a markov chain of specified order. Instead of observing all the transitions in a markov chain we record only a few of them and treat the remaining part as missing. The decision…

Methodology · Statistics 2018-07-17 Atanu Kumar Ghosh , Arnab Chakraborty

Data compression continues to evolve, with traditional information theory methods being widely used for compressing text, images, and videos. Recently, there has been growing interest in leveraging Generative AI for predictive compression…

Information Theory · Computer Science 2024-09-24 Swathi Shree Narashiman , Nitin Chandrachoodan

Various and ubiquitous information systems are being used in monitoring, exchanging, and collecting information. These systems are generating massive amount of event sequence logs that may help us understand underlying phenomenon. By…

Machine Learning · Statistics 2018-07-13 Yihuang Kang , Vladimir Zadorozhny

Data used for analytics and machine learning often take the form of tables with categorical entries. We introduce a family of lossless compression algorithms for such data that proceed in four steps: $(i)$ Estimate latent variables…

Information Theory · Computer Science 2023-02-21 Andrea Montanari , Eric Weiner

Multinomial processing tree (MPT) models are tools for disentangling the contributions of latent cognitive processes in a given experimental paradigm. The present note analyzes MPT models subject to order constraints on subsets of its…

Applications · Statistics 2014-11-11 Karl Christoph Klauer , Henrik Singmann , David Kellen

Cumulative prospect theory (CPT) is the first theory for decision-making under uncertainty that combines full theoretical soundness and empirically realistic features [P.P. Wakker - Prospect theory: For risk and ambiguity, Page 2]. While…

Logic in Computer Science · Computer Science 2025-05-15 Thomas Brihaye , Krishnendu Chatterjee , Stefanie Mohr , Maximilian Weininger

Given the widespread use of lossless compression algorithms to approximate algorithmic (Kolmogorov-Chaitin) complexity, and that lossless compression algorithms fall short at characterizing patterns other than statistical ones not different…

Information Theory · Computer Science 2017-08-15 Fernando Soler-Toscano , Hector Zenil

Finite order Markov models are theoretically well-studied models for dependent discrete data. Despite their generality, application in empirical work when the order is large is rare. Practitioners avoid using higher order Markov models…

Statistics Theory · Mathematics 2023-03-06 Guilherme Ost , Daniel Takahashi

Determinantal point processes (DPPs) are probabilistic models for repulsion. When used to represent the occurrence of random subsets of a finite base set, DPPs allow to model global negative associations in a mathematically elegant and…

Statistics Theory · Mathematics 2019-01-29 Kayvan Sadeghi , Alessandro Rinaldo

Mappings to structured output spaces (strings, trees, partitions, etc.) are typically learned using extensions of classification algorithms to simple graphical structures (eg., linear chains) in which search and parameter estimation can be…

Machine Learning · Computer Science 2009-07-07 Hal Daumé , Daniel Marcu

Dynamic Programming Languages are quite popular because they increase the programmer's productivity. However, the absence of types in the source code makes the program written in these languages difficult to understand and virtual machines…

Programming Languages · Computer Science 2019-01-17 Abhinav Jangda , Gaurav Anand

The P\'olya tree (PT) process is a general-purpose Bayesian nonparametric model that has found wide application in a range of inference problems. It has a simple analytic form and the posterior computation boils down to beta-binomial…

Methodology · Statistics 2021-12-09 Naoki Awaya , Li Ma

Pre-transformed polar codes (PTPCs) form a class of codes that perform close to the finite-length capacity bounds. The minimum distance and the number of minimum weight codewords are two decisive properties for their performance. In this…

Information Theory · Computer Science 2024-04-29 Andreas Zunker , Marvin Geiselhart , Stephan ten Brink

We present the first study of non-deterministic weighted automata under probabilistic semantics. In this semantics words are random events, generated by a Markov chain, and functions computed by weighted automata are random variables. We…

Formal Languages and Automata Theory · Computer Science 2019-11-01 Jakub Michaliszyn , Jan Otop

Most representation learning algorithms for language and image processing are local, in that they identify features for a data point based on surrounding points. Yet in language processing, the correct meaning of a word often depends on its…

Machine Learning · Computer Science 2014-02-19 Anjan Nepal , Alexander Yates