English
Related papers

Related papers: Learning CNF formulas from uniform random solution…

200 papers

Continuous normalizing flows (CNFs) learn an ordinary differential equation to transform prior samples into data. Flow matching (FM) has recently emerged as a simulation-free approach for training CNFs by regressing a velocity model towards…

Machine Learning · Statistics 2024-05-28 Tianyu Xie , Yu Zhu , Longlin Yu , Tong Yang , Ziheng Cheng , Shiyue Zhang , Xiangyu Zhang , Cheng Zhang

Sampling from unnormalised discrete distributions is a fundamental problem across various domains. While Markov chain Monte Carlo offers a principled approach, it often suffers from slow mixing and poor convergence. In this paper, we…

Machine Learning · Computer Science 2025-10-23 Zijing Ou , Ruixiang Zhang , Yingzhen Li

The Lov\'asz Local Lemma is a versatile result in probability theory, characterizing circumstances in which a collection of $n$ `bad events', each occurring with probability at most $p$ and dependent on a set of underlying random variables,…

Data Structures and Algorithms · Computer Science 2025-02-18 Peter Davies-Peck

Reinforcement learning (RL) problems are fundamental in online decision-making and have been instrumental in finding an optimal policy for Markov decision processes (MDPs). Function approximations are usually deployed to handle large or…

Machine Learning · Computer Science 2025-05-20 Jiashuo Jiang , Yiming Zong , Yinyu Ye

Model counting of Disjunctive Normal Form (DNF) formulas is a critical problem in applications such as probabilistic inference and network reliability. For example, it is often used for query evaluation in probabilistic databases. Due to…

Data Structures and Algorithms · Computer Science 2026-01-16 Paul Burkhardt , David G. Harris , Kevin T Schmitt

We consider the problems of testing and learning an $n$-qubit $k$-local Hamiltonian from queries to its evolution operator with respect the 2-norm of the Pauli spectrum, or equivalently, the normalized Frobenius norm. For testing whether a…

Quantum Physics · Physics 2024-04-10 Francisco Escudero Gutiérrez

The problem of estimating an unknown discrete distribution from its samples is a fundamental tenet of statistical learning. Over the past decade, it attracted significant research effort and has been solved for a variety of divergence…

Machine Learning · Computer Science 2018-10-30 Yi Hao , Alon Orlitsky , Venkatadheeraj Pichapati

Often machine learning and statistical models will attempt to describe the majority of the data. However, there may be situations where only a fraction of the data can be fit well by a linear regression model. Here, we are interested in a…

Machine Learning · Computer Science 2021-11-16 Brendan Juba , Leda Liang

In order to sample from an unnormalized probability density function, we propose to combine continuous normalizing flows (CNFs) with rejection-resampling steps based on importance weights. We relate the iterative training of CNFs with…

Machine Learning · Statistics 2025-08-14 Johannes Hertrich , Robert Gruhlke

We show an efficient algorithm for the following problem: Given uniformly random points from an arbitrary n-dimensional simplex, estimate the simplex. The size of the sample and the number of arithmetic operations of our algorithm are…

Machine Learning · Computer Science 2013-06-07 Joseph Anderson , Navin Goyal , Luis Rademacher

Reinforcement learning (RL) methods have been shown to be capable of learning intelligent behavior in rich domains. However, this has largely been done in simulated domains without adequate focus on the process of building the simulator. In…

Machine Learning · Computer Science 2019-10-24 Aditya Modi , Nan Jiang , Ambuj Tewari , Satinder Singh

A pair of clauses in a CNF formula constitutes a conflict if there is a variable that occurs positively in one clause and negatively in the other. A CNF formula without any conflicts is satisfiable. The Lovasz Local Lemma implies that a…

Discrete Mathematics · Computer Science 2010-09-07 Dominik Scheder , Philipp Zumstein

Model counting is a fundamental problem that consists of determining the number of satisfying assignments for a given Boolean formula. The weighted variant, which computes the weighted sum of satisfying assignments, has extensive…

Discrete Mathematics · Computer Science 2026-05-08 L. Sunil Chandran , Rishikesh Gajjala , Kuldeep S. Meel

Weighted model counting (WMC) has emerged as a prevalent approach for probabilistic inference. In its most general form, WMC is #P-hard. Weighted DNF counting (weighted #DNF) is a special case, where approximations with probabilistic…

Artificial Intelligence · Computer Science 2020-01-31 Ralph Abboud , Ismail Ilkan Ceylan , Thomas Lukasiewicz

Continuous normalizing flows (CNFs) are a generative method for learning probability distributions, which is based on ordinary differential equations. This method has shown remarkable empirical success across various applications, including…

Machine Learning · Statistics 2024-04-02 Yuan Gao , Jian Huang , Yuling Jiao , Shurong Zheng

We study the sample complexity of learning a high-dimensional simplex from a set of points uniformly sampled from its interior. Learning of simplices is a long studied problem in computer science and has applications in computational…

Machine Learning · Computer Science 2020-08-14 Amir Najafi , Saeed Ilchi , Amir H. Saberi , Seyed Abolfazl Motahari , Babak H. Khalaj , Hamid R. Rabiee

We prove a new structural lemma for partial Boolean functions $f$, which we call the seed lemma for DNF. Using the lemma, we give the first subexponential algorithm for proper learning of DNF in Angluin's Equivalence Query (EQ) model. The…

Machine Learning · Computer Science 2011-11-07 Lisa Hellerstein , Devorah Kletenik , Linda Sellie , Rocco Servedio

In many applications, data come with a natural ordering. This ordering can often induce local dependence among nearby variables. However, in complex data, the width of this dependence may vary, making simple assumptions such as a constant…

Statistics Theory · Mathematics 2017-12-11 Guo Yu , Jacob Bien

In a recent breakthrough, [Bshouty et al., 2005] obtained the first passive-learning algorithm for DNFs under the uniform distribution. They showed that DNFs are learnable in the Random Walk and Noise Sensitivity models. We extend their…

Machine Learning · Computer Science 2011-09-07 S. Roch

Markov random fields (MRFs) appear in many problems in machine learning and statistics. From a computational learning theory point of view, a natural problem of learning MRFs arises: given samples from an MRF from a restricted class, learn…

Quantum Physics · Physics 2021-09-07 Liming Zhao , Siyi Yang , Patrick Rebentrost