English
Related papers

Related papers: Bypassing the Noisy Parity Barrier: Learning Highe…

200 papers

Modeling the dynamics of non-stationary stochastic systems requires balancing the representational power of deep learning with the mathematical transparency of classical models. While classical Markov transition operators provide explicit,…

Machine Learning · Computer Science 2026-05-07 Jan Rovirosa , Jesse Schmolze

This paper addresses the challenge of a particular class of noisy state observations in Markov Decision Processes (MDPs), a common issue in various real-world applications. We focus on modeling this uncertainty through a confusion matrix…

Machine Learning · Computer Science 2023-12-15 Amirhossein Afsharrad , Sanjay Lall

We propose an application of online hard sample mining for efficient training of Neural Radiance Fields (NeRF). NeRF models produce state-of-the-art quality for many 3D reconstruction and rendering tasks but require substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Juuso Korhonen , Goutham Rangu , Hamed R. Tavakoli , Juho Kannala

Many latent-variable applications, including community detection, collaborative filtering, genomic analysis, and NLP, model data as generated by low-rank matrices. Yet despite considerable research, except for very special cases, the number…

Machine Learning · Computer Science 2020-10-02 Ayush Jain , Alon Orlitsky

The sim-to-real gap, which represents the disparity between training and testing environments, poses a significant challenge in reinforcement learning (RL). A promising approach to addressing this challenge is distributionally robust RL,…

Machine Learning · Computer Science 2024-11-05 Miao Lu , Han Zhong , Tong Zhang , Jose Blanchet

We consider the fundamental problem of learning the parameters of an undirected graphical model or Markov Random Field (MRF) in the setting where the edge weights are chosen at random. For Ising models, we show that a multiplicative-weight…

Machine Learning · Computer Science 2024-11-19 Gautam Chandrasekaran , Adam Klivans

The key assumption underlying linear Markov Decision Processes (MDPs) is that the learner has access to a known feature map $\phi(x, a)$ that maps state-action pairs to $d$-dimensional vectors, and that the rewards and transitions are…

Machine Learning · Computer Science 2023-09-20 Noah Golowich , Ankur Moitra , Dhruv Rohatgi

In this work, we study the problem of learning partially observed linear dynamical systems from a single sample trajectory. A major practical challenge in the existing system identification methods is the undesirable dependency of their…

Machine Learning · Computer Science 2020-10-09 Salar Fattahi

Markov decision processes (MDPs) are formal models commonly used in sequential decision-making. MDPs capture the stochasticity that may arise, for instance, from imprecise actuators via probabilities in the transition function. However, in…

Artificial Intelligence · Computer Science 2023-06-21 Marnix Suilen , Thiago D. Simão , David Parker , Nils Jansen

Aggregating a dataset, then injecting some noise, is a simple and common way to release differentially private data.However, aggregated data -- even without noise -- is not an appropriate input for machine learning classifiers.In this work,…

Machine Learning · Computer Science 2022-10-07 Alexandre Gilotte , Ahmed Ben Yahmed , David Rohde

Motivated by multiple applications in social networks, nervous systems, and financial risk analysis, we consider the problem of learning the underlying (directed) influence graph or causal graph of a high-dimensional multivariate…

Machine Learning · Computer Science 2024-06-14 Smita Bagewadi , Avhishek Chatterjee

A variety of complex biological, natural and man-made systems exhibit non-Markovian dynamics that can be modeled through fractional order differential equations, yet, we lack sample comlexity aware system identification strategies. Towards…

Systems and Control · Electrical Eng. & Systems 2025-06-23 Xiaole Zhang , Vijay Gupta , Paul Bogdan

There is mounting evidence of emergent phenomena in the capabilities of deep learning methods as we scale up datasets, model sizes, and training times. While there are some accounts of how these resources modulate statistical capacity, far…

Machine Learning · Computer Science 2023-01-18 Boaz Barak , Benjamin L. Edelman , Surbhi Goel , Sham Kakade , Eran Malach , Cyril Zhang

This work reports the most relevant technical aspects in the problem of learning the \emph{Markov network structure} from data. Such problem has become increasingly important in machine learning, and many other application fields of machine…

Artificial Intelligence · Computer Science 2013-11-21 Federico Schlüter

Machine learning (ML) algorithms become increasingly important in the analysis of astronomical data. However, since most ML algorithms are not designed to take data uncertainties into account, ML based studies are mostly restricted to data…

Instrumentation and Methods for Astrophysics · Physics 2018-12-26 Itamar Reis , Dalya Baron , Sahar Shahaf

We consider the structure learning problem for graphical models that we call loosely connected Markov random fields, in which the number of short paths between any pair of nodes is small, and present a new conditional independence test…

Machine Learning · Statistics 2014-02-05 Rui Wu , R. Srikant , Jian Ni

Understanding the data-generating process is essential for building machine learning models that generalise well while ensuring robustness and interpretability. This paper addresses the fundamental challenge of modelling the data generation…

Machine Learning · Computer Science 2025-08-11 Bohan Tang , Keyue Jiang , Laura Toni , Siheng Chen , Xiaowen Dong

We give faster algorithms for producing sparse approximations of the transition matrices of $k$-step random walks on undirected, weighted graphs. These transition matrices also form graphs, and arise as intermediate objects in a variety of…

Data Structures and Algorithms · Computer Science 2017-02-21 Gorav Jindal , Pavel Kolev , Richard Peng , Saurabh Sawlani

We study learning Censor Markov Random Fields (abbreviated CMRFs). These are Markov Random Fields where some of the nodes are censored (not observed). We present an algorithm for learning high-temperature CMRFs within o(n) transportation…

Machine Learning · Computer Science 2021-01-18 Ankur Moitra , Elchanan Mossel , Colin Sandon

In this work, we show, for the well-studied problem of learning parity under noise, where a learner tries to learn $x=(x_1,\ldots,x_n) \in \{0,1\}^n$ from a stream of random linear equations over $\mathrm{F}_2$ that are correct with…

Machine Learning · Computer Science 2021-07-07 Sumegha Garg , Pravesh K. Kothari , Pengda Liu , Ran Raz