English
Related papers

Related papers: Bounds for Algorithmic Mutual Information and a Un…

200 papers

Recent work on neural algorithmic reasoning has investigated the reasoning capabilities of neural networks, effectively demonstrating they can learn to execute classical algorithms on unseen data coming from the train distribution. However,…

We investigate the information complexity of mixed-integer convex optimization under different types of oracles. We establish new lower bounds for the standard first-order oracle, improving upon the previous best known lower bound. This…

Optimization and Control · Mathematics 2023-08-23 Amitabh Basu , Hongyi Jiang , Phillip Kerger , Marco Molinaro

In former work, we showed that a quantum algorithm is the sum over the histories of a classical algorithm that knows in advance 50% of the information about the solution of the problem - each history is a possible way of getting the…

Quantum Physics · Physics 2009-11-17 Giuseppe Castagnoli

We consider a hidden Markov model with multiple observation processes, one of which is chosen at each point in time by a policy---a deterministic function of the information state---and attempt to determine which policy minimises the…

Probability · Mathematics 2015-03-17 James Y. Zhao

In recent decades, a growing number of discoveries in fields of mathematics have been assisted by computer algorithms, primarily for exploring large parameter spaces that humans would take too long to investigate. As computers and…

The structure of data organization is widely recognized as having a substantial influence on the efficacy of machine learning algorithms, particularly in binary classification tasks. Our research provides a theoretical framework suggesting…

Machine Learning · Computer Science 2024-07-15 Fei Jing , Zi-Ke Zhang , Yi-Cheng Zhang , Qingpeng Zhang

Partially observable Markov decision processes (POMDPs) are a general framework for sequential decision-making under latent state uncertainty, yet learning in POMDPs is intractable in the worst case. Motivated by sensing and probing…

Machine Learning · Computer Science 2026-01-27 Ming Shi , Yingbin Liang , Ness B. Shroff

We investigate measurements of bipartite ensembles restricted to local operations and classical communication and find a universal Holevo-like upper bound on the locally accessible information. We analyze our bound and exhibit a class of…

Quantum Physics · Physics 2009-10-20 Piotr Badziag , Michal Horodecki , Aditi Sen De , Ujjwal Sen

Consider a channel $W$ along with a given input distribution $P_X$. In certain settings, such as in the construction of polar codes, the output alphabet of $W$ is `too large', and hence we replace $W$ by a channel $Q$ having a smaller…

Information Theory · Computer Science 2021-05-31 Or Ordentlich , Ido Tal

The storage capacity of an incremental learning algorithm for the parity machine, the Tilinglike Learning Algorithm, is analytically determined in the limit of a large number of hidden perceptrons. Different learning rules for the simple…

Disordered Systems and Neural Networks · Physics 2009-10-31 Arnaud Buhot , Mirta B. Gordon

We study the compute-optimal trade-off between model and training data set sizes for large neural networks. Our result suggests a linear relation similar to that supported by the empirical analysis of chinchilla. While that work studies…

Machine Learning · Computer Science 2023-10-20 Hong Jun Jeon , Benjamin Van Roy

Most of the unsupervised dependency parsers are based on first-order probabilistic generative models that only consider local parent-child information. Inspired by second-order supervised dependency parsing, we proposed a second-order…

Computation and Language · Computer Science 2020-10-29 Songlin Yang , Yong Jiang , Wenjuan Han , Kewei Tu

In this paper, we consider the distributed estimation problem of a linear stochastic system described by an autoregressive model with exogenous inputs (ARX) when both the system orders and parameters are unknown. We design distributed…

Systems and Control · Electrical Eng. & Systems 2021-10-20 Die Gan , Zhixin Liu

Scientific explanation often requires inferring maximally predictive features from a given data set. Unfortunately, the collection of minimal maximally predictive features for most stochastic processes is uncountably infinite. In such…

Statistical Mechanics · Physics 2017-05-31 Sarah E. Marzen , James P. Crutchfield

We construct mixing processes over an infinite alphabet and ergodic processes over a finite alphabet for which Shannon mutual information between adjacent blocks of length $n$ grows as $n^\beta$, where $\beta\in(0,1)$. The processes are a…

Information Theory · Computer Science 2020-03-11 Łukasz Dębowski

Many machine learning approaches are characterized by information constraints on how they interact with the training data. These include memory and sequential access constraints (e.g. fast first-order methods to solve stochastic…

Machine Learning · Computer Science 2014-10-29 Ohad Shamir

The flow of information reaching us via the online media platforms is optimized not by the information content or relevance but by popularity and proximity to the target. This is typically performed in order to maximise platform usage. As a…

Physics and Society · Physics 2019-06-19 Alina Sîrbu , Dino Pedreschi , Fosca Giannotti , János Kertész

We select policies for large Markov Decision Processes (MDPs) with compact first-order representations. We find policies that generalize well as the number of objects in the domain grows, potentially without bound. Existing…

Artificial Intelligence · Computer Science 2013-01-07 Sung Wook Yoon , Alan Fern , Robert Givan

This paper addresses the challenge of offline policy learning in reinforcement learning with continuous action spaces when unmeasured confounders are present. While most existing research focuses on policy evaluation within partially…

Machine Learning · Statistics 2025-05-02 Yuhan Li , Eugene Han , Yifan Hu , Wenzhuo Zhou , Zhengling Qi , Yifan Cui , Ruoqing Zhu

Prior work on generating explanations in a planning and decision-making context has focused on providing the rationale behind an AI agent's decision making. While these methods provide the right explanations from the explainer's…

Artificial Intelligence · Computer Science 2020-10-20 Mehrdad Zakershahrak , Shashank Rao Marpally , Akshay Sharma , Ze Gong , Yu Zhang