English
Related papers

Related papers: Optimal Data Reduction under Information-Theoretic…

200 papers

Bounded agents are limited by intrinsic constraints on their ability to process information that is available in their sensors and memory and choose actions and memory updates. In this dissertation, we model these constraints as…

Machine Learning · Computer Science 2017-03-31 Roy Fox

We propose algorithms to approximate directed information graphs. Directed information graphs are probabilistic graphical models that depict causal dependencies between stochastic processes in a network. The proposed algorithms identify…

Information Theory · Computer Science 2015-06-17 Christopher J. Quinn , Ali Pinar , Negar Kiyavash

We investigate the problem of estimating the causal effect of a treatment on individual subjects from observational data, this is a central problem in various application domains, including healthcare, social sciences, and online…

Methodology · Statistics 2019-01-30 Ahmed M. Alaa , Mihaela van der Schaar

Distributionally Robust Optimization (DRO), as a popular method to train robust models against distribution shift between training and test sets, has received tremendous attention in recent years. In this paper, we propose and analyze…

Machine Learning · Computer Science 2023-08-17 Qi Qi , Jiameng Lyu , Kung sik Chan , Er Wei Bai , Tianbao Yang

Model selection is a cornerstone of statistical inference, where information criteria are widely employed to balance model fit and complexity. However, classical likelihood-based criteria are often highly sensitive to contamination,…

Methodology · Statistics 2026-03-26 Udita Goswami , Shuvashree Mondal

We study the factor model problem, which aims to uncover low-dimensional structures in high-dimensional datasets. Adopting a robust data-driven approach, we formulate the problem as a saddle-point optimization. Our primary contribution is a…

Optimization and Control · Mathematics 2026-04-13 Shabnam Khodakaramzadeh , Soroosh Shafiee , Gabriel de Albuquerque Gleizer , Peyman Mohajerin Esfahani

The diverse world of machine learning applications has given rise to a plethora of algorithms and optimization methods, finely tuned to the specific regression or classification task at hand. We reduce the complexity of algorithm design for…

Optimization and Control · Mathematics 2016-05-23 Zeyuan Allen-Zhu , Elad Hazan

A well-known technique in estimating probabilities of rare events in general and in information theory in particular (used, e.g., in the sphere-packing bound), is that of finding a reference probability measure under which the event of…

Information Theory · Computer Science 2014-12-23 Rami Atar , Neri Merhav

This document introduces a strategy to solve linear optimization problems. The strategy is based on the bounding condition each constraint produces on each one of the problem's dimension. The solution of a linear optimization problem is…

Optimization and Control · Mathematics 2018-09-24 Gerardo L. Febres

A class of algorithms for the solution of discrete material optimization problems in electromagnetic applications is discussed. The idea behind the algorithm is similar to that of the sequential programming. However, in each major iteration…

Optimization and Control · Mathematics 2017-07-14 Johannes Semmler , Lukas Pflug , Michael Stingl

Shi and Tsai (JRSSB, 2002) proposed an interesting residual information criterion (RIC) for model selection in regression. Their RIC was motivated by the principle of minimizing the Kullback-Leibler discrepancy between the residual…

Methodology · Statistics 2007-11-14 Chenlei Leng

We present a novel, domain-agnostic, model-independent, unsupervised, and universally applicable Machine Learning approach for dimensionality reduction based on the principles of algorithmic complexity. Specifically, but without loss of…

Data Structures and Algorithms · Computer Science 2025-05-06 Hector Zenil , Narsis A. Kiani , Alyssa Adams , Felipe S. Abrahão , Antonio Rueda-Toicen , Allan A. Zea , Luan Ozelim , Jesper Tegnér

We consider the problem of clustering data that reside on discrete, low dimensional lattices. Canonical examples for this setting are found in image segmentation and key point extraction. Our solution is based on a recent approach to…

Computer Vision and Pattern Recognition · Computer Science 2013-10-29 Christian Bauckhage , Kristian Kersting

Information Bottleneck (IB) is a technique to extract information about one target random variable through another relevant random variable. This technique has garnered significant interest due to its broad applications in information…

Information Theory · Computer Science 2024-04-09 Lingyi Chen , Shitong Wu , Jiachuan Ye , Huihui Wu , Wenyi Zhang , Hao Wu

Neural networks can be compressed to reduce memory and computational requirements, or to increase accuracy by facilitating the use of a larger base architecture. In this paper we focus on pruning individual neurons, which can simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2018-04-20 Bin Dai , Chen Zhu , David Wipf

The study of the fundamental limits of information systems is a central theme in information theory. Both the traditional analytical approach and the recently proposed computational approach have significant limitations, where the former is…

Information Theory · Computer Science 2022-05-04 Wenjing Chen , Chao Tian

The information bottleneck principle is an elegant and useful approach to representation learning. In this paper, we investigate the problem of representation learning in the context of reinforcement learning using the information…

Machine Learning · Computer Science 2019-11-14 Pei Yingjun , Hou Xinwen

The problem of finding a reduced dimensionality representation of categorical variables while preserving their most relevant characteristics is fundamental for the analysis of complex data. Specifically, given a co-occurrence matrix of two…

Machine Learning · Computer Science 2012-12-12 Amir Globerson , Gal Chechik , Naftali Tishby

The dynamics of many-body systems can often be captured in terms of only a few relevant variables. Mathematical and numerical approaches exist to identify these variables by exploiting a separation of time scales between slow relevant and…

A high-ranking goal of interdisciplinary modeling approaches in the natural sciences are quantitative prediction of system dynamics and model based optimization. For this purpose, mathematical modeling, numerical simulation and scientific…

Optimization and Control · Mathematics 2015-03-17 Dominik Skanda , Dirk Lebiedz