相关论文: GPS Information and Rate Tolerance - Clarifying Re…
Common approach to radial distortion is by the means of polynomial approximation, which introduces distortion-specific parameters into the camera model and requires estimation of these distortion parameters. The task of estimating radial…
We study a gas of hard rods on a ring, driven by an external thermostat, with either elastic or inelastic collisions, which exhibits sub-diffusive behavior $<x^2 > \sim t^{1/2}$. We show the validity of the usual Fluctuation-Dissipation…
The Global Positioning System (GPS) provides an excellent educational example as to how the theory of general relativity is put into practice and becomes part of our everyday life. This paper gives a short and instructive derivation of an…
Galaxy peculiar velocities provide an integral source of cosmological information that can be harnessed to measure the growth rate of large scale structure and constrain possible extensions to General Relativity. In this work, we present a…
Calibration is a fundamental property of a good predictive model: it requires that the model predicts correctly in proportion to its confidence. Modern neural networks, however, provide no strong guarantees on their calibration -- and can…
Observations on the past provide some hints about what will happen in the future, and this can be quantified using information theory. The ``predictive information'' defined in this way has connections to measures of complexity that have…
Algorithm- and data-dependent generalization bounds are required to explain the generalization behavior of modern machine learning algorithms. In this context, there exists information theoretic generalization bounds that involve (various…
To test the theory of gravity one needs to test, on one hand, how space and time are distorted by matter and, on the other hand, how matter moves in a distorted space-time. Current observations provide tight constraints on the motion of…
We consider the problem of multiple description scalar quantizers and describing the achievable rate-distortion tuples in that setting. We formulate it as a combinatorial optimization problem of arranging numbers in a matrix to minimize the…
A general theoretical framework is presented for analyzing information transmission over Gaussian channels with memoryless transceiver distortion, which encompasses various nonlinear distortion models including transmit-side clipping,…
We consider rate-distortion with two decoders, each with distinct side information. This problem is well understood when the side information at the decoders satisfies a certain degradedness condition. We consider cases in which this…
It is not obvious what fraction of all the potential information residing in the molecules and structures of living systems is significant or meaningful to the system. Sets of random sequences or identically repeated sequences, for example,…
The notion of signal sparsity has been gaining increasing interest in information theory and signal processing communities. As a consequence, a plethora of sparsity metrics has been presented in the literature. The appropriateness of these…
We study the expressibility and learnability of convex optimization solution functions and their multi-layer architectural extension. The main results are: \emph{(1)} the class of solution functions of linear programming (LP) and quadratic…
Data mining services require accurate input data for their results to be meaningful, but privacy concerns may influence users to provide spurious information. To encourage users to provide correct inputs, we recently proposed a data…
The shapelet transform is a form of feature extraction for time series, in which a time series is described by its similarity to each of a collection of `shapelets'. However it has previously suffered from a number of limitations, such as…
We study temporally persistent and spatially extended extreme events of temperature anomalies, i.e. heat waves and cold spells, using large deviation theory. To this end, we consider a simplified yet Earth-like general circulation model of…
Pulsar timing is a valuable source of high-precision astrophysical measurements which can be used to probe gravitational physics, including by detecting gravitational waves. An important factor limiting the precision of these measurements…
A general notion of information-related complexity applicable to both natural and man-made systems is proposed. The overall approach is to explicitly consider a rational agent performing a certain task with a quantifiable degree of success.…
Numerical analysts might be expected to pay close attention to a branch of complexity theory called information-based complexity theory (IBCT), which produces an abundance of impressive results about the quest for approximate solutions to…