English
Related papers

Related papers: Maximum Entropy Property of Discrete-time Stable S…

200 papers

Diffusion models do not recover semantic structure uniformly over time. Instead, samples transition from semantic ambiguity to class commitment within a narrow regime. Recent theoretical work attributes this transition to dynamical…

Machine Learning · Statistics 2026-02-11 Florian Handke , Dejan Stančević , Felix Koulischer , Thomas Demeester , Luca Ambrogioni

We study the supremum of some random Dirichlet polynomials with independent coefficients and obtain sharp upper and lower bounds for supremum expectation thus extending the results from our previous work (see…

Probability · Mathematics 2009-04-23 Mikhail Lifshits , Michel Weber

The characterisation of information processing is an important task in complex systems science. Information dynamics is a quantitative methodology for modelling the intrinsic information processing conducted by a process represented as a…

Information Theory · Computer Science 2018-08-01 Richard E. Spinney , Joseph T. Lizier

In this paper we propose a model predictive control scheme for constrained fractional-order discrete-time systems. We prove that all constraints are satisfied at all time instants and we prescribe conditions for the origin to be an…

Optimization and Control · Mathematics 2016-06-16 Pantelis Sopasakis , Haralambos Sarimveis

Differentially private (DP) stochastic convex optimization (SCO) is a fundamental problem, where the goal is to approximately minimize the population risk with respect to a convex loss function, given a dataset of $n$ i.i.d. samples from a…

Machine Learning · Computer Science 2022-05-06 Raef Bassily , Cristóbal Guzmán , Anupama Nandi

This article considers a discrete-time robust optimal control problem on matrix Lie groups. The underlying system is assumed to be perturbed by exogenous unmeasured bounded disturbances, and the control problem is posed as a min-max optimal…

Optimization and Control · Mathematics 2020-07-28 Anant A. Joshi , Debasish Chatterjee , Ravi N. Banavar

In stochastic control applications, typically only an ideal model (controlled transition kernel) is assumed and the control design is based on the given model, raising the problem of performance loss due to the mismatch between the assumed…

Systems and Control · Computer Science 2020-02-04 Ali Devran Kara , Serdar Yüksel

R\'esum\'e: Le principal objet de cette communication est de faire une r\'etro perspective succincte de l'utilisation de l'entropie et du principe du maximum d'entropie dans le domaine du traitement du signal. Apr\`es un bref rappel de…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Ali Mohammad-Djafari

We study the problem of synthesizing a policy that maximizes the entropy of a Markov decision process (MDP) subject to a temporal logic constraint. Such a policy minimizes the predictability of the paths it generates, or dually, maximizes…

Optimization and Control · Mathematics 2019-06-17 Yagiz Savas , Melkior Ornik , Murat Cubuktepe , Mustafa O. Karabag , Ufuk Topcu

The main goal of the paper is to establish time semidiscrete and space-time fully discrete maximal parabolic regularity for the time discontinuous Galerkin solution of linear parabolic equations. Such estimates have many applications. They…

Numerical Analysis · Mathematics 2018-08-20 Dmitriy Leykekhman , Boris Vexler

We study tagged particle diffusion at large packing fractions, for a model of particles interacting with a generalized Lennard-Jones 2n-n potential, with large n. The resulting short-range potential mimics interactions in colloidal systems.…

Soft Condensed Matter · Physics 2007-05-23 Luca Angelani , Giuseppe Foffi , Francesco Sciortino , Piero Tartaglia

Privacy is a central challenge for systems that learn from sensitive data sets, especially when a system's outputs must be continuously updated to reflect changing data. We consider the achievable error for differentially private continual…

Data Structures and Algorithms · Computer Science 2024-07-12 Palak Jain , Iden Kalemaj , Sofya Raskhodnikova , Satchit Sivakumar , Adam Smith

In this paper we show that the existence of a primarily discrete space-time may be a fruitful assumption from which we may develop a new approach of statistical thermodynamics in pre-relativistic conditions. The discreetness of space-time…

Quantum Physics · Physics 2010-05-17 J. P. Badiali

We introduce a method for quantifying the inherent unpredictability of a continuous-valued time series via an extension of the differential Shannon entropy rate. Our extension, the specific entropy rate, quantifies the amount of predictive…

Machine Learning · Computer Science 2016-06-09 David Darmon

This paper studies an optimal control problem for continuous-time stochastic systems subject to reachability objectives specified in a subclass of metric interval temporal logic specifications, a temporal logic with real-time constraints.…

Systems and Control · Computer Science 2015-04-21 Jie Fu , Ufuk Topcu

In [1] it is shown that recurrent neural networks (RNNs) can learn - in a metric entropy optimal manner - discrete time, linear time-invariant (LTI) systems. This is effected by comparing the number of bits needed to encode the…

Dynamical Systems · Mathematics 2022-11-29 Clemens Hutter , Thomas Allard , Helmut Bölcskei

A time crystal is a state of periodically driven matter which breaks discrete time translation symmetry. Time crystals have been demonstrated experimentally in various programmable quantum simulators and exemplify how non-equilibrium,…

Disordered Systems and Neural Networks · Physics 2023-03-21 Andrew Stasiuk , Paola Cappellaro

We address the problem of estimating the running quantile of a data stream when the memory for storing observations is limited. We (i) highlight the limitations of approaches previously described in the literature which make them unsuitable…

Data Structures and Algorithms · Computer Science 2014-09-26 Ognjen Arandjelovic , Ducson Pham , Svetha Venkatesh

Preservation of the maximum principle is studied for the combination of the linear finite element method in space and the $\theta$-method in time for solving time dependent anisotropic diffusion problems. It is shown that the numerical…

Numerical Analysis · Mathematics 2013-10-23 Xianping Li , Weizhang Huang

Entropy and differential entropy are important quantities in information theory. A tractable extension to singular random variables-which are neither discrete nor continuous-has not been available so far. Here, we present such an extension…

Information Theory · Computer Science 2017-01-04 Günther Koliander , Georg Pichler , Erwin Riegler , Franz Hlawatsch