English
Related papers

Related papers: Empirical risk minimization and complexity of dyna…

200 papers

We propose novel parameter estimation algorithms for a class of dynamical systems with nonlinear parametrization. The class is initially restricted to smooth monotonic functions with respect to a linear functional of the parameters. We show…

Dynamical Systems · Mathematics 2007-05-23 Ivan Tyukin , Danil Prokhorov , Cees van Leeuwen

This paper extends the standard chaining technique to prove excess risk upper bounds for empirical risk minimization with random design settings even if the magnitude of the noise and the estimates is unbounded. The bound applies to many…

Machine Learning · Statistics 2016-09-08 Gábor Balázs , András György , Csaba Szepesvári

This paper studies empirical risk minimization (ERM) problems for large-scale datasets and incorporates the idea of adaptive sample size methods to improve the guaranteed convergence bounds for first-order stochastic and deterministic…

Machine Learning · Computer Science 2017-09-05 Aryan Mokhtari , Alejandro Ribeiro

The principle of maximum entropy is a broadly applicable technique for computing a distribution with the least amount of information possible constrained to match empirical data, for instance, feature expectations. We seek to generalize…

Information Theory · Computer Science 2022-05-30 Kenneth Bogert

Tuning parameters are parameters involved in an estimating procedure for the purpose of reducing the risk of some other estimator. Examples include the degree of penalization in penalized regression and likelihood problems, as well as the…

Statistics Theory · Mathematics 2026-03-31 Ingrid Dæhlen , Nils Lid Hjort , Ingrid Hobæk Haff

With the deluge of digitized information in the Big Data era, massive datasets are becoming increasingly available for learning predictive models. However, in many practical situations, the poor control of the data acquisition processes may…

Machine Learning · Statistics 2022-11-02 Stephan Clémençon , Pierre Laforgue

In various practical situations, we encounter data from stochastic processes which can be efficiently modelled by an appropriate parametric model for subsequent statistical analyses. Unfortunately, the most common estimation and inference…

Methodology · Statistics 2022-04-12 Rohan Hore , Abhik Ghosh

The concept of random dynamical system is a comparatively recent development combining ideas and methods from the well developed areas of probability theory and dynamical systems. Due to our inaccurate knowledge of the particular physical…

Dynamical Systems · Mathematics 2007-05-23 Vitor Araujo

There is mounting empirical evidence that many communities of living organisms display key features which closely resemble those of physical systems at criticality. We here introduce a minimal model framework for the dynamics of a community…

Biological Physics · Physics 2020-02-17 Fabio Peruzzo , Mauro Mobilia , Sandro Azaele

We propose to examine the predictability and the complexity characteristics of the Standard&Poor500 dynamics behaviors in a coarse-grained way using the symbolic dynamics method and under the prism of the Information theory through the…

Statistical Finance · Quantitative Finance 2021-05-11 Geoffrey Ducournau

Using statistical thermodynamics, we derive a general expression of the stationary probability distribution for thermodynamic systems driven out of equilibrium by several thermodynamic forces. The local equilibrium is defined by imposing…

Statistical Mechanics · Physics 2015-06-12 Giorgio Sonnino , György Steinbrecher , Alessandro Cardinali , Alberto Sonnino , Mustapha Tlidi

This paper studies the dynamic programming principle using the measurable selection method for stochastic control of continuous processes. The novelty of this work is to incorporate intermediate expectation constraints on the canonical…

Optimization and Control · Mathematics 2020-04-22 Yuk-Loong Chow , Xiang Yu , Chao Zhou

The identification of a linear system model from data has wide applications in control theory. The existing work that provides finite sample guarantees for linear system identification typically uses data from a single long system…

Machine Learning · Statistics 2025-05-09 Lei Xin , Baike She , Qi Dou , George Chiu , Shreyas Sundaram

The aim of this paper is to address optimality of stochastic control strategies via dynamic programming subject to total variation distance ambiguity on the conditional distribution of the controlled process. We formulate the stochastic…

Optimization and Control · Mathematics 2014-02-06 Ioannis Tzortzis , Charalambos D. Charalambous , Themistoklis Charalambous

We establish new conditions for obtaining uniform bounds on the moments of discrete-time stochastic processes. Our results require a weak negative drift criterion along with a state-dependent restriction on the sizes of the one-step jumps…

Probability · Mathematics 2022-06-02 Arnab Ganguly , Debasish Chatterjee

Motivated by microscopic traffic modeling, we analyze dynamical systems which have a piecewise linear concave dynamics not necessarily monotonic. We introduce a deterministic Petri net extension where edges may have negative weights. The…

Optimization and Control · Mathematics 2010-01-26 Nadir Farhi , Maurice Goursat , Jean-Pierre Quadrat

The definition of complexity through Statistical Complexity Measures (SCM) has recently seen major improvements. Mostly, effort is concentrated in measures on time series. We propose a SCM definition for spatial dynamical systems. Our…

Statistical Mechanics · Physics 2015-06-17 A. Arbona , C. Bona , B. Miñano , A. Plastino

Noisy dynamical models are employed to describe a wide range of phenomena. Since exact modeling of these phenomena requires access to their microscopic dynamics, whose time scales are typically much shorter than the observable time scales,…

Statistical Mechanics · Physics 2015-11-18 Giovanni Volpe , Jan Wehr

Let $(U_n(t))_{t\in\R^d}$ be the empirical process associated to an $\R^d$-valued stationary process $(X_i)_{i\ge 0}$. We give general conditions, which only involve processes $(f(X_i))_{i\ge 0}$ for a restricted class of functions $f$,…

Probability · Mathematics 2012-10-02 Olivier Durieu , Marco Tusche

We propose a new inference framework, named MOSAIC, for change-point detection in dynamic networks with the simultaneous low-rank and sparse-change structure. We establish the minimax rate of detection boundary, which relies on the sparsity…

Machine Learning · Statistics 2025-09-09 Yingying Fan , Jingyuan Liu , Jinchi Lv , Ao Sun
‹ Prev 1 4 5 6 7 8 10 Next ›