English
Related papers

Related papers: Parameter Estimation of Sigmoid Superpositions: Dy…

200 papers

In this paper, we deal with algorithms to solve the finite-sum problems related to fitting over-parametrized models, that typically satisfy the interpolation condition. In particular, we focus on approaches based on stochastic line searches…

Optimization and Control · Mathematics 2025-09-05 Matteo Lapucci , Davide Pucci

Nowadays, supervised learning is commonly used in many domains. Indeed, many works propose to learn new knowledge from examples that translate the expected behaviour of the considered system. A key issue of supervised learning concerns the…

Machine Learning · Computer Science 2012-04-20 Patrick Taillandier , Alexis Drogoul

Given a log and a specification, timed pattern matching aims at exhibiting for which start and end dates a specification holds on that log. For example, "a given action is always followed by another action before a given deadline". This…

Formal Languages and Automata Theory · Computer Science 2024-07-26 Masaki Waga , Étienne André , Ichiro Hasuo

We present a method for storing multiple models within a single set of parameters. Models can coexist in superposition and still be retrieved individually. In experiments with neural networks, we show that a surprisingly large number of…

Machine Learning · Computer Science 2019-06-18 Brian Cheung , Alex Terekhov , Yubei Chen , Pulkit Agrawal , Bruno Olshausen

In this work we present a new simple but efficient scheme - Subsquares approach - for development of algorithms for enclosing the solution set of overdetermined interval linear systems. We are going to show two algorithms based on this…

Numerical Analysis · Computer Science 2013-05-07 Jaroslav Horáček , Milan Hladík

We build on the dynamical systems approach to deep learning, where deep residual networks are idealized as continuous-time dynamical systems, from the approximation perspective. In particular, we establish general sufficient conditions for…

Machine Learning · Computer Science 2020-06-09 Qianxiao Li , Ting Lin , Zuowei Shen

Probabilistic Manifold Decomposition (PMD)\cite{doi:10.1137/25M1738863}, developed in our earlier work, provides a nonlinear model reduction by embedding high-dimensional dynamics onto low-dimensional probabilistic manifolds. The PMD has…

Numerical Analysis · Mathematics 2026-01-13 Jiaming Guo , Dunhui Xiao

We develop a practical approach to establish the stability, that is, the recurrence in a given set, of a large class of controlled Markov chains. These processes arise in various areas of applied science and encompass important numerical…

Statistics Theory · Mathematics 2015-02-02 Christophe Andrieu , Vladislav B. Tadić , Matti Vihola

It is widely believed that complex machine learning models generally encode features through linear representations. This is the foundational hypothesis behind a vast body of work on interpretability. A key challenge toward extracting…

Machine Learning · Computer Science 2026-04-01 Allen Liu

Path-following algorithms are frequently used in composite optimization problems where a series of subproblems, with varying regularization hyperparameters, are solved sequentially. By reusing the previous solutions as initialization,…

Optimization and Control · Mathematics 2021-12-10 Eugene Ndiaye , Ichiro Takeuchi

This paper deals with the robust stability analysis of linear systems, subject to time-varying parameters. The Parameter Dependent Lyapunov Function are considered, assuming that the temporal derivative of the parameters are bounded. Some…

Optimization and Control · Mathematics 2025-06-16 L. A. Mozelli , R. L. S. Adriano

In this work we propose a new kind of parameterized outer estimate of the united solution set to an interval parametric linear system. The new method has several advantages compared to the methods obtaining parameterized solutions…

Numerical Analysis · Mathematics 2020-04-02 Evgenija D. Popova

We develop a general framework for estimating function-valued parameters under equality or inequality constraints in infinite-dimensional statistical models. Such constrained learning problems are common across many areas of statistics and…

Machine Learning · Statistics 2025-07-22 Razieh Nabi , Nima S. Hejazi , Mark J. van der Laan , David Benkeser

We introduce a simple method to estimate the system parameters in continuous dynamical systems from the time series. In this method, we construct a modified system by introducing some constants (controlling constants) into the given…

Chaotic Dynamics · Physics 2009-11-10 P. Palaniyandi , M. Lakshmanan

We introduce parametrisation of that property of the available training dataset, that necessitates an inhomogeneous correlation structure for the function that is learnt as a model of the relationship between the pair of variables,…

Machine Learning · Statistics 2025-10-22 Gargi Roy , Dalia Chakrabarty

Logistic regression is the most commonly used method for constructing predictive models for binary responses. One significant drawback to this approach, however, is that the asymptotes of the logistic response function are fixed at 0 and 1,…

Methodology · Statistics 2026-02-09 Anthony Almudevar , Jacob Almudevar

We propose a novel method for fast and scalable evaluation of periodic solutions of systems of ordinary differential equations for a given set of parameter values and initial conditions. The equations governing the system dynamics are…

Dynamical Systems · Mathematics 2016-05-30 I. Yu. Tyukin , A. N. Gorban , T. A. Tyukina , J. Al Ameri , Yu. A. Korablev

Dynamic Complexity studies the maintainability of queries with logical formulas in a setting where the underlying structure or database changes over time. Most often, these formulas are from first-order logic, giving rise to the dynamic…

Logic in Computer Science · Computer Science 2019-10-16 Jonas Schmidt , Thomas Schwentick , Nils Vortmeier , Thomas Zeume , Ioannis Kokkinis

In this letter, we perform a sensitivity analysis on the master stability function approach for the synchronization of networks of coupled dynamical systems. More specifically, we analyze the linear stability of a nearly synchronized…

Disordered Systems and Neural Networks · Physics 2015-05-27 Francesco Sorrentino , Maurizio Porfiri

Nonlinear models and optimization methods have successfully tackled a rapidly growing set of problems in recent years. Indeed, a relatively small toolbox of such models and methods can provide sufficient performance across a large landscape…

Optimization and Control · Mathematics 2026-05-01 Akshunna S. Dogra