English
Related papers

Related papers: Nonparametric Filtering, Estimation and Classifica…

200 papers

Filtering problems with jumps in both the signal and the observation have been extensively studied, typically under the assumption that jump times are totally inaccessible. In many applications, however, jump times are known in advance…

Probability · Mathematics 2026-05-13 Thorsten Schmidt , Félix B. Tambe-Ndonfack

Online-learning research has mainly been focusing on minimizing one objective function. In many real-world applications, however, several objective functions have to be considered simultaneously. Recently, an algorithm for dealing with…

Machine Learning · Computer Science 2017-03-21 Guy Uziel , Ran El-Yaniv

Batch training of machine learning models based on neural networks is now well established, whereas to date streaming methods are largely based on linear models. To go beyond linear in the online setting, nonparametric methods are of…

Signal Processing · Electrical Eng. & Systems 2020-01-22 Alec Koppel , Amrit Singh Bedi , Ketan Rajawat , Brian M. Sadler

Motivated by energy management for micro-grids, we study convex optimization problems with uncertainty in the objective function and sequential decision making. To solve these problems, we propose a new framework called ``Online…

Optimization and Control · Mathematics 2020-08-25 Martijn H. H. Schoot Uiterkamp , Marco E. T. Gerards , Johann L. Hurink

Many time series are effectively generated by a combination of deterministic continuous flows along with discrete jumps sparked by stochastic events. However, we usually do not have the equation of motion describing the flows, or how they…

Machine Learning · Computer Science 2020-01-09 Junteng Jia , Austin R. Benson

Optimal transport (OT) serves as a natural framework for comparing probability measures, with applications in statistics, machine learning, and applied mathematics. Alas, statistical estimation and exact computation of the OT distances…

Statistics Theory · Mathematics 2024-05-14 Tao Wang , Ziv Goldfeld

Model reduction for fluid flow simulation continues to be of great interest across a number of scientific and engineering fields. Here, we explore the use of Neural Ordinary Differential Equations, a recently introduced family of…

Machine Learning · Computer Science 2021-04-30 Sourav Dutta , Peter Rivera-Casillas , Matthew W. Farthing

The neural Ordinary Differential Equation (ODE) model has shown success in learning complex continuous-time processes from observations on discrete time stamps. In this work, we consider the modeling and forecasting of time series data that…

Machine Learning · Statistics 2023-06-05 Yixuan Tan , Liyan Xie , Xiuyuan Cheng

$ $The classical theory of statistical estimation aims to estimate a parameter of interest under data generated from a fixed design ("offline estimation"), while the contemporary theory of online learning provides algorithms for estimation…

Machine Learning · Statistics 2024-04-17 Dylan J. Foster , Yanjun Han , Jian Qian , Alexander Rakhlin

Differential equations in general and neural ODEs in particular are an essential technique in continuous-time system identification. While many deterministic learning algorithms have been designed based on numerical integration via the…

Machine Learning · Computer Science 2021-10-18 Lenart Treven , Philippe Wenk , Florian Dörfler , Andreas Krause

Optimal control problems naturally arise in many scientific applications where one wishes to steer a dynamical system from a certain initial state $\mathbf{x}_0$ to a desired target state $\mathbf{x}^*$ in finite time $T$. Recent advances…

Machine Learning · Computer Science 2022-09-20 Lucas Böttcher , Thomas Asikis

Using neural networks to solve partial differential equations (PDEs) is gaining popularity as an alternative approach in the scientific computing community. Neural networks can integrate different types of information into the loss…

Machine Learning · Computer Science 2024-05-07 Zhiwei Wang , Lulu Zhang , Zhongwang Zhang , Zhi-Qin John Xu

We develop an online data-enabled predictive (ODeePC) control method for optimal control of unknown systems, building on the recently proposed DeePC [1]. Our proposed ODeePC method leverages a primal-dual algorithm with real-time…

Optimization and Control · Mathematics 2020-11-20 Stefanos Baros , Chin-Yao Chang , Gabriel E. Colon-Reyes , Andrey Bernstein

LiDAR-based perception is critical for autonomous driving due to its robustness to poor lighting and visibility conditions. Yet, current models operate under the closed-set assumption and often fail to recognize unexpected…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Zizhao Li , Zhengkang Xiang , Jiayang Ao , Feng Liu , Joseph West , Kourosh Khoshelham

A class of neural networks that gained particular interest in the last years are neural ordinary differential equations (neural ODEs). We study input-output relations of neural ODEs using dynamical systems theory and prove several results…

Dynamical Systems · Mathematics 2023-09-29 Christian Kuehn , Sara-Viola Kuntz

Spurred by tremendous success in pattern matching and prediction tasks, researchers increasingly resort to machine learning to aid original scientific discovery. Given large amounts of observational data about a system, can we uncover the…

Machine Learning · Computer Science 2025-01-31 Hananeh Aliee , Fabian J. Theis , Niki Kilbertus

The existing Neural ODE formulation relies on an explicit knowledge of the termination time. We extend Neural ODEs to implicitly defined termination criteria modeled by neural event functions, which can be chained together and…

Machine Learning · Computer Science 2021-10-28 Ricky T. Q. Chen , Brandon Amos , Maximilian Nickel

Neural ordinary differential equations (Neural ODEs) propose the idea that a sequence of layers in a neural network is just a discretisation of an ODE, and thus can instead be directly modelled by a parameterised ODE. This idea has had…

Machine Learning · Computer Science 2024-05-07 Christina Runkel , Ander Biguri , Carola-Bibiane Schönlieb

Reinforcement learning-based quadruped robots excel across various terrains but still lack the ability to swim in water due to the complex underwater environment. This paper presents the development and evaluation of a data-driven…

Robotics · Computer Science 2024-10-02 Cong Wang , Aoming Liang , Fei Han , Xinyu Zeng , Zhibin Li , Dixia Fan , Jens Kober

Online convex optimization is a sequential prediction framework with the goal to track and adapt to the environment through evaluating proper convex loss functions. We study efficient particle filtering methods from the perspective of such…

Machine Learning · Computer Science 2018-07-23 Mahdi Azarafrooz