English
Related papers

Related papers: ALKPU: an active learning method for the DeePMD mo…

200 papers

Sequential Bayesian filters in non-linear dynamic systems require the recursive estimation of the predictive and posterior distributions. This paper introduces a Bayesian filter called the adaptive kernel Kalman filter (AKKF). With this…

Signal Processing · Electrical Eng. & Systems 2023-04-12 Mengwei Sun , Mike E. Davies , Ian K. Proudler , James R. Hopgood

Water treatment and liquid storage are the two plants implementing the hydraulic three-tank system. Maintaining certain levels is the critical scenario so that the systems run as desired. To deal with, the optimal linear control and the…

Systems and Control · Electrical Eng. & Systems 2026-04-07 Bambang L. Widjiantoro , Katherin Indriawati , Moh Kamalul Wafi

Physics-Informed Neural Networks (PINNs) have emerged as a promising approach for solving Partial Differential Equations (PDEs) by incorporating physical constraints into deep learning models. However, standard PINNs often require a large…

Machine Learning · Computer Science 2025-05-05 Keon Vin Park

In order to integrate uncertainty estimates into deep time-series modelling, Kalman Filters (KFs) (Kalman et al., 1960) have been integrated with deep learning models, however, such approaches typically rely on approximate inference…

Machine Learning · Computer Science 2019-05-20 Philipp Becker , Harit Pandya , Gregor Gebhardt , Cheng Zhao , James Taylor , Gerhard Neumann

We investigate active learning in the context of deep neural network models for change detection and map updating. Active learning is a natural choice for a number of remote sensing tasks, including the detection of local surface changes:…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Vít Růžička , Stefano D'Aronco , Jan Dirk Wegner , Konrad Schindler

This paper introduces the Adaptive Learning Path Navigation (ALPN) system, a novel approach for enhancing E-learning platforms by providing highly adaptive learning paths for students. The ALPN system integrates the Attentive Knowledge…

Artificial Intelligence · Computer Science 2023-06-22 Jyun-Yi Chen , Saeed Saeedvand , I-Wei Lai

Koopman operator theory shows how nonlinear dynamical systems can be represented as an infinite-dimensional, linear operator acting on a Hilbert space of observables of the system. However, determining the relevant modes and eigenvalues of…

Machine Learning · Computer Science 2022-04-06 Daniel J. Alford-Lago , Christopher W. Curtis , Alexander T. Ihler , Opal Issan

It is imperative to accelerate the training of neural network force field such as Deep Potential, which usually requires thousands of images based on first-principles calculation and a couple of days to generate an accurate potential energy…

Computational Physics · Physics 2022-12-15 Siyu Hu , Wentao Zhang , Qiuchen Sha , Feng Pan , Lin-Wang Wang , Weile Jia , Guangmng Tan , Tong Zhao

Active learning (AL) is a prominent technique for reducing the annotation effort required for training machine learning models. Deep learning offers a solution for several essential obstacles to deploying AL in practice but introduces many…

Computation and Language · Computer Science 2022-05-10 Akim Tsvigun , Artem Shelmanov , Gleb Kuzmin , Leonid Sanochkin , Daniil Larionov , Gleb Gusev , Manvel Avetisian , Leonid Zhukov

Online multiple kernel learning (OMKL) has provided an attractive performance in nonlinear function learning tasks. Leveraging a random feature approximation, the major drawback of OMKL, known as the curse of dimensionality, has been…

Machine Learning · Computer Science 2020-05-08 Songnam Hong , Jeongmin Chae

This paper presents a deep learning enhanced adaptive unscented Kalman filter (UKF) for predicting human arm motion in the context of manufacturing. Unlike previous network-based methods that solely rely on captured human motion data, which…

Robotics · Computer Science 2024-02-21 Wansong Liu , Sibo Tian , Boyi Hu , Xiao Liang , Minghui Zheng

In this paper we introduce an active learning method for symbolic regression using StackGP. The approach begins with a small number of data points for StackGP to model. To improve the model the system incrementally adds a data point such…

Machine Learning · Computer Science 2022-02-11 Nathan Haut , Wolfgang Banzhaf , Bill Punch

Active learning methods are rapidly becoming the integral component of automated experiment workflows in imaging, materials synthesis, and computation. The distinctive aspect of many experimental scenarios is the presence of multiple…

Machine Learning · Computer Science 2022-03-22 Maxim Ziatdinov , Yongtao Liu , Sergei V. Kalinin

Model-based reinforcement learning algorithms tend to achieve higher sample efficiency than model-free methods. However, due to the inevitable errors of learned models, model-based methods struggle to achieve the same asymptotic performance…

Machine Learning · Computer Science 2019-12-02 Qi Zhou , Houqiang Li , Jie Wang

The traditional Kalman filter (KF) is widely applied in control systems, but it relies heavily on the accuracy of the system model and noise parameters, leading to potential performance degradation when facing inaccuracies. To address this…

Systems and Control · Electrical Eng. & Systems 2024-04-08 Jiaming Wang , Xinyu Geng , Jun Xu

Knowledge distillation (KD) is a widely used framework for training compact, task-specific models by transferring the knowledge from teacher models. However, its application to active learning (AL), which aims to minimize annotation costs…

Machine Learning · Computer Science 2025-10-02 Seongjae Kang , Dong Bok Lee , Hyungjoon Jang , Dongseop Kim , Sung Ju Hwang

Active Learning (AL) is increasingly important in a broad range of applications. Two main AL principles to obtain accurate classification with few labeled data are refinement of the current decision boundary and exploration of poorly…

Machine Learning · Computer Science 2012-10-19 Jens Roeder , Boaz Nadler , Kevin Kunzmann , Fred A. Hamprecht

Continual learning, involving sequential training on diverse tasks, often faces catastrophic forgetting. While knowledge distillation-based approaches exhibit notable success in preventing forgetting, we pinpoint a limitation in their…

Machine Learning · Computer Science 2024-05-17 Zenglin Shi , Pei Liu , Tong Su , Yunpeng Wu , Kuien Liu , Yu Song , Meng Wang

Large Language Models (LLMs) are highly accurate in classification tasks, however, substantial computational and financial costs hinder their large-scale deployment in dynamic environments. Knowledge Distillation (KD) where a LLM "teacher"…

Machine Learning · Computer Science 2025-11-18 Viviana Luccioli , Rithika Iyengar , Ryan Panley , Flora Haberkorn , Xiaoyu Ge , Leland Crane , Nitish Sinha , Seung Jung Lee

Improved state space models, such as Recurrent State Space Models (RSSMs), are a key factor behind recent advances in model-based reinforcement learning (RL). Yet, despite their empirical success, many of the underlying design choices are…

Machine Learning · Computer Science 2022-10-18 Philipp Becker , Gerhard Neumann