English
Related papers

Related papers: Machine Learning from a Continuous Viewpoint

200 papers

Continual learning (CL) is a fundamental topic in machine learning, where the goal is to train a model with continuously incoming data and tasks. Due to the memory limit, we cannot store all the historical data, and therefore confront the…

Machine Learning · Computer Science 2024-07-31 Weichen Lin , Jiaxiang Chen , Ruomin Huang , Hu Ding

The rapid advancement of generative models has empowered modern AI systems to comprehend and produce highly sophisticated content, even achieving human-level performance in specific domains. However, these models are fundamentally…

This paper introduces a deep learning system based on a quantum neural network for the binary classification of points of a specific geometric pattern (Two-Moons Classification problem) on a plane. We believe that the use of hybrid deep…

Quantum Physics · Physics 2022-08-10 Marco Simonetti , Damiano Perri , Osvaldo Gervasi

Continual learning (CL) provides a framework for training models in ever-evolving environments. Although re-occurrence of previously seen objects or tasks is common in real-world problems, the concept of repetition in the data stream is not…

Inverse medium scattering is an ill-posed, nonlinear wave-based imaging problem arising in medical imaging, remote sensing, and non-destructive testing. Machine learning (ML) methods offer increased inference speed and flexibility in…

Computational Physics · Physics 2025-12-12 Olivia Tsang , Owen Melia , Vasileios Charisopoulos , Jeremy Hoskins , Yuehaw Khoo , Rebecca Willett

Continual learning and machine unlearning are crucial challenges in machine learning, typically addressed separately. Continual learning focuses on adapting to new knowledge while preserving past information, whereas unlearning involves…

Machine Learning · Computer Science 2024-12-30 Romit Chatterjee , Vikram Chundawat , Ayush Tarun , Ankur Mali , Murari Mandal

We present a probabilistic viewpoint to multiple kernel learning unifying well-known regularised risk approaches and recent advances in approximate Bayesian inference relaxations. The framework proposes a general objective function suitable…

Machine Learning · Statistics 2012-06-08 Hannes Nickisch , Matthias Seeger

Machine learning has achieved tremendous success in a variety of domains in recent years. However, a lot of these success stories have been in places where the training and the testing distributions are extremely similar to each other. In…

Machine Learning · Statistics 2021-03-05 Martin Arjovsky

This paper revisits the principle of uniform convergence in statistical learning, discusses how it acts as the foundation behind machine learning, and attempts to gain a better understanding of the essential problem that current deep…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Lei Zhang , Heung-Yeung Shum

This paper proposes inverse feature learning as a novel supervised feature learning technique that learns a set of high-level features for classification based on an error representation approach. The key contribution of this method is to…

Machine Learning · Computer Science 2020-03-10 Behzad Ghazanfari , Fatemeh Afghah , MohammadTaghi Hajiaghayi

Continual learning (CL) is the sub-field of machine learning concerned with accumulating knowledge in dynamic environments. So far, CL research has mainly focused on incremental classification tasks, where models learn to classify new…

The demands on visual recognition systems do not end with the complexity offered by current large-scale image datasets, such as ImageNet. In consequence, we need curious and continuously learning algorithms that actively acquire knowledge…

Computer Vision and Pattern Recognition · Computer Science 2016-12-20 Christoph Käding , Erik Rodner , Alexander Freytag , Joachim Denzler

Real-world natural language processing (NLP) models need to be continually updated to fix the prediction errors in out-of-distribution (OOD) data streams while overcoming catastrophic forgetting. However, existing continual learning (CL)…

Computation and Language · Computer Science 2022-05-05 Bill Yuchen Lin , Sida Wang , Xi Victoria Lin , Robin Jia , Lin Xiao , Xiang Ren , Wen-tau Yih

Since about 100 years ago, to learn the intrinsic structure of data, many representation learning approaches have been proposed, including both linear ones and nonlinear ones, supervised ones and unsupervised ones. Particularly, deep…

Machine Learning · Computer Science 2016-11-28 Guoqiang Zhong , Li-Na Wang , Junyu Dong

Manifold learning is a popular and quickly-growing subfield of machine learning based on the assumption that one's observed data lie on a low-dimensional manifold embedded in a higher-dimensional space. This thesis presents a mathematical…

Machine Learning · Computer Science 2020-11-04 Luke Melas-Kyriazi

Reconstructing force fields (FFs) from atomistic simulation data is a challenge since accurate data can be highly expensive. Here, machine learning (ML) models can help to be data economic as they can be successfully constrained using the…

Chemical Physics · Physics 2022-10-27 Niklas Frederik Schmitz , Klaus-Robert Müller , Stefan Chmiela

Machine Learning (ML) is one of the most exciting and dynamic areas of modern research and application. The purpose of this review is to provide an introduction to the core concepts and tools of machine learning in a manner easily…

For a long time, machine learning (ML) has been seen as the abstract problem of learning relationships from data independent of the surrounding settings. This has recently been challenged, and methods have been proposed to include external…

Machine Learning · Computer Science 2023-02-08 Sebastian Scher , Bernhard Geiger , Simone Kopeinik , Andreas Trügler , Dominik Kowald

Deep learning has arguably achieved tremendous success in recent years. In simple words, deep learning uses the composition of many nonlinear functions to model the complex dependency between input features and labels. While neural networks…

Machine Learning · Statistics 2019-04-16 Jianqing Fan , Cong Ma , Yiqiao Zhong

Conventional machine learning studies generally assume close-environment scenarios where important factors of the learning process hold invariant. With the great success of machine learning, nowadays, more and more practical tasks,…

Machine Learning · Computer Science 2022-08-10 Zhi-Hua Zhou