English
Related papers

Related papers: Affect and Effect: Limitations of regularisation-b…

200 papers

We study the statistical performance of a continual learning problem with two linear regression tasks in a well-specified random design setting. We consider a structural regularization algorithm that incorporates a generalized…

Machine Learning · Computer Science 2025-04-08 Haoran Li , Jingfeng Wu , Vladimir Braverman

Accurate recognition of human emotional states is critical for effective human-machine interaction. Electroencephalography (EEG) offers a reliable source for emotion recognition due to its high temporal resolution and its direct reflection…

Machine Learning · Computer Science 2026-01-30 Maryam Mirzaei , Farzaneh Shayegh , Hamed Narimani

Continual learning (CL) aims to empower models to learn new tasks without forgetting previously acquired knowledge. Most prior works concentrate on the techniques of architectures, replay data, regularization, \etc. However, the category…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Bolin Ni , Hongbo Zhao , Chenghao Zhang , Ke Hu , Gaofeng Meng , Zhaoxiang Zhang , Shiming Xiang

Emotion recognition is crucial for advancing mental health, healthcare, and technologies like brain-computer interfaces (BCIs). However, EEG-based emotion recognition models face challenges in cross-domain applications due to the high cost…

Signal Processing · Electrical Eng. & Systems 2025-04-08 Md Niaz Imtiaz , Naimul Khan

Continual Learning (CL) methods aim to enable machine learning models to learn new tasks without catastrophic forgetting of those that have been previously mastered. Existing CL approaches often keep a buffer of previously-seen samples,…

Machine Learning · Computer Science 2022-02-22 Dong Gong , Qingsen Yan , Yuhang Liu , Anton van den Hengel , Javen Qinfeng Shi

As affective robots become integral in human life, these agents must be able to fairly evaluate human affective expressions without discriminating against specific demographic groups. Identifying bias in Machine Learning (ML) systems as a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Ozgur Kara , Nikhil Churamani , Hatice Gunes

Electroencephalography (EEG) based emotion recognition has demonstrated tremendous improvement in recent years. Specifically, numerous domain adaptation (DA) algorithms have been exploited in the past five years to enhance the…

Signal Processing · Electrical Eng. & Systems 2022-04-20 Yan Li , Hao Chen , Jake Zhao , Haolan Zhang , Jinpeng Li

We address the Continual Learning (CL) problem, wherein a model must learn a sequence of tasks from non-stationary distributions while preserving prior knowledge upon encountering new experiences. With the advancement of foundation models,…

Machine Learning · Computer Science 2024-07-08 Kyra Ahrens , Hans Hergen Lehmann , Jae Hee Lee , Stefan Wermter

In-context learning (ICL) achieves remarkable performance in various domains such as knowledge acquisition, commonsense reasoning, and semantic understanding. However, its performance significantly deteriorates for emotion detection tasks,…

Machine Learning · Computer Science 2025-10-13 Zhaochun Ren , Zhou Yang , Chenglong Ye , Yufeng Wang , Haizhou Sun , Chao Chen , Xiaofei Zhu , Yunbing Wu , Xiangwen Liao

Continual learning (CL) has remained a significant challenge for deep neural networks as learning new tasks erases previously acquired knowledge, either partially or completely. Existing solutions often rely on experience rehearsal or full…

Machine Learning · Computer Science 2025-05-29 Prashant Bhat , Laurens Niesten , Elahe Arani , Bahram Zonooz

Affective brain-computer interfaces based on electroencephalography (EEG) is an important branch in the field of affective computing. However, individual differences and noisy labels seriously limit the effectiveness and generalizability of…

Human-Computer Interaction · Computer Science 2022-05-09 Rushuang Zhou , Zhiguo Zhang , Hong Fu , Li Zhang , Linling Li , Gan Huang , Yining Dong , Fali Li , Xin Yang , Zhen Liang

Existing generalization theories of supervised learning typically take a holistic approach and provide bounds for the expected generalization over the whole data distribution, which implicitly assumes that the model generalizes similarly…

Machine Learning · Computer Science 2024-01-08 Firas Laakom , Yuheng Bu , Moncef Gabbouj

General-purpose learning systems should improve themselves in open-ended fashion in ever-changing environments. Conventional learning algorithms for neural networks, however, suffer from catastrophic forgetting (CF), i.e., previously…

Machine Learning · Computer Science 2025-02-18 Kazuki Irie , Róbert Csordás , Jürgen Schmidhuber

An interesting case of the well-known Dataset Shift Problem is the classification of Electroencephalogram (EEG) signals in the context of Brain-Computer Interface (BCI). The non-stationarity of EEG signals can lead to poor generalisation…

Machine Learning · Computer Science 2024-05-21 Andrea Apicella , Francesco Isgrò , Andrea Pollastro , Roberto Prevete

LSTMs promise much to financial time-series analysis, temporal and cross-sectional inference, but we find that they do not deliver in a real-world financial management task. We examine an alternative called Continual Learning (CL), a…

Machine Learning · Computer Science 2019-12-11 Daniel Philps , Artur d'Avila Garcez , Tillman Weyde

The goal of Continual Learning (CL) task is to continuously learn multiple new tasks sequentially while achieving a balance between the plasticity and stability of new and old knowledge. This paper analyzes that this insufficiency arises…

Machine Learning · Computer Science 2024-05-28 Hanxi Xiao , Fan Lyu

Self-supervised learning has emerged as a highly effective approach in the fields of natural language processing and computer vision. It is also applicable to brain signals such as electroencephalography (EEG) data, given the abundance of…

Signal Processing · Electrical Eng. & Systems 2024-01-22 Yuqi Chen , Kan Ren , Kaitao Song , Yansen Wang , Yifan Wang , Dongsheng Li , Lili Qiu

Continual learning of deep neural networks is a key requirement for scaling them up to more complex applicative scenarios and for achieving real lifelong learning of these architectures. Previous approaches to the problem have considered…

Machine Learning · Computer Science 2020-06-25 Jary Pomponi , Simone Scardapane , Vincenzo Lomonaco , Aurelio Uncini

Effectiveness of speech emotion recognition in real-world scenarios is often hindered by noisy environments and variability across datasets. This paper introduces a two-step approach to enhance the robustness and generalization of speech…

Sound · Computer Science 2025-10-13 Upasana Tiwari , Rupayan Chakraborty , Sunil Kumar Kopparapu

We propose a novel regularization-based continual learning method, dubbed as Adaptive Group Sparsity based Continual Learning (AGS-CL), using two group sparsity-based penalties. Our method selectively employs the two penalties when learning…

Machine Learning · Computer Science 2021-06-01 Sangwon Jung , Hongjoon Ahn , Sungmin Cha , Taesup Moon