English
Related papers

Related papers: Multimodal Task Representation Memory Bank vs. Cat…

200 papers

Functional magnetic resonance imaging (fMRI) is widely used for studying and diagnosing brain disorders, with functional connectivity (FC) matrices providing powerful representations of large-scale neural interactions. However, existing…

Tissues and Organs · Quantitative Biology 2026-04-17 Qianyu Chen , Shujian Yu

Modern recommender systems face critical challenges in handling information overload while addressing the inherent limitations of multimodal representation learning. Existing methods suffer from three fundamental limitations: (1) restricted…

Information Retrieval · Computer Science 2025-08-15 Zheyu Chen , Jinfeng Xu , Hewei Wang , Shuo Yang , Zitong Wan , Haibo Hu

Transformers have been established as the de-facto backbones for most recent advances in sequence modeling, mainly due to their growing memory capacity that scales with the context length. While plausible for retrieval tasks, it causes…

Machine Learning · Computer Science 2026-03-02 Ali Behrouz , Zeman Li , Yuan Deng , Peilin Zhong , Meisam Razaviyayn , Vahab Mirrokni

Learning representations of multimodal data that are both informative and robust to missing modalities at test time remains a challenging problem due to the inherent heterogeneity of data obtained from different channels. To address it, we…

Machine Learning · Computer Science 2022-11-21 Petra Poklukar , Miguel Vasco , Hang Yin , Francisco S. Melo , Ana Paiva , Danica Kragic

Anomaly detection has recently gained increasing attention in the field of computer vision, likely due to its broad set of applications ranging from product fault detection on industrial production lines and impending event detection in…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Neelu Madan , Nicolae-Catalin Ristea , Radu Tudor Ionescu , Kamal Nasrollahi , Fahad Shahbaz Khan , Thomas B. Moeslund , Mubarak Shah

When tasks change over time, meta-transfer learning seeks to improve the efficiency of learning a new task via both meta-learning and transfer-learning. While the standard attention has been effective in a variety of settings, we question…

Machine Learning · Computer Science 2020-06-30 Jaesik Yoon , Gautam Singh , Sungjin Ahn

Unsupervised anomaly detection in medical imaging aims to detect and localize arbitrary anomalies without requiring annotated anomalous data during training. Often, this is achieved by learning a data distribution of normal samples and…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Carsten T. Lüth , David Zimmerer , Gregor Koehler , Paul F. Jaeger , Fabian Isensee , Jens Petersen , Klaus H. Maier-Hein

Self-supervised learning approaches leverage unlabeled samples to acquire generic knowledge about different concepts, hence allowing for annotation-efficient downstream task learning. In this paper, we propose a novel self-supervised method…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Aiham Taleb , Christoph Lippert , Tassilo Klein , Moin Nabi

Multimodal learning robust to missing modality has attracted increasing attention due to its practicality. Existing methods tend to address it by learning a common subspace representation for different modality combinations. However, we…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Shicai Wei , Yang Luo , Yuji Wang , Chunbo Luo

Generally intelligent agents exhibit successful behavior across problems in several settings. Endemic in approaches to realize such intelligence in machines is catastrophic forgetting: sequential learning corrupts knowledge obtained earlier…

Artificial Intelligence · Computer Science 2018-04-13 Shawn L. E. Beaulieu , Sam Kriegman , Josh C. Bongard

This paper introduces INCPrompt, an innovative continual learning solution that effectively addresses catastrophic forgetting. INCPrompt's key innovation lies in its use of adaptive key-learner and task-aware prompts that capture…

Machine Learning · Computer Science 2025-09-04 Zhiyuan Wang , Xiaoyang Qu , Jing Xiao , Bokui Chen , Jianzong Wang

Continual learning has become essential in many practical applications such as online news summaries and product classification. The primary challenge is known as catastrophic forgetting, a phenomenon where a model inadvertently discards…

Machine Learning · Computer Science 2025-01-13 Xiaodi Li , Dingcheng Li , Rujun Gao , Mahmoud Zamani , Latifur Khan

In this study, we address the interpretability issue in complex, black-box Machine Learning models applied to sequence data. We introduce the Model-Based tree Hidden Semi-Markov Model (MOB-HSMM), an inherently interpretable model aimed at…

Machine Learning · Computer Science 2023-10-31 Chan Hsu , Wei-Chun Huang , Jun-Ting Wu , Chih-Yuan Li , Yihuang Kang

A significant challenge to make learning techniques more suitable for general purpose use is to move beyond i) complete supervision, ii) low dimensional data, iii) a single task and single view per instance. Solving these challenges allows…

Machine Learning · Computer Science 2012-02-07 Buyue Qian , Xiang Wang , Ian Davidson

Intelligent systems deployed in the real world suffer from catastrophic forgetting when exposed to a sequence of tasks. Humans, on the other hand, acquire, consolidate, and transfer knowledge between tasks that rarely interfere with the…

Machine Learning · Computer Science 2023-02-23 Prashant Bhat , Bahram Zonooz , Elahe Arani

Concept Bottleneck Models (CBMs) assume that training examples (e.g., x-ray images) are annotated with high-level concepts (e.g., types of abnormalities), and perform classification by first predicting the concepts, followed by predicting…

Computation and Language · Computer Science 2023-12-19 Danis Alukaev , Semen Kiselev , Ilya Pershin , Bulat Ibragimov , Vladimir Ivanov , Alexey Kornaev , Ivan Titov

Neural networks encounter the challenge of Catastrophic Forgetting (CF) in continual learning, where new task learning interferes with previously learned knowledge. Existing data fine-tuning and regularization methods necessitate task…

Machine Learning · Computer Science 2024-05-17 Yuwei Sun , Ippei Fujisawa , Arthur Juliani , Jun Sakuma , Ryota Kanai

Unsupervised feature learning methods have proven effective for classification tasks based on a single modality. We present multimodal sparse coding for learning feature representations shared across multiple modalities. The shared…

Machine Learning · Computer Science 2016-05-18 Youngjune Gwon , William Campbell , Kevin Brady , Douglas Sturim , Miriam Cha , H. T. Kung

Maximum Manifold Capacity Representations (MMCR) is a recent multi-view self-supervised learning (MVSSL) method that matches or surpasses other leading MVSSL methods. MMCR is intriguing because it does not fit neatly into any of the…

Restricted Boltzmann machines (RBMs) and their extensions, called 'deep-belief networks', are powerful neural networks that have found applications in the fields of machine learning and artificial intelligence. The standard way to training…

Machine Learning · Computer Science 2018-10-25 Haik Manukian , Fabio L. Traversa , Massimiliano Di Ventra