中文
相关论文

相关论文: Learning latent representations across multiple da…

200 篇论文

In this work, we improve the generative replay in a continual learning setting to perform well on challenging scenarios. Current generative rehearsal methods are usually benchmarked on small and simple datasets as they are not powerful…

机器学习 · 计算机科学 2023-09-20 Valeriya Khan , Sebastian Cygert , Kamil Deja , Tomasz Trzciński , Bartłomiej Twardowski

Graph Neural Networks (GNNs) have recently received significant research attention due to their superior performance on a variety of graph-related learning tasks. Most of the current works focus on either static or dynamic graph settings,…

机器学习 · 计算机科学 2021-02-09 Fan Zhou , Chengtai Cao

To successfully apply trained neural network models to new domains, powerful transfer learning solutions are essential. We propose to introduce a novel cross-domain latent modulation mechanism to a variational autoencoder framework so as to…

机器学习 · 计算机科学 2024-02-01 Jinyong Hou , Jeremiah D. Deng , Stephen Cranefield , Xuejie Din

Continual Learning (CL) for malware classification tackles the rapidly evolving nature of malware threats and the frequent emergence of new types. Generative Replay (GR)-based CL systems utilize a generative model to produce synthetic…

密码学与安全 · 计算机科学 2025-01-03 Jimin Park , AHyun Ji , Minji Park , Mohammad Saidur Rahman , Se Eun Oh

We propose a Bayesian neural network-based continual learning algorithm using Variational Inference, aiming to overcome several drawbacks of existing methods. Specifically, in continual learning scenarios, storing network parameters at each…

机器学习 · 计算机科学 2024-11-22 Sanchar Palit , Biplab Banerjee , Subhasis Chaudhuri

We introduce generative models for accelerating simulations of complex systems through learning and evolving their effective dynamics. In the proposed Generative Learning of Effective Dynamics (G-LED), instances of high dimensional data are…

机器学习 · 计算机科学 2024-02-28 Han Gao , Sebastian Kaltenbach , Petros Koumoutsakos

We introduce a new method for internal replay that modulates the frequency of rehearsal based on the depth of the network. While replay strategies mitigate the effects of catastrophic forgetting in neural networks, recent works on…

计算机视觉与模式识别 · 计算机科学 2022-07-07 Stanisław Pawlak , Filip Szatkowski , Michał Bortkiewicz , Jan Dubiński , Tomasz Trzciński

In this paper, we introduce variational semantic memory into meta-learning to acquire long-term knowledge for few-shot learning. The variational semantic memory accrues and stores semantic information for the probabilistic inference of…

机器学习 · 计算机科学 2021-07-16 Xiantong Zhen , Yingjun Du , Huan Xiong , Qiang Qiu , Cees G. M. Snoek , Ling Shao

Vision-language navigation (VLN) is a critical domain within embedded intelligence, requiring agents to navigate 3D environments based on natural language instructions. Traditional VLN research has focused on improving environmental…

人工智能 · 计算机科学 2024-09-24 Zhiyuan Li , Yanfeng Lv , Ziqin Tu , Di Shang , Hong Qiao

Deep Reinforcement Learning agents often suffer from catastrophic forgetting, forgetting previously found solutions in parts of the input space when training on new data. Replay Memories are a common solution to the problem, decorrelating…

机器学习 · 计算机科学 2023-08-29 Muhammad Burhan Hafez , Tilman Immisch , Tom Weber , Stefan Wermter

End-to-end training of Spoken Language Models (SLMs) commonly involves adapting pre-trained text-based Large Language Models (LLMs) to the speech modality through multi-stage training on diverse tasks such as ASR, TTS and spoken question…

计算与语言 · 计算机科学 2025-05-26 Chi-Yuan Hsiao , Ke-Han Lu , Kai-Wei Chang , Chih-Kai Yang , Wei-Chih Chen , Hung-yi Lee

Compressive sensing (CS) is widely used to reduce the acquisition time of magnetic resonance imaging (MRI). Although state-of-the-art deep learning based methods have been able to obtain fast, high-quality reconstruction of CS-MR images,…

图像与视频处理 · 电气工程与系统科学 2020-09-25 Bhavya Vasudeva , Puneesh Deora , Saumik Bhattacharya , Pyari Mohan Pradhan

Humans and animals have the ability to continually acquire, fine-tune, and transfer knowledge and skills throughout their lifespan. This ability, referred to as lifelong learning, is mediated by a rich set of neurocognitive mechanisms that…

机器学习 · 计算机科学 2019-02-12 German I. Parisi , Ronald Kemker , Jose L. Part , Christopher Kanan , Stefan Wermter

Continual lifelong learning is an machine learning framework inspired by human learning, where learners are trained to continuously acquire new knowledge in a sequential manner. However, the non-stationary nature of streaming training data…

机器学习 · 计算机科学 2024-05-14 Xingyu Li , Bo Tang , Haifeng Li

Deep learning models often suffer from forgetting previously learned information when trained on new data. This problem is exacerbated in federated learning (FL), where the data is distributed and can change independently for each user.…

机器学习 · 计算机科学 2023-11-22 Sara Babakniya , Zalan Fabian , Chaoyang He , Mahdi Soltanolkotabi , Salman Avestimehr

Models trained in the context of continual learning (CL) should be able to learn from a stream of data over an undefined period of time. The main challenges herein are: 1) maintaining old knowledge while simultaneously benefiting from it…

神经与进化计算 · 计算机科学 2019-12-03 Oleksiy Ostapenko , Mihai Puscas , Tassilo Klein , Patrick Jähnichen , Moin Nabi

Recent improvements in Generative Adversarial Neural Networks (GANs) have shown their ability to generate higher quality samples as well as to learn good representations for transfer learning. Most of the representation learning methods…

音频与语音处理 · 电气工程与系统科学 2020-06-02 Kazi Nazmul Haque , Rajib Rana , John H. L. Hansen , Björn Schuller

Generative models have emerged as powerful tools in medical imaging, enabling tasks such as segmentation, anomaly detection, and high-quality synthetic data generation. These models typically rely on learning meaningful latent…

计算机视觉与模式识别 · 计算机科学 2026-02-17 Jordi Malé , Juan Fortea , Mateus Rozalem-Aranha , Neus Martínez-Abadías , Xavier Sevillano

Continual learning aims to provide intelligent agents that are capable of learning continually a sequence of tasks, building on previously learned knowledge. A key challenge in this learning paradigm is catastrophically forgetting…

机器学习 · 计算机科学 2021-01-18 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

While autoregressive Large Vision-Language Models (LVLMs) demonstrate remarkable proficiency in multimodal tasks, they face a "Visual Signal Dilution" phenomenon, where the accumulation of textual history expands the attention partition…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Siyuan Huang , Xiaoye Qu , Yafu Li , Tong Zhu , Zefeng He , Muxin Fu , Daizong Liu , Wei-Long Zheng , Yu Cheng