English
Related papers

Related papers: LACE: Loss-Adaptive Capacity Expansion for Continu…

200 papers

Deep transfer learning techniques try to tackle the limitations of deep learning, the dependency on extensive training data and the training costs, by reusing obtained knowledge. However, the current DTL techniques suffer from either…

Machine Learning · Computer Science 2023-05-12 Mohammadreza Iman , John A. Miller , Khaled Rasheed , Robert M. Branch , Hamid R. Arabnia

Multi-domain image-to-image translation re quires grounding semantic differences ex pressed in natural language prompts into corresponding visual transformations, while preserving unrelated structural and seman tic content. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Jongwon Ryu , Joonhyung Park , Jaeho Han , Yeong-Seok Kim , Hye-rin Kim , Sunjae Yoon , Junyeong Kim

Tensor decomposition (TD) is essential for analyzing high-dimensional sparse data, yet its irregular computations and memory-access patterns pose major performance challenges on modern parallel processors. Prior works rely on…

Machine Learning · Computer Science 2025-09-03 Ahmed E. Helal , Fabio Checconi , Jan Laukemann , Yongseok Soh , Jesmin Jahan Tithi , Fabrizio Petrini , Jee Choi

Continual learning (CL) enables models to adapt to new tasks and environments without forgetting previously learned knowledge. While current CL setups have ignored the relationship between labels in the past task and the new task with or…

Machine Learning · Computer Science 2023-08-29 Byung Hyun Lee , Okchul Jung , Jonghyun Choi , Se Young Chun

Ensuring neural networks adhere to domain-specific constraints is crucial for addressing safety and trustworthiness while also enhancing inference accuracy. Despite the nonlinear nature of most real-world tasks, the majority of existing…

Machine Learning · Computer Science 2026-05-05 Giacomo Lastrucci , Artur M. Schweidtmann

Generalized Category Discovery (GCD) seeks to identify novel categories from unlabeled data while retaining the classification ability of seen categories. Prior GCD methods commonly leverage transferable representations from pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Bo Ye , Kai Gan , Tong Wei , Min-Ling Zhang

The goal of this work is Active Speaker Detection (ASD), a task to determine whether a person is speaking or not in a series of video frames. Previous works have dealt with the task by exploring network architectures while learning…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Chaeyoung Jung , Suyeon Lee , Kihyun Nam , Kyeongha Rho , You Jin Kim , Youngjoon Jang , Joon Son Chung

LiDAR point cloud compression is vital for autonomous systems to handle massive data from high-resolution sensors. While learned entropy modeling built upon octree structures yields high compression gains, it faces two critical bottlenecks:…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jiahao Zhu , Kang You , Dandan Ding , Zhan Ma

Understanding when and how linguistic knowledge emerges during language model training remains a central challenge for interpretability. Most existing tools are post hoc, rely on scalar metrics, or require nontrivial integration effort,…

Computation and Language · Computer Science 2025-07-08 Nura Aljaafari , Danilo S. Carvalho , André Freitas

On-device learning is essential for personalization, privacy, and long-term adaptation in resource-constrained environments. Achieving this requires efficient learning, both fine-tuning existing models and continually acquiring new tasks…

Machine Learning · Computer Science 2026-03-18 Marco Paul E. Apolinario , Kaushik Roy

Anomaly Detection is a relevant problem that arises in numerous real-world applications, especially when dealing with images. However, there has been little research for this task in the Continual Learning setting. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Davide Dalle Pezze , Eugenia Anello , Chiara Masiero , Gian Antonio Susto

High-dimensional, heterogeneous data with complex feature interactions pose significant challenges for traditional predictive modeling approaches. While Projection to Latent Structures (PLS) remains a popular technique, it struggles to…

Machine Learning · Computer Science 2025-10-21 Farwa Abbas , Hussain Ahmad , Claudia Szabo

Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning. However, the incremental learning issue of CL has rarely been…

Machine Learning · Computer Science 2023-01-31 Cheng Ji , Jianxin Li , Hao Peng , Jia Wu , Xingcheng Fu , Qingyun Sun , Phillip S. Yu

Imbalanced datasets pose a considerable challenge in training deep learning (DL) models for medical diagnostics, particularly for segmentation tasks. Imbalance may be associated with annotation quality limited annotated datasets, rare…

Image and Video Processing · Electrical Eng. & Systems 2025-04-08 Bashir Alam , Masa Cirkovic , Mete Harun Akcay , Md Kaf Shahrier , Sebastien Lafond , Hergys Rexha , Kurt Benke , Sepinoud Azimi , Janan Arslan

Neural networks enjoy widespread use, but many aspects of their training, representation, and operation are poorly understood. In particular, our view into the training process is limited, with a single scalar loss being the most common…

Machine Learning · Computer Science 2020-03-04 Janice Lan , Rosanne Liu , Hattie Zhou , Jason Yosinski

Continual learning (CL) involves acquiring and accumulating knowledge from evolving tasks while alleviating catastrophic forgetting. Recently, leveraging contrastive loss to construct more transferable and less forgetful representations has…

Machine Learning · Computer Science 2025-09-22 Jia Tang , Xinrui Wang , Songcan Chen

The "pre-training $\rightarrow$ downstream adaptation" presents both new opportunities and challenges for Continual Learning (CL). Although the recent state-of-the-art in CL is achieved through Parameter-Efficient-Tuning (PET) adaptation…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Qiankun Gao , Chen Zhao , Yifan Sun , Teng Xi , Gang Zhang , Bernard Ghanem , Jian Zhang

The right to be forgotten mandates that machine learning models enable the erasure of a data owner's data and information from a trained model. Removing data from the dataset alone is inadequate, as machine learning models can memorize…

Machine Learning · Computer Science 2024-10-16 Xiaoyu Xia , Ziqi Wang , Ruoxi Sun , Bowen Liu , Ibrahim Khalil , Minhui Xue

Although deep neural networks have made remarkable achievements in the field of automatic modulation recognition (AMR), these models often require a large amount of labeled data for training. However, in many practical scenarios, the…

Machine Learning · Computer Science 2025-07-17 Yao Lu , Hongyu Gao , Zhuangzhi Chen , Dongwei Xu , Yun Lin , Qi Xuan , Guan Gui

We focus on contrastive methods for self-supervised video representation learning. A common paradigm in contrastive learning is to construct positive pairs by sampling different data views for the same instance, with different data…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Chen Sun , Arsha Nagrani , Yonglong Tian , Cordelia Schmid