English
Related papers

Related papers: One Pool Is Not Enough: Multi-Cluster Memory for P…

200 papers

Multi-source Domain Adaptation (MDA) seeks to adapt models trained on data from multiple labeled source domains to perform effectively on an unlabeled target domain data, assuming access to sources data. To address the challenges of model…

Machine Learning · Computer Science 2024-08-20 Omar Ghannou , Younès Bennani

Markov chain Monte Carlo (MCMC) methods are often used in clustering since they guarantee asymptotically exact expectations in the infinite-time limit. In finite time, though, slow mixing often leads to poor performance. Modern computing…

Methodology · Statistics 2022-02-24 Tin D. Nguyen , Brian L. Trippe , Tamara Broderick

Organisms constantly pivot between tasks such as evading predators, foraging, traversing rugged terrain, and socializing, often within milliseconds. Remarkably, they preserve knowledge of once-learned environments sans catastrophic…

Machine Learning · Computer Science 2025-12-02 Susmit Agrawal , Krishn Vishwas Kher , Saksham Mittal , Swarnim Maheshwari , Vineeth N. Balasubramanian

Associative memory has long underpinned the design of sequential models. Beyond recall, humans reason by projecting future states and selecting goal-directed actions, a capability that modern language models increasingly require but do not…

Machine Learning · Computer Science 2026-03-11 Peihao Wang , Shan Yang , Xijun Wang , Tesi Xiao , Xin Liu , Changlong Yu , Yu Lou , Pan Li , Zhangyang Wang , Ming Lin , René Vidal

Test-Time Compute (TTC) has emerged as a powerful paradigm for enhancing the performance of Large Language Models (LLMs) at inference, leveraging strategies such as Test-Time Training (TTT) and Retrieval-Augmented Generation (RAG). However,…

Computation and Language · Computer Science 2025-08-15 J. Pablo Muñoz , Jinjie Yuan

In real-world scenarios, tabular data often suffer from distribution shifts that threaten the performance of machine learning models. Despite its prevalence and importance, handling distribution shifts in the tabular domain remains…

Machine Learning · Computer Science 2025-02-13 Changhun Kim , Taewon Kim , Seungyeon Woo , June Yong Yang , Eunho Yang

Vision-language models (VLMs) exhibit remarkable zero-shot generalization but suffer performance degradation under distribution shifts in downstream tasks, particularly in the absence of labeled data. Test-Time Adaptation (TTA) addresses…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Khanh-Binh Nguyen , Phuoc-Nguyen Bui , Hyunseung Choo , Duc Thanh Nguyen

Parameter-efficient tuning (PET) methods such as LoRA, Adapter, and Visual Prompt Tuning (VPT) have found success in enabling adaptation to new domains by tuning small modules within a transformer model. However, the number of domains…

Clustering is widely used in unsupervised learning to find homogeneous groups of observations within a dataset. However, clustering mixed-type data remains a challenge, as few existing approaches are suited for this task. This study…

Machine Learning · Statistics 2025-11-26 Badih Ghattas , Alvaro Sanchez San-Benito

Test-time adaptation (TTA) aims to adapt models to maintain reliable performance on non-stationary test streams without requiring labeled data. Despite its empirical success, the learnability of TTA under non-stationary streams remains…

Machine Learning · Computer Science 2026-05-28 Zhi Zhou , Ming Yang , Shi-Yu Tian , Kun-Yang Yu , Lan-Zhe Guo , Yu-Feng Li

One of the fundamental problems of using optimization models that use different time series as data input, is the trade-off between model accuracy and computational tractability. To overcome the computational intractability of these full…

Optimization and Control · Mathematics 2022-06-08 Sonja Wogrin

Channel attention mechanisms endeavor to recalibrate channel weights to enhance representation abilities of networks. However, mainstream methods often rely solely on global average pooling as the feature squeezer, which significantly…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Yangbo Jiang , Zhiwei Jiang , Le Han , Zenan Huang , Nenggan Zheng

In the field of multi-task reinforcement learning, the modular principle, which involves specializing functionalities into different modules and combining them appropriately, has been widely adopted as a promising approach to prevent the…

Machine Learning · Computer Science 2023-11-03 Siming Lan , Rui Zhang , Qi Yi , Jiaming Guo , Shaohui Peng , Yunkai Gao , Fan Wu , Ruizhi Chen , Zidong Du , Xing Hu , Xishan Zhang , Ling Li , Yunji Chen

Recent continual test-time adaptation (CTTA) methods adopt masked image modeling to stabilize learning under distribution shift, yet each treats its masking family $F$ as a fixed design choice and innovates exclusively along the selection…

Post-training quantization (PTQ) reduces excessive hardware cost by quantizing full-precision models into lower bit representations on a tiny calibration set, without retraining. Despite the remarkable progress made through recent efforts,…

Machine Learning · Computer Science 2024-12-16 Junrui Xiao , Zhikai Li , Lianwei Yang , Yiduo Mei , Qingyi Gu

Large Language Models (LLMs) need to adapt to the continuous changes in data, tasks, and user preferences. Due to their massive size and the high costs associated with training, LLMs are not suitable for frequent retraining. However,…

Computation and Language · Computer Science 2024-12-11 Dongfang Li , Zetian Sun , Xinshuo Hu , Baotian Hu , Min Zhang

Test-Time Adaptation (TTA) adjusts models using unlabeled test data to handle dynamic distribution shifts. However, existing methods rely on frequent adaptation and high computational cost, making them unsuitable for resource-constrained…

Machine Learning · Computer Science 2025-11-20 Hyeongheon Cha , Dong Min Kim , Hye Won Chung , Taesik Gong , Sung-Ju Lee

Continual Test-Time Adaptation (CTTA) aims to adapt a pre-trained model to a sequence of target domains during the test phase without accessing the source data. To adapt to unlabeled data from unknown domains, existing methods rely on…

Machine Learning · Computer Science 2024-07-15 Jiayao Tan , Fan Lyu , Chenggong Ni , Tingliang Feng , Fuyuan Hu , Zhang Zhang , Shaochuang Zhao , Liang Wang

Time series aggregation (TSA) aims to construct temporally aggregated optimization models that accurately represent the output space of their full-scale counterparts while using a significantly reduced temporal dimensionality. This paper…

Optimization and Control · Mathematics 2026-03-16 Thomas Klatzer , David Cardona-Vasquez , Luca Santosuosso , Sonja Wogrin

The demand for efficient machine learning (ML) accelerators is growing rapidly, driving the development of novel computing concepts such as resistive random access memory (RRAM)-based tiled computing-in-memory (CIM) architectures. CIM…

Hardware Architecture · Computer Science 2024-01-18 Rebecca Pelke , Jose Cubero-Cascante , Nils Bosbach , Felix Staudigl , Rainer Leupers , Jan Moritz Joseph