English
Related papers

Related papers: ActMAD: Activation Matching to Align Distributions…

200 papers

This article presents a comprehensive survey of online test-time adaptation (OTTA), focusing on effectively adapting machine learning models to distributionally different target data upon batch arrival. Despite the recent proliferation of…

Artificial Intelligence · Computer Science 2024-07-19 Zixin Wang , Yadan Luo , Liang Zheng , Zhuoxiao Chen , Sen Wang , Zi Huang

Recent advancements in dense out-of-distribution (OOD) detection have primarily focused on scenarios where the training and testing datasets share a similar domain, with the assumption that no domain shift exists between them. However, in…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Zhitong Gao , Shipeng Yan , Xuming He

In the dynamic realms of machine learning and deep learning, the robustness and reliability of models are paramount, especially in critical real-world applications. A fundamental challenge in this sphere is managing Out-of-Distribution…

Machine Learning · Computer Science 2024-03-07 Yingrui Ji , Yao Zhu , Zhigang Li , Jiansheng Chen , Yunlong Kong , Jingbo Chen

Machine learning methods strive to acquire a robust model during the training process that can effectively generalize to test samples, even in the presence of distribution shifts. However, these methods often suffer from performance…

Machine Learning · Computer Science 2024-12-13 Jian Liang , Ran He , Tieniu Tan

Alignment plays a fundamental role in many machine learning problems, such as multi-network analysis, multimodal learning, and point cloud registration. Recent works increasingly leverage optimal transport (OT) for distributional alignment,…

Machine Learning · Computer Science 2026-05-26 Qi Yu , Ruizhong Qiu , Zhichen Zeng , My T. Thai , Huan Liu , Hanghang Tong

When presented with Out-of-Distribution (OOD) examples, deep neural networks yield confident, incorrect predictions. Detecting OOD examples is challenging, and the potential risks are high. In this paper, we propose to detect OOD examples…

Machine Learning · Computer Science 2020-01-10 Chandramouli Shama Sastry , Sageev Oore

Out-of-distribution (OOD) detection is crucial for the safe deployment of neural networks. Existing CLIP-based approaches perform OOD detection by devising novel scoring functions or sophisticated fine-tuning methods. In this work, we…

Computation and Language · Computer Science 2024-11-06 Yixia Li , Boya Xiong , Guanhua Chen , Yun Chen

Multi-Task Learning (MTL) is a framework, where multiple related tasks are learned jointly and benefit from a shared representation space, or parameter transfer. To provide sufficient learning support, modern MTL uses annotated data with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Dimitrios Kollias , Viktoriia Sharmanska , Stefanos Zafeiriou

Multi-task learning (MTL) aims to enhance the performance and efficiency of machine learning models by simultaneously training them on multiple tasks. However, MTL research faces two challenges: 1) effectively modeling the relationships…

Information Retrieval · Computer Science 2023-06-06 Danwei Li , Zhengyu Zhang , Siyang Yuan , Mingze Gao , Weilin Zhang , Chaofei Yang , Xi Liu , Jiyan Yang

Traditional test-time training (TTT) methods, while addressing domain shifts, often assume a consistent class set, limiting their applicability in real-world scenarios characterized by infinite variety. Open-World Test-Time Training (OWTTT)…

Machine Learning · Computer Science 2024-09-17 Houcheng Su , Mengzhu Wang , Jiao Li , Bingli Wang , Daixian Liu , Zeheng Wang

Deep neural networks are known to be vulnerable to unseen data: they may wrongly assign high confidence stcores to out-distribuion samples. Recent works try to solve the problem using representation learning methods and specific metrics. In…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Haowei He , Jiaye Teng , Yang Yuan

Out-of-distribution (OOD) detection targets to detect and reject test samples with semantic shifts, to prevent models trained on in-distribution (ID) dataset from producing unreliable predictions. Existing works only extract the appearance…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Xiang Fang , Arvind Easwaran , Blaise Genest

Since autonomous driving systems usually face dynamic and ever-changing environments, continual test-time adaptation (CTTA) has been proposed as a strategy for transferring deployed models to continually changing target domains. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Jiayi Ni , Senqiao Yang , Ran Xu , Jiaming Liu , Xiaoqi Li , Wenyu Jiao , Zehui Chen , Yi Liu , Shanghang Zhang

Test-Time Adaptation (TTA) has emerged as a promising paradigm for enhancing the generalizability of models. However, existing mainstream TTA methods, predominantly operating at batch level, often exhibit suboptimal performance in complex…

Machine Learning · Computer Science 2024-10-15 Yige Yuan , Bingbing Xu , Teng Xiao , Liang Hou , Fei Sun , Huawei Shen , Xueqi Cheng

Out-of-distribution (OOD) detection aims to detect test samples outside the training category space, which is an essential component in building reliable machine learning systems. Existing reviews on OOD detection primarily focus on method…

Machine Learning · Computer Science 2025-08-05 Shuo Lu , Yingsheng Wang , Lijun Sheng , Lingxiao He , Aihua Zheng , Jian Liang

Information diffusion prediction (IDP) is a pivotal task for understanding how information propagates among users. Most existing methods commonly adhere to a conventional training-test paradigm, where models are pretrained on training data…

Social and Information Networks · Computer Science 2025-07-18 Wenting Zhu , Chaozhuo Li , Qingpo Yang , Xi Zhang , Philip S. Yu

Many neural network-based out-of-distribution (OoD) detection methods have been proposed. However, they require many training data for each target task. We propose a simple yet effective meta-learning method to detect OoD with small…

Machine Learning · Statistics 2022-06-22 Tomoharu Iwata , Atsutoshi Kumagai

Machine learning algorithms typically assume that the training and test samples come from the same distributions, i.e., in-distribution. However, in open-world scenarios, streaming big data can be Out-Of-Distribution (OOD), rendering these…

Machine Learning · Computer Science 2022-11-10 Anique Tahir , Lu Cheng , Ruocheng Guo , Huan Liu

Out-of-distribution detection (OOD) is a crucial technique for deploying machine learning models in the real world to handle the unseen scenarios. In this paper, we first propose a simple yet effective Neural Activation Prior (NAP) for OOD…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Weilin Wan , Weizhong Zhang , Quan Zhou , Fan Yi , Cheng Jin

Test-Time Adaptation (TTA) has recently emerged as a promising approach for tackling the robustness challenge under distribution shifts. However, the lack of consistent settings and systematic studies in prior literature hinders thorough…

Machine Learning · Computer Science 2023-06-07 Hao Zhao , Yuejiang Liu , Alexandre Alahi , Tao Lin