English
Related papers

Related papers: Sparsity Hurts: Simple Linear Adapter Can Boost Ge…

200 papers

Out-of-Distribution (OOD) generalization has become a primary metric for evaluating image analysis systems. Since deep learning models tend to capture domain-specific context, they often develop shortcut dependencies on these non-causal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Haoran Pei , Yuguang Yang , Kexin Liu , Juan Zhang , Baochang Zhang

In this study, we focus on the unsupervised domain adaptation problem where an approximate inference model is to be learned from a labeled data domain and expected to generalize well to an unlabeled data domain. The success of unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Jing Wang , Jiahong Chen , Jianzhe Lin , Leonid Sigal , Clarence W. de Silva

While classifier-free guidance (CFG) is essential for conditional diffusion models, it doubles the number of neural function evaluations (NFEs) per inference step. To mitigate this inefficiency, we introduce adapter guidance distillation…

Machine Learning · Computer Science 2025-03-11 Cristian Perez Jensen , Seyedmorteza Sadat

Diffusion Transformers have demonstrated remarkable performance in video generation. However, their long input sequences incur substantial latency due to the quadratic complexity of full attention. Various sparse attention mechanisms have…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Tongcheng Fang , Hanling Zhang , Ruiqi Xie , Zhuo Han , Xin Tao , Tianchen Zhao , Pengfei Wan , Wenbo Ding , Wanli Ouyang , Xuefei Ning , Yu Wang

Cognitive diagnosis (CD) models latent cognitive states of human learners by analyzing their response patterns on diagnostic tests, serving as a crucial machine learning technique for educational assessment and evaluation. Traditional…

Machine Learning · Computer Science 2025-07-15 Jiatong Li , Qi Liu , Mengxiao Zhu

The rapid development of multimedia has provided a large amount of data with different distributions for visual tasks, forming different domains. Federated Learning (FL) can efficiently use this diverse data distributed on different client…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Shuran Ma , Weiying Xie , Daixun Li , Haowei Li , Yunsong Li

Dynamic graph anomaly detection (DGAD) is critical for many real-world applications but remains challenging due to the scarcity of labeled anomalies. Existing methods are either unsupervised or semi-supervised: unsupervised methods avoid…

Machine Learning · Computer Science 2026-02-24 Yuxing Tian , Yiyan Qi , Fengran Mo , Weixu Zhang , Jian Guo , Jian-Yun Nie

Recently, linear complexity sequence modeling networks have achieved modeling capabilities similar to Vision Transformers on a variety of computer vision tasks, while using fewer FLOPs and less memory. However, their advantage in terms of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Bencheng Liao , Xinggang Wang , Lianghui Zhu , Qian Zhang , Chang Huang

Unsupervised domain adaptation (UDA) aims to enhance the generalization capability of a certain model from a source domain to a target domain. UDA is of particular significance since no extra effort is devoted to annotating target domain…

Computer Vision and Pattern Recognition · Computer Science 2019-12-06 Qiming Zhang , Jing Zhang , Wei Liu , Dacheng Tao

In the big data era, the computer vision field benefits from large-scale datasets such as LAION-2B, LAION-400M, and ImageNet-21K, Kinetics, on which popular models like the ViT and ConvNeXt series have been pre-trained, acquiring…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Qiankun Li , Feng He , Huabao Chen , Xin Ning , Kun Wang , Zengfu Wang

Generalized additive models (GAM) have been successfully applied to high dimensional data analysis. However, most existing methods cannot simultaneously estimate the link function, the component functions and the variable interaction. To…

Machine Learning · Statistics 2024-10-14 Peipei Yuan , Xinge You , Hong Chen , Xuelin Zhang , Qinmu Peng

Transformer-based autoregressive models excel in data generation but are inherently constrained by their reliance on discretized tokens, which limits their ability to represent continuous values with high precision. We analyze the…

Machine Learning · Computer Science 2026-01-12 Yeonsang Shin , Insoo Kim , Bongkeun Kim , Keonwoo Bae , Bohyung Han

Remote Sensing Change Detection (RSCD) typically identifies changes in land cover or surface conditions by analyzing multi-temporal images. Currently, most deep learning-based methods primarily focus on learning unimodal visual information,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Yixiao Liu , Yizhou Yang , Jinwen Li , Jun Tao , Ruoyu Li , Xiangkun Wang , Min Zhu , Junlong Cheng

Cross-domain few-shot learning presents a formidable challenge, as models must be trained on base classes and then tested on novel classes from various domains with only a few samples at hand. While prior approaches have primarily focused…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Yongjin Yang , Taehyeon Kim , Se-Young Yun

Recent advances in deep learning have significantly improved the performance of various computer vision applications. However, discovering novel categories in an incremental learning scenario remains a challenging problem due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Hyungmin Kim , Sungho Suh , Daehwan Kim , Daun Jeong , Hansang Cho , Junmo Kim

The Foundation model for image segmentation, Segment Anything (SAM), has been actively researched in various fields since its proposal. Various researches have been proposed to adapt SAM to specific domains, with one notable approach…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Joohyeok Kim , Joonhyeon Song , Seohwan Yun , Seongho Yoon , Sangmin Lee

Augmentation by generative modelling yields a promising alternative to the accumulation of surgical data, where ethical, organisational and regulatory aspects must be considered. Yet, the joint synthesis of (image, mask) pairs for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Yannik Frisch , Christina Bornberg , Moritz Fuchs , Anirban Mukhopadhyay

Handling distribution shifts from training data, known as out-of-distribution (OOD) generalization, poses a significant challenge in the field of machine learning. While a pre-trained vision-language model like CLIP has demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Bac Nguyen , Stefan Uhlich , Fabien Cardinaux , Lukas Mauch , Marzieh Edraki , Aaron Courville

Data imbalance and open-ended distribution are two intrinsic characteristics of the real visual world. Though encouraging progress has been made in tackling each challenge separately, few works dedicated to combining them towards real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Jianhong Bai , Zuozhu Liu , Hualiang Wang , Ruizhe Chen , Lianrui Mu , Xiaomeng Li , Joey Tianyi Zhou , Yang Feng , Jian Wu , Haoji Hu

This paper is concerned with a guessing codeword decoding (GCD) of linear block codes. Compared with the guessing noise decoding (GND), which is only efficient for high-rate codes, the GCD is efficient for not only high-rate codes but also…

Information Theory · Computer Science 2024-05-07 Xiangping Zheng , Xiao Ma