English
Related papers

Related papers: Breaking Inter-Layer Co-Adaptation by Classifier A…

200 papers

Despite large neural networks demonstrating remarkable abilities to complete different tasks, they require excessive memory usage to store the optimization states for training. To alleviate this, the low-rank adaptation (LoRA) is proposed…

Machine Learning · Computer Science 2024-06-14 Yongchang Hao , Yanshuai Cao , Lili Mou

This paper investigates domain generalization: How to take knowledge acquired from an arbitrary number of related domains and apply it to previously unseen domains? We propose Domain-Invariant Component Analysis (DICA), a kernel-based…

Machine Learning · Statistics 2013-01-11 Krikamol Muandet , David Balduzzi , Bernhard Schölkopf

Low-Rank Adaptation (LoRA) has become a widely used mechanism for customizing diffusion models, enabling users to inject new visual concepts or styles through lightweight parameter updates. However, LoRAs can memorize training images,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yu Zhe , Yang Jiayan , Wei Junhao , Yu-Lin Tsai , Wang Chen

For a long time, anomaly localization has been widely used in industries. Previous studies focused on approximating the distribution of normal features without adaptation to a target dataset. However, since anomaly localization should…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Sungwook Lee , Seunghyun Lee , Byung Cheol Song

One-class classification (OCC), i.e., identifying whether an example belongs to the same distribution as the training data, is essential for deploying machine learning models in the real world. Adapting the pre-trained features on the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Zilong Zhang , Zhibin Zhao , Deyu Meng , Xingwu Zhang , Xuefeng Chen

Universal domain adaptation (UniDA) is a general unsupervised domain adaptation setting, which addresses both domain and label shifts in adaptation. Its main challenge lies in how to identify target samples in unshared or unknown classes.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Yunyun Wang , Yao Liu , Songcan Chen

Many unsupervised domain adaptation (UDA) methods exploit domain adversarial training to align the features to reduce domain gap, where a feature extractor is trained to fool a domain discriminator in order to have aligned feature…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Xin Jin , Cuiling Lan , Wenjun Zeng , Zhibo Chen

Previous feature alignment methods in Unsupervised domain adaptation(UDA) mostly only align global features without considering the mismatch between class-wise features. In this work, we propose a new coarse-to-fine feature alignment method…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Shiyu Tang , Peijun Tang , Yanxiang Gong , Zheng Ma , Mei Xie

Federated Learning (FL) enables collaborative model training across distributed clients without sharing raw data, making it ideal for privacy-sensitive applications. However, FL models often suffer performance degradation due to…

Deep learning classifiers achieve state-of-the-art performance in various risk detection applications. They explore rich semantic representations and are supposed to automatically discover risk behaviors. However, due to the lack of…

Cryptography and Security · Computer Science 2025-05-15 Yiling He , Jian Lou , Zhan Qin , Kui Ren

It is well-known that a deep neural network has a strong fitting capability and can easily achieve a low training error even with randomly assigned class labels. When the number of training samples is small, or the class labels are noisy,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Avraham Chapman , Lingqiao Liu

The population-based optimization algorithms have provided promising results in feature selection problems. However, the main challenges are high time complexity. Moreover, the interaction between features is another big challenge in FS…

Neural and Evolutionary Computing · Computer Science 2021-10-26 Motahare Namakin , Modjtaba Rouhani , Mostafa Sabzekar

We consider the problem of distributed feature quantization, where the goal is to enable a pretrained classifier at a central node to carry out its classification on features that are gathered from distributed nodes through communication…

Machine Learning · Computer Science 2019-11-04 Osama A. Hanna , Yahya H. Ezzeldin , Tara Sadjadpour , Christina Fragouli , Suhas Diggavi

Existing domain adaptation methods aim at learning features that can be generalized among domains. These methods commonly require to update source classifier to adapt to the target domain and do not properly handle the trade off between the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-02 Shaokai Ye , Kailu Wu , Mu Zhou , Yunfei Yang , Sia huat Tan , Kaidi Xu , Jiebo Song , Chenglong Bao , Kaisheng Ma

In this paper, we investigate the problem of classifying feature vectors with mutually independent but non-identically distributed elements. First, we show the importance of this problem. Next, we propose a classifier and derive an…

Machine Learning · Computer Science 2021-09-01 Farzad Shahrivari , Nikola Zlatanov

Low-rank adaptation (LoRA) is one of the most popular task-specific parameter-efficient fine-tuning (PEFT) methods on pre-trained language models for its good performance and computational efficiency. LoRA injects a product of two trainable…

Machine Learning · Computer Science 2024-03-20 Youbang Sun , Zitao Li , Yaliang Li , Bolin Ding

Recent unsupervised approaches to domain adaptation primarily focus on minimizing the gap between the source and the target domains through refining the feature generator, in order to learn a better alignment between the two domains. This…

Machine Learning · Computer Science 2020-10-08 Shuyang Dai , Yu Cheng , Yizhe Zhang , Zhe Gan , Jingjing Liu , Lawrence Carin

Colocalization analysis aims to study complex spatial associations between bio-molecules via optical imaging techniques. However, existing colocalization analysis workflows only assess an average degree of colocalization within a certain…

This work introduces two strategies for training network classifiers with heterogeneous agents. One strategy promotes global smoothing over the graph and a second strategy promotes local smoothing over neighbourhoods. It is assumed that the…

Artificial Intelligence · Computer Science 2019-11-13 Elsa Rizk , Roula Nassif , Ali H. Sayed

Despite the rapid development and great success of machine learning models, extensive studies have exposed their disadvantage of inheriting latent discrimination and societal bias from the training data. This phenomenon hinders their…

Machine Learning · Computer Science 2021-12-30 Tianxiang Zhao , Enyan Dai , Kai Shu , Suhang Wang