English
Related papers

Related papers: Spectral Gradient Surgery for Domain-Generalizable…

200 papers

Score distillation sampling (SDS) and its variants have greatly boosted the development of text-to-3D generation, but are vulnerable to geometry collapse and poor textures yet. To solve this issue, we first deeply analyze the SDS and find…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Zike Wu , Pan Zhou , Xuanyu Yi , Xiaoding Yuan , Hanwang Zhang

Deep neural networks (DNN) have demonstrated unprecedented success for medical imaging applications. However, due to the issue of limited dataset availability and the strict legal and ethical requirements for patient privacy protection, the…

Machine Learning · Computer Science 2023-09-19 Chris Xing Tian , Haoliang Li , Yufei Wang , Shiqi Wang

Deep learning has grown tremendously over recent years, yielding state-of-the-art results in various fields. However, training such models requires huge amounts of data, increasing the computational time and cost. To address this, dataset…

Machine Learning · Computer Science 2023-07-18 Murad Tukan , Alaa Maalouf , Margarita Osadchy

Single-cell RNA sequencing (scRNA-seq) technology has profiled hundreds of millions of human cells across organs, diseases, development and perturbations to date. However, the high-dimensional sparsity, batch effect noise, category…

Machine Learning · Computer Science 2025-03-07 Zhen Yu , Jianan Han , Yang Liu , Qingchao Chen

Domain Generalization (DG), designed to enhance out-of-distribution (OOD) generalization, is all about learning invariance against domain shifts utilizing sufficient supervision signals. Yet, the scarcity of such labeled data has led to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 An Zhang , Han Wang , Xiang Wang , Tat-Seng Chua

To alleviate the reliance of deep neural networks on large-scale datasets, dataset distillation aims to generate compact, high-quality synthetic datasets that can achieve comparable performance to the original dataset. The integration of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Mingzhuo Li , Guang Li , Jiafeng Mao , Linfeng Ye , Takahiro Ogawa , Miki Haseyama

Despite the success of Deep Learning (DL), the deployment of modern DL models requiring large computational power poses a significant problem for resource-constrained systems. This necessitates building compact networks that reduce…

Machine Learning · Computer Science 2020-06-24 Akshay Kulkarni , Navid Panchi , Sharath Chandra Raparthy , Shital Chiddarwar

Domain generalization (DG) aims to generalize a model trained on multiple source (i.e., training) domains to a distributionally different target (i.e., test) domain. In contrast to the conventional DG that strictly requires the availability…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Zijian Wang , Yadan Luo , Ruihong Qiu , Zi Huang , Mahsa Baktashmotlagh

Generalization to previously unseen images with potential domain shifts and different styles is essential for clinically applicable medical image segmentation, and the ability to disentangle domain-specific and domain-invariant features is…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Ran Gu , Guotai Wang , Jiangshan Lu , Jingyang Zhang , Wenhui Lei , Yinan Chen , Wenjun Liao , Shichuan Zhang , Kang Li , Dimitris N. Metaxas , Shaoting Zhang

Generalized Category Discovery (GCD) aims to leverage labeled samples from known categories to cluster unlabeled data that may include both known and unknown categories. While existing methods have achieved impressive results under standard…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Wei Feng , Zongyuan Ge

Skin cancer is one of the most common types of malignancy, affecting a large population and causing a heavy economic burden worldwide. Over the last few years, computer-aided diagnosis has been rapidly developed and make great progress in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Yongwei Wang , Yuheng Wang , Tim K. Lee , Chunyan Miao , Z. Jane Wang

The high cost and accessibility problem associated with large datasets hinder the development of large-scale visual recognition systems. Dataset Distillation addresses these problems by synthesizing compact surrogate datasets for efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Tongfei Liu , Yufan Liu , Bing Li , Weiming Hu

With the rapid scaling of neural networks, data storage and communication demands have intensified. Dataset distillation has emerged as a promising solution, condensing information from extensive datasets into a compact set of synthetic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Ali Abbasi , Shima Imani , Chenyang An , Gayathri Mahalingam , Harsh Shrivastava , Maurice Diesendruck , Hamed Pirsiavash , Pramod Sharma , Soheil Kolouri

Time Series forecasting (TSF) in the modern era faces significant computational and storage cost challenges due to the massive scale of real-world data. Dataset Distillation (DD), a paradigm that synthesizes a small, compact dataset to…

Machine Learning · Computer Science 2026-03-05 Seungha Hong , Sanghwan Jang , Wonbin Kweon , Suyeon Kim , Gyuseok Lee , Hwanjo Yu

Large-scale datasets are usually required to train deep neural networks, but it increases the computational complexity hindering the practical applications. Recently, dataset distillation for images and texts has been attracting a lot of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Jae-Young Yim , Dongwook Kim , Jae-Young Sim

Despite plentiful successes achieved by graph representation learning in various domains, the training of graph neural networks (GNNs) still remains tenaciously challenging due to the tremendous computational overhead needed for sizable…

Machine Learning · Computer Science 2025-05-28 Yurui Lai , Taiyan Zhang , Renchi Yang

Data-free knowledge distillation (DFKD) has emerged as a pivotal technique in the domain of model compression, substantially reducing the dependency on the original training data. Nonetheless, conventional DFKD methods that employ…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Muquan Li , Dongyang Zhang , Tao He , Xiurui Xie , Yuan-Fang Li , Ke Qin

Deep neural networks (DNNs) have achieved significant success in numerous applications. The remarkable performance of DNNs is largely attributed to the availability of massive, high-quality training datasets. However, processing such…

Sound · Computer Science 2024-07-23 Wenbo Jiang , Rui Zhang , Hongwei Li , Xiaoyuan Liu , Haomiao Yang , Shui Yu

Recent years have witnessed the remarkable success of deep learning in remote sensing image interpretation, driven by the availability of large-scale benchmark datasets. However, this reliance on massive training data also brings two major…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Yonghao Xu , Pedram Ghamisi , Qihao Weng

Most deep metric learning (DML) methods employ a strategy that forces all positive samples to be close in the embedding space while keeping them away from negative ones. However, such a strategy ignores the internal relationships of…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Zelong Zeng , Fan Yang , Zheng Wang , Shin'ichi Satoh