English
Related papers

Related papers: Parameterizing Dataset Distillation via Gaussian S…

200 papers

Medical image enhancement is clinically valuable, but existing methods require large-scale datasets to learn complex pixel-level mappings. However, the substantial training and storage costs associated with these datasets hinder their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Fengzhi Xu , Ziyuan Yang , Mengyu Sun , Joey Tianyi Zhou , Yi Zhang

Dataset Distillation (DD) seeks to create a compact dataset from a large, real-world dataset. While recent methods often rely on heuristic approaches to balance efficiency and quality, the fundamental relationship between original and…

Machine Learning · Computer Science 2026-01-30 Shaobo Wang , Yantai Yang , Guo Chen , Peiru Li , Kaixin Li , Yufa Zhou , Zhaorun Chen , Linfeng Zhang

Implicit neural representations (INRs) have achieved remarkable success in image representation and compression, but they require substantial training time and memory. Meanwhile, recent 2D Gaussian Splatting (GS) methods (\textit{e.g.},…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Tiantian Li , Xinjie Zhang , Xingtong Ge , Tongda Xu , Dailan He , Jun Zhang , Yan Wang

Herein, we propose a novel dataset distillation method for constructing small informative datasets that preserve the information of the large original datasets. The development of deep learning models is enabled by the availability of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Guang Li , Ren Togo , Takahiro Ogawa , Miki Haseyama

The emergence of 3D Gaussian Splatting (3D-GS) has significantly advanced 3D reconstruction by providing high fidelity and fast training speeds across various scenarios. While recent efforts have mainly focused on improving model structures…

Graphics · Computer Science 2025-03-07 Yifei Gao , Jun Huang , Lei Wang , Ruiting Dai , Jun Cheng

Driven by the ``scale-is-everything'' paradigm, modern machine learning increasingly demands ever-larger datasets and models, yielding prohibitive computational and storage requirements. Dataset distillation mitigates this by compressing an…

Machine Learning · Computer Science 2025-07-24 Youneng Bao , Yiping Liu , Zhuo Chen , Yongsheng Liang , Mu Li , Kede Ma

Dataset distillation (DD) aims to compress large-scale datasets into compact synthetic sets while preserving training efficacy. However, existing studies mainly focus on image classification, leaving dense prediction tasks such as semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Wenjie Zheng , Haoji Hu , Jiali Lu , Xingze Zou , Jing Wang

3D Gaussian Splatting (3DGS) has emerged as a mainstream solution for novel view synthesis and 3D reconstruction. By explicitly encoding a 3D scene using a collection of Gaussian kernels, 3DGS achieves high-quality rendering with superior…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Lei Lan , Tianjia Shao , Zixuan Lu , Yu Zhang , Chenfanfu Jiang , Yin Yang

Differentiable rendering techniques have recently shown promising results for free-viewpoint video synthesis of characters. However, such methods, either Gaussian Splatting or neural implicit rendering, typically necessitate per-subject…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Boyao Zhou , Shunyuan Zheng , Hanzhang Tu , Ruizhi Shao , Boning Liu , Shengping Zhang , Liqiang Nie , Yebin Liu

Advances in self-distillation have shown that when knowledge is distilled from a teacher to a student using the same deep learning (DL) architecture, the student performance can surpass the teacher particularly when the network is…

Machine Learning · Computer Science 2025-06-25 Muhammad Haseeb Aslam , Clara Martinez , Marco Pedersoli , Alessandro Koerich , Ali Etemad , Eric Granger

Data-efficient learning has garnered significant attention, especially given the current trend of large multi-modal models. Recently, dataset distillation has become an effective approach by synthesizing data samples that are essential for…

Machine Learning · Computer Science 2024-08-08 Yue Xu , Yong-Lu Li , Kaitong Cui , Ziyu Wang , Cewu Lu , Yu-Wing Tai , Chi-Keung Tang

Dataset distillation synthesizes a small dataset such that a model trained on this set approximates the performance of the original dataset. Recent studies on dataset distillation focused primarily on the design of the optimization process,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Shiguang Wang , Zhongyu Zhang , Jian Cheng

Recently, high-fidelity scene reconstruction with an optimized 3D Gaussian splat representation has been introduced for novel view synthesis from sparse image sets. Making such representations suitable for applications like network…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Simon Niedermayr , Josef Stumpfegger , Rüdiger Westermann

Recently, 3D Gaussian Splatting (3DGS) has demonstrated remarkable success in 3D reconstruction and novel view synthesis. However, reconstructing 3D scenes from sparse viewpoints remains highly challenging due to insufficient visual…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Zhaorui Wang , Yi Gu , Deming Zhou , Renjing Xu

Dataset distillation (DD) generates small synthetic datasets that can efficiently train deep networks with a limited amount of memory and compute. Despite the success of DD methods for supervised learning, DD for self-supervised…

Machine Learning · Computer Science 2025-04-02 Siddharth Joshi , Jiayi Ni , Baharan Mirzasoleiman

Techniques such as ensembling and distillation promise model quality improvements when paired with almost any base model. However, due to increased test-time cost (for ensembles) and increased complexity of the training pipeline (for…

Machine Learning · Computer Science 2020-08-24 Rohan Anil , Gabriel Pereyra , Alexandre Passos , Robert Ormandi , George E. Dahl , Geoffrey E. Hinton

Recent developments in 3D reconstruction and neural rendering have significantly propelled the capabilities of photo-realistic 3D scene rendering across various academic and industrial fields. The 3D Gaussian Splatting technique, alongside…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zexu Huang , Min Xu , Stuart Perry

3D Gaussian Splatting (3DGS) has emerged as a powerful technique for novel view synthesis, demonstrating remarkable capability in high-fidelity scene reconstruction through its Gaussian primitive representations. However, the computational…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Chengbo Wang , Guozheng Ma , Yifei Xue , Yizhen Lao

3D Gaussian Splatting (GS) has emerged as a powerful representation for high-quality scene reconstruction, offering compelling rendering quality. However, the training process of GS often suffers from slow convergence due to inefficient…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Binxiao Huang , Zhengwu Liu , Ngai Wong

We introduce Posterior Distillation Sampling (PDS), a novel optimization method for parametric image editing based on diffusion models. Existing optimization-based methods, which leverage the powerful 2D prior of diffusion models to handle…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Juil Koo , Chanho Park , Minhyuk Sung