English
Related papers

Related papers: Proxy Synthesis: Learning with Synthetic Classes f…

200 papers

Synthetic data generation is increasingly used in machine learning for training and data augmentation. Yet, current strategies often rely on external foundation models or datasets, whose usage is restricted in many scenarios due to policy…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Parsa Rahimi , Sebastien Marcel

Synthetic training data has gained prominence in numerous learning tasks and scenarios, offering advantages such as dataset augmentation, generalization evaluation, and privacy preservation. Despite these benefits, the efficiency of…

Machine Learning · Computer Science 2024-03-21 Jianhao Yuan , Jie Zhang , Shuyang Sun , Philip Torr , Bo Zhao

This article introduces the concept of optimization learning, a methodology to design optimization proxies that learn the input/output mapping of parametric optimization problems. These optimization proxies are trustworthy by design: they…

Optimization and Control · Mathematics 2025-01-08 Pascal Van Hentenryck

Deep learning models have become increasingly useful in many different industries. On the domain of image classification, convolutional neural networks proved the ability to learn robust features for the closed set problem, as shown in many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Rafael S. Pereira , Alexis Joly , Patrick Valduriez , Fabio Porto

Knowledge Distillation (KD) refers to transferring knowledge from a large model to a smaller one, which is widely used to enhance model performance in machine learning. It tries to align embedding spaces generated from the teacher and the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Weidong Shi , Guanghui Ren , Yunpeng Chen , Shuicheng Yan

Training a semantic segmentation model requires a large amount of pixel-level annotation, hampering its application at scale. With computer graphics, we can generate almost unlimited training data with precise annotation. However,a deep…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Tong Shen , Dong Gong , Wei Zhang , Chunhua Shen , Tao Mei

Learning methods using synthetic data have attracted attention as an effective approach for increasing the diversity of training data while reducing collection costs, thereby improving the robustness of model discrimination. However, many…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Koshiro Nagano , Ryo Fujii , Ryo Hachiuma , Fumiaki Sato , Taiki Sekii , Hideo Saito

Computational cost of training state-of-the-art deep models in many learning problems is rapidly increasing due to more sophisticated models and larger datasets. A recent promising direction for reducing training cost is dataset…

Machine Learning · Computer Science 2022-12-23 Bo Zhao , Hakan Bilen

Most classification models treat all misclassifications equally. However, different classes may be related, and these hierarchical relationships must be considered in some classification problems. These problems can be addressed by using…

Machine Learning · Computer Science 2023-01-27 Hyeongji Kim , Pekka Parviainen , Terje Berge , Ketil Malde

Semantic image synthesis (SIS) aims to generate realistic images that match given semantic masks. Despite recent advances allowing high-quality results and precise spatial control, they require a massive semantic segmentation dataset for…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Jungwoo Chae , Hyunin Cho , Sooyeon Go , Kyungmook Choi , Youngjung Uh

Recently, it has been widely known that deep neural networks are highly vulnerable and easily broken by adversarial attacks. To mitigate the adversarial vulnerability, many defense algorithms have been proposed. Recently, to improve…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Hong Joo Lee , Yong Man Ro

During the training of networks for distance metric learning, minimizers of the typical loss functions can be considered as "feasible points" satisfying a set of constraints imposed by the training data. To this end, we reformulate distance…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Oğul Can , Yeti Ziya Gürbüz , A. Aydın Alatan

Deep learning algorithms require extensive data to achieve robust performance. However, data availability is often restricted in the medical domain due to patient privacy concerns. Synthetic data presents a possible solution to these…

This paper addresses the challenge of overfitting in the learning of dynamical systems by introducing a novel approach for the generation of synthetic data, aimed at enhancing model generalization and robustness in scenarios characterized…

Machine Learning · Computer Science 2024-03-11 Dario Piga , Matteo Rufolo , Gabriele Maroni , Manas Mejari , Marco Forgione

As synthetic imagery is used more frequently in training deep models, it is important to understand how different synthesis techniques impact the performance of such models. In this work, we perform a thorough evaluation of the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Kristofer Schlachter , Connor DeFanti , Sebastian Herscher , Ken Perlin , Jonathan Tompson

Many industrial applications use Metric Learning as a way to circumvent scalability issues when designing systems with a high number of classes. Because of this, this field of research is attracting a lot of interest from the academic and…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Carlos Roig , David Varas , Issey Masuda , Juan Carlos Riveiro , Elisenda Bou-Balust

Objective functions that optimize deep neural networks play a vital role in creating an enhanced feature representation of the input data. Although cross-entropy-based loss formulations have been extensively used in a variety of supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Deen Dayal Mohan , Bhavin Jawade , Srirangaraj Setlur , Venu Govindaraj

We present a technique for synthesizing a motion blurred image from a pair of unblurred images captured in succession. To build this system we motivate and design a differentiable "line prediction" layer to be used as part of a neural…

Computer Vision and Pattern Recognition · Computer Science 2019-06-21 Tim Brooks , Jonathan T. Barron

Prompt learning is a powerful technique for transferring Vision-Language Models (VLMs) such as CLIP to downstream tasks. However, the prompt-based methods that are fine-tuned solely with base classes may struggle to generalize to novel…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Mushui Liu , Weijie He , Ziqian Lu , Yunlong Yu

Learning the distance metric between pairs of samples has been studied for image retrieval and clustering. With the remarkable success of pair-based metric learning losses, recent works have proposed the use of generated synthetic points on…

Computer Vision and Pattern Recognition · Computer Science 2020-04-24 Byungsoo Ko , Geonmo Gu