English
Related papers

Related papers: Knowledge-Based Regularization in Generative Model…

200 papers

Given a causal graph representing the data-generating process shared across different domains/distributions, enforcing sufficient graph-implied conditional independencies can identify domain-general (non-spurious) feature representations.…

Machine Learning · Computer Science 2024-04-26 Olawale Salaudeen , Sanmi Koyejo

Hybrid learning methods use theoretical knowledge of a domain and a set of classified examples to develop a method for classification. Methods that use domain knowledge have been shown to perform better than inductive learners. However,…

Machine Learning · Computer Science 2011-01-26 Ridwan Al Iqbal

We propose a probabilistic framework for domain adaptation that blends both generative and discriminative modeling in a principled way. Under this framework, generative and discriminative models correspond to specific choices of the prior…

Machine Learning · Computer Science 2017-10-31 Han Zhao , Zhenyao Zhu , Junjie Hu , Adam Coates , Geoff Gordon

Quantizing images into discrete representations has been a fundamental problem in unified generative modeling. Predominant approaches learn the discrete representation either in a deterministic manner by selecting the best-matching token or…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Jiahui Zhang , Fangneng Zhan , Christian Theobalt , Shijian Lu

Continual learning of deep neural networks is a key requirement for scaling them up to more complex applicative scenarios and for achieving real lifelong learning of these architectures. Previous approaches to the problem have considered…

Machine Learning · Computer Science 2020-06-25 Jary Pomponi , Simone Scardapane , Vincenzo Lomonaco , Aurelio Uncini

Most complex machine learning and modelling techniques are prone to over-fitting and may subsequently generalise poorly to future data. Artificial neural networks are no different in this regard and, despite having a level of implicit…

Machine Learning · Statistics 2022-05-26 Vincent Szolnoky , Viktor Andersson , Balazs Kulcsar , Rebecka Jörnsten

Domain generalization aims at training machine learning models to perform robustly across different and unseen domains. Several recent methods use multiple datasets to train models to extract domain-invariant features, hoping to generalize…

Machine Learning · Computer Science 2021-05-19 Mattia Segu , Alessio Tonioni , Federico Tombari

In the last years, the design of image reconstruction methods in the field of quantitative Magnetic Resonance Imaging (qMRI) has experienced a paradigm shift. Often, when dealing with (quantitative) MR image reconstruction problems, one is…

Optimization and Control · Mathematics 2024-03-01 Andreas Kofler , Felix Frederik Zimmermann , Kostas Papafitsoros

Training deep neural networks is known to require a large number of training samples. However, in many applications only few training samples are available. In this work, we tackle the issue of training neural networks for classification…

Machine Learning · Computer Science 2017-12-25 Soufiane Belharbi , Clément Chatelain , Romain Hérault , Sébastien Adam

We address the task of domain generalization, where the goal is to train a predictive model such that it is able to generalize to a new, previously unseen domain. We choose a hierarchical generative approach within the framework of…

Machine Learning · Computer Science 2021-05-18 Xudong Sun , Florian Buettner

Human adaptability relies crucially on the ability to learn and merge knowledge both from supervised and unsupervised learning: the parents point out few important concepts, but then the children fill in the gaps on their own. This is…

Computer Vision and Pattern Recognition · Computer Science 2019-08-09 Fabio Maria Carlucci , Antonio D'Innocente , Silvia Bucci , Barbara Caputo , Tatiana Tommasi

This work studies deep metric learning under small to medium scale data as we believe that better generalization could be a contributing factor to the improvement of previous fine-grained image retrieval methods; it should be considered…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 Nam Vo , James Hays

We seek to learn a representation on a large annotated data source that generalizes to a target domain using limited new supervision. Many prior approaches to this problem have focused on learning "disentangled" representations so that as…

Machine Learning · Computer Science 2020-02-28 Or Litany , Ari Morcos , Srinath Sridhar , Leonidas Guibas , Judy Hoffman

Generalization in generative modeling is defined as the ability to learn an underlying distribution from a finite dataset and produce novel samples, with evaluation largely driven by held-out performance and perceived sample quality. In…

Machine Learning · Computer Science 2026-03-05 Jerome Garnier-Brun , Luca Biggio , Davide Beltrame , Marc Mézard , Luca Saglietti

In this chapter we provide a theoretically founded investigation of state-of-the-art learning approaches for inverse problems from the point of view of spectral reconstruction operators. We give an extended definition of regularization…

Numerical Analysis · Mathematics 2024-06-05 Martin Burger , Samira Kabri

One-class recognition is traditionally approached either as a representation learning problem or a feature modeling problem. In this work, we argue that both of these approaches have their own limitations; and a more effective solution can…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Pramuditha Perera , Vishal Patel

How to extract more and useful information for single image super resolution is an imperative and difficult problem. Learning-based method is a representative method for such task. However, the results are not so stable as there may exist…

Image and Video Processing · Electrical Eng. & Systems 2020-03-25 Hu Liang , Shengrong Zhao

Generative models have recently been explored for synthesizing neural network weights. These approaches take neural network checkpoints as training data and aim to generate high-performing weights during inference. In this work, we examine…

Machine Learning · Computer Science 2025-10-06 Boya Zeng , Yida Yin , Zhiqiu Xu , Zhuang Liu

Existing federated learning models that follow the standard risk minimization paradigm of machine learning often fail to generalize in the presence of spurious correlations in the training data. In many real-world distributed settings,…

Machine Learning · Computer Science 2023-05-31 Praveen Venkateswaran , Vatche Isahagian , Vinod Muthusamy , Nalini Venkatasubramanian

The well known domain shift issue causes model performance to degrade when deployed to a new target domain with different statistics to training. Domain adaptation techniques alleviate this, but need some instances from the target domain to…

Machine Learning · Computer Science 2019-06-11 Yiying Li , Yongxin Yang , Wei Zhou , Timothy M. Hospedales