English
Related papers

Related papers: A method for quantifying the generalization capabi…

200 papers

In this work, we consider one-shot imitation learning for object rearrangement tasks, where an AI agent needs to watch a single expert demonstration and learn to perform the same task in different environments. To achieve a strong…

Machine Learning · Computer Science 2022-11-29 Aviv Netanyahu , Tianmin Shu , Joshua Tenenbaum , Pulkit Agrawal

General circulation models (GCMs) typically have a grid size of 25--200 km. Parametrizations are used to represent diabatic processes such as radiative transfer and cloud microphysics and account for sub-grid-scale motions and variability.…

Atmospheric and Oceanic Physics · Physics 2019-10-23 Noah D Brenowitz , Christopher S Bretherton

Most conditional generation tasks expect diverse outputs given a single conditional context. However, conditional generative adversarial networks (cGANs) often focus on the prior conditional information and ignore the input noise vectors,…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Qi Mao , Hsin-Ying Lee , Hung-Yu Tseng , Siwei Ma , Ming-Hsuan Yang

Generative adversarial networks (GANs) are an exciting alternative to algorithms for solving density estimation problems---using data to assess how likely samples are to be drawn from the same distribution. Instead of explicitly computing…

Machine Learning · Computer Science 2017-09-20 Christopher Grimm , Yuhang Song , Michael L. Littman

Regularization plays a crucial role in machine learning models, especially for deep neural networks. The existing regularization techniques mainly rely on the i.i.d. assumption and only consider the knowledge from the current sample,…

Machine Learning · Computer Science 2023-10-24 Ke Sun , Bing Yu , Zhouchen Lin , Zhanxing Zhu

Generative adversarial networks (GANs) learn a target probability distribution by optimizing a generator and a discriminator with minimax objectives. This paper addresses the question of whether such optimization actually provides the…

Machine Learning · Computer Science 2024-04-11 Yuhta Takida , Masaaki Imaizumi , Takashi Shibuya , Chieh-Hsin Lai , Toshimitsu Uesaka , Naoki Murata , Yuki Mitsufuji

One of the challenges in vision-based driving trajectory generation is dealing with out-of-distribution scenarios. In this paper, we propose a domain generalization method for vision-based driving trajectory generation for autonomous…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Yunkai Wang , Dongkun Zhang , Yuxiang Cui , Zexi Chen , Wei Jing , Junbo Chen , Rong Xiong , Yue Wang

While significant theoretical progress has been achieved, unveiling the generalization mystery of overparameterized neural networks still remains largely elusive. In this paper, we study the generalization behavior of shallow neural…

Machine Learning · Computer Science 2022-09-21 Yunwen Lei , Rong Jin , Yiming Ying

Under limited data setting, GANs often struggle to navigate and effectively exploit the input latent space. Consequently, images generated from adjacent variables in a sparse input latent space may exhibit significant discrepancies in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Jian Wang , Xin Lan , Jizhe Zhou , Yuxin Tian , Jiancheng Lv

Practitioners in diverse fields such as healthcare, economics and education are eager to apply machine learning to improve decision making. The cost and impracticality of performing experiments and a recent monumental increase in electronic…

Machine Learning · Computer Science 2023-08-01 Fredrik D. Johansson , Uri Shalit , Nathan Kallus , David Sontag

Domain generalization aims to learn invariance across multiple training domains, thereby enhancing generalization against out-of-distribution data. While gradient or representation matching algorithms have achieved remarkable success, these…

Machine Learning · Computer Science 2024-06-17 Yuxin Dong , Tieliang Gong , Hong Chen , Shuangyong Song , Weizhan Zhang , Chen Li

Generalization is a central problem in Machine Learning. Indeed most prediction methods require careful calibration of hyperparameters usually carried out on a hold-out \textit{validation} dataset to achieve generalization. The main goal of…

Machine Learning · Statistics 2021-02-18 Karim Lounici , Katia Meziani , Benjamin Riu

Quantum machine learning offers a transformative approach to solving complex problems, but the inherent noise hinders its practical implementation in near-term quantum devices. This obstacle makes it difficult to understand the…

Machine Learning · Computer Science 2025-02-05 Bikram Khanal , Pablo Rivas

Removing the shape noise from the observed weak lensing field, i.e., denoising, enhances the potential of WL by accessing information at small scales where the shape noise dominates without denoising. We utilise two machine learning (ML)…

Cosmology and Nongalactic Astrophysics · Physics 2026-05-13 Shohei D. Aoyama , Ken Osato , Masato Shirasaki

Many scientific problems seek to find the ground state in a rugged energy landscape, a task that becomes prohibitively difficult for large systems. Within a particular class of problems, however, the short-range correlations within energy…

Computational Physics · Physics 2020-08-20 Seong Ho Pahng , Michael P. Brenner

We address the fundamental question of why deep neural networks generalize by establishing a pointwise generalization theory for fully connected networks. This framework resolves long-standing barriers to characterizing the rich nonlinear…

Machine Learning · Computer Science 2026-05-19 Shaojie Li , Yunbei Xu

The numerical extraction of resonant states of open quantum systems is usually a difficult problem. Regularization techniques, such as the mapping to complex coordinates or the addition of Complex Absorbing Potentials are typically…

Materials Science · Physics 2015-04-03 Luigi Genovese , Alessandro Cerioni , Maxime Morinière , Thierry Deutsch

Understanding the generalization of deep neural networks is one of the most important tasks in deep learning. Although much progress has been made, theoretical error bounds still often behave disparately from empirical observations. In this…

Machine Learning · Computer Science 2021-11-09 Ching-Yao Chuang , Youssef Mroueh , Kristjan Greenewald , Antonio Torralba , Stefanie Jegelka

Recurrent neural networks (RNNs) are a class of neural networks that have emerged from the paradigm of artificial intelligence and has enabled lots of interesting advances in the field of natural language processing. Interestingly, these…

Disordered Systems and Neural Networks · Physics 2024-01-17 Mohamed Hibat-Allah , Roger G. Melko , Juan Carrasquilla

GANS are powerful generative models that are able to model the manifold of natural images. We leverage this property to perform manifold regularization by approximating the Laplacian norm using a Monte Carlo approximation that is easily…

Machine Learning · Computer Science 2018-05-24 Bruno Lecouat , Chuan-Sheng Foo , Houssam Zenati , Vijay R. Chandrasekhar