English
Related papers

Related papers: Debunking Generalization Error or: How I Learned t…

200 papers

As deep learning technology continues to evolve, the images yielded by generative models are becoming more and more realistic, triggering people to question the authenticity of images. Existing generated image detection methods detect…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Xiuli Bi , Bo Liu , Fan Yang , Bin Xiao , Weisheng Li , Gao Huang , Pamela C. Cosman

Humans can easily infer the underlying 3D geometry and texture of an object only from a single 2D image. Current computer vision methods can do this, too, but suffer from view generalization problems - the models inferred tend to make poor…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Anand Bhattad , Aysegul Dundar , Guilin Liu , Andrew Tao , Bryan Catanzaro

Generalization beyond the training distribution is a core challenge in machine learning. The common practice of mixing and shuffling examples when training neural networks may not be optimal in this regard. We show that partitioning the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Damien Teney , Ehsan Abbasnejad , Anton van den Hengel

Domain generalization is the problem of assigning labels to an unlabeled data set, given several similar data sets for which labels have been provided. Despite considerable interest in this problem over the last decade, there has been no…

Machine Learning · Statistics 2019-05-28 Aniket Anand Deshmukh , Yunwen Lei , Srinagesh Sharma , Urun Dogan , James W. Cutler , Clayton Scott

We study the prevalent problem when a test distribution differs from the training distribution. We consider a setting where our training set consists of a small number of sample domains, but where we have many samples in each domain. Our…

Machine Learning · Computer Science 2011-05-05 Dean Foster , Sham Kakade , Ruslan Salakhutdinov

Learning from Demonstration depends on a robot learner generalising its learned model to unseen conditions, as it is not feasible for a person to provide a demonstration set that accounts for all possible variations in non-trivial tasks.…

Robotics · Computer Science 2019-03-05 Aran Sena , Brendan Michael , Matthew Howard

Making mock simulated catalogs is an important component of astrophysical data analysis. Selection criteria for observed astronomical objects are often too complicated to be derived from first principles. However the existence of an…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-22 Amir Hajian , Marcelo Alvarez , J. Richard Bond

The problem of model collapse has presented new challenges in iterative training of generative models, where such training with synthetic data leads to an overall degradation of performance. This paper looks at the problem from a…

Machine Learning · Statistics 2026-02-19 Soham Bakshi , Sunrit Chakraborty

Quickly growing computing facilities and an increasing number of extragalactic observations encourage the application of data-driven approaches to uncover hidden relations from astronomical data. In this work we raise the problem of…

Cosmology and Nongalactic Astrophysics · Physics 2020-03-25 A. Elyiv , O. Melnyk , I. Vavilova , D. Dobrycheva , V. Karachentseva

We present a new machine learning model for estimating photometric redshifts with improved accuracy for galaxies in Pan-STARRS1 data release 1. Depending on the estimation range of redshifts, this model based on neural networks can handle…

Instrumentation and Methods for Astrophysics · Physics 2021-12-09 Joongoo Lee , Min-Su Shin

Surveys of the local and distant Universe are the means to test and improve our models of galaxy formation. Substantial successes in the models are evident, while there is also considerable recent progress in identifying what remains to be…

Astrophysics · Physics 2007-05-23 Gerry Gilmore

The problem of domain generalization is to learn, given data from different source distributions, a model that can be expected to generalize well on new target distributions which are only seen through unlabeled samples. In this paper, we…

Machine Learning · Computer Science 2024-03-12 Markus Holzleitner , Sergei V. Pereverzyev , Werner Zellinger

The ability to build a model on a source task and subsequently adapt such model on a new target task is a pervasive need in many astronomical applications. The problem is generally known as transfer learning in machine learning, where…

Machine Learning · Computer Science 2019-09-25 Ricardo Vilalta , Kinjal Dhar Gupta , Dainis Boumber , Mikhail M. Meskhi

The robust generalization of models to rare, in-distribution (ID) samples drawn from the long tail of the training distribution and to out-of-training-distribution (OOD) samples is one of the major challenges of current deep learning…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Paul Gavrikov , Janis Keuper

Machine learning techniques offer a plethora of opportunities in tackling big data within the astronomical community. We present the set of Generalized Linear Models as a fast alternative for determining photometric redshifts of galaxies, a…

Instrumentation and Methods for Astrophysics · Physics 2016-06-29 J. Elliott , R. S. de Souza , A. Krone-Martins , E. Cameron , E. E. O. Ishida , J. Hilbe

Understanding how galaxies trace the underlying matter density field is essential for characterizing the influence of the large-scale structure on galaxy formation, being therefore a key ingredient in observational cosmology. This…

Galactic nuclei and globular clusters act as laboratories in which nature experiments with normal stars, neutron stars and black holes, through collisions and through the formation of bound states, in the form of binaries. The main…

Astrophysics · Physics 2007-05-23 Piet Hut

Medical imaging machine learning algorithms are usually evaluated on a single dataset. Although training and testing are performed on different subsets of the dataset, models built on one study show limited capability to generalize to other…

Computer Vision and Pattern Recognition · Computer Science 2018-12-06 Ahmed Ashraf , Shehroz Khan , Nikhil Bhagwat , Mallar Chakravarty , Babak Taati

We strive to learn a model from a set of source domains that generalizes well to unseen target domains. The main challenge in such a domain generalization scenario is the unavailability of any target domain data during training, resulting…

Machine Learning · Computer Science 2022-02-17 Zehao Xiao , Xiantong Zhen , Ling Shao , Cees G. M. Snoek

We explore the capability of deep learning to classify cosmic structures. In cosmological simulations, cosmic volumes are segmented into voids, sheets, filaments and knots, according to the distribution and kinematics of dark matter (DM),…

Astrophysics of Galaxies · Physics 2022-08-03 Shigeki Inoue , Xiaotian Si , Takashi Okamoto , Moka Nishigaki