English
Related papers

Related papers: Applying Machine Learning to Catalogue Matching in…

200 papers

We present the design of a novel way of handling astronomical catalogs in Astro-WISE in order to achieve the scalability required for the data produced by large scale surveys. A high level of automation and abstraction is achieved in order…

Instrumentation and Methods for Astrophysics · Physics 2011-11-17 Hugo Buddelmeijer , Danny Boxhoorn , Edwin A. Valentijn

Nowadays there is no field research which is not flooded with data. Among the sciences, Astrophysics has always been driven by the analysis of massive amounts of data. The development of new and more sophisticated observation facilities,…

Instrumentation and Methods for Astrophysics · Physics 2017-06-14 Mauro Garofalo , Alessio Botta , Giorgio Ventre

Recent improvements in data collection volume from planetary and space physics missions have allowed the application of novel data science techniques. The Cassini mission for example collected over 600 gigabytes of scientific data from 2004…

Space Physics · Physics 2023-07-17 A. R. Azari , J. W. Lockhart , M. W. Liemohn , X. Jia

Obtaining accurate photometric redshift estimations is an important aspect of cosmology, remaining a prerequisite of many analyses. In creating novel methods to produce redshift estimations, there has been a shift towards using machine…

Instrumentation and Methods for Astrophysics · Physics 2021-07-07 Ben Henghes , Connor Pettitt , Jeyan Thiyagalingam , Tony Hey , Ofer Lahav

Taking advantage of $\sim4700$ deg$^2$ optical coverage of the Southern sky offered by the VST ATLAS survey, we construct a new catalogue of photometrically selected galaxy groups and clusters using the {\sc orca} cluster detection…

Cosmology and Nongalactic Astrophysics · Physics 2023-02-08 B. Ansarinejad , D. N. A. Murphy , T. Shanks , N. Metcalfe

Supervised learning is ubiquitous in medical image analysis. In this paper we consider the problem of meta-learning -- predicting which methods will perform well in an unseen classification problem, given previous experience with other…

Computer Vision and Pattern Recognition · Computer Science 2017-06-13 Veronika Cheplygina , Pim Moeskops , Mitko Veta , Behdad Dasht Bozorg , Josien Pluim

We summarize the first exploratory investigation into whether Machine Learning techniques can augment science strategic planning. We find that an approach based on Latent Dirichlet Allocation using abstracts drawn from high impact astronomy…

Instrumentation and Methods for Astrophysics · Physics 2022-03-03 Brian Thomas , Harley Thronson , Anthony Buonomo , Louis Barbier

A common problem in machine learning is to rank a set of n items based on pairwise comparisons. Here ranking refers to partitioning the items into sets of pre-specified sizes according to their scores, which includes identification of the…

Machine Learning · Computer Science 2018-01-08 Reinhard Heckel , Max Simchowitz , Kannan Ramchandran , Martin J. Wainwright

Context: The huge and still rapidly growing amount of galaxies in modern sky surveys raises the need of an automated and objective classification method. Unsupervised learning algorithms are of particular interest, since they discover…

Cosmology and Nongalactic Astrophysics · Physics 2015-05-18 Rene Andrae , Peter Melchior , Matthias Bartelmann

Machine learning has rapidly become a tool of choice for the astronomical community. It is being applied across a wide range of wavelengths and problems, from the classification of transients to neural network emulators of cosmological…

We review the current state of data mining and machine learning in astronomy. 'Data Mining' can have a somewhat mixed connotation from the point of view of a researcher in this field. If used correctly, it can be a powerful approach,…

Instrumentation and Methods for Astrophysics · Physics 2010-08-11 Nicholas M. Ball , Robert J. Brunner

This review summarizes popular unsupervised learning methods, and gives an overview of their past, current, and future uses in astronomy. Unsupervised learning aims to organise the information content of a dataset, in such a way that…

Instrumentation and Methods for Astrophysics · Physics 2024-06-26 Sotiria Fotopoulou

This paper presents a data processing pipeline designed to extract information from the hyperspectral signature of unknown space objects. The methodology proposed in this paper determines the material composition of space objects from…

Instrumentation and Methods for Astrophysics · Physics 2024-01-30 Massimiliano Vasile , Lewis Walker , Andrew Campbell , Simao Marto , Paul Murray , Stephen Marshall , Vasili Savitski

This dissertation uses supervised and unsupervised data mining techniques to analyse office floor plans in an attempt to gain a better understanding of their geometry-to-function relationship. This question was deemed relevant after a…

Machine Learning · Computer Science 2020-05-19 Boyana Buyuklieva

Schema Matching is a method of finding attributes that are either similar to each other linguistically or represent the same information. In this project, we take a hybrid approach at solving this problem by making use of both the provided…

Databases · Computer Science 2020-04-22 Tanvi Sahay , Ankita Mehta , Shruti Jadon

Methods based on machine learning have recently made substantial inroads in many corners of cosmology. Through this process, new computational tools, new perspectives on data collection, model development, analysis, and discovery, as well…

The scientific study of the Solar System's minor bodies ultimately starts with a search for those bodies. This chapter presents a review of the use of machine learning techniques to find moving objects, both natural and artificial, in…

Earth and Planetary Astrophysics · Physics 2024-05-13 Wesley C. Fraser

Job search through online matching engines nowadays are very prominent and beneficial to both job seekers and employers. But the solutions of traditional engines without understanding the semantic meanings of different resumes have not kept…

Computation and Language · Computer Science 2016-07-27 Yiou Lin , Hang Lei , Prince Clement Addo , Xiaoyu Li

We present recent results from the Laboratory for Cosmological Data Mining (http://lcdm.astro.uiuc.edu) at the National Center for Supercomputing Applications (NCSA) to provide robust classifications and photometric redshifts for objects in…

Astrophysics · Physics 2007-10-25 Nicholas M. Ball , Robert J. Brunner , Adam D. Myers

We present a fast method of producing mock galaxy catalogues that can be used to compute covariance matrices of large-scale clustering measurements and test the methods of analysis. Our method populates a 2nd-order Lagrangian Perturbation…