English
Related papers

Related papers: Dealing with the data imbalance problem on pulsar …

200 papers

Feature selection is an important process in machine learning and knowledge discovery. By selecting the most informative features and eliminating irrelevant ones, the performance of learning algorithms can be improved and the extraction of…

Machine Learning · Computer Science 2024-01-17 Chunxu Cao , Qiang Zhang

Class imbalance is a common issue in many domain applications of learning algorithms. Oftentimes, in the same domains it is much more relevant to correctly classify and profile minority class observations. This need can be addressed by…

Machine Learning · Statistics 2021-03-23 Michela C. Massi , Francesca Ieva , Francesca Gasperoni , Anna Maria Paganoni

Feature Selection (FS) is a key task in Machine Learning. It consists in selecting a number of relevant variables for the model construction or data analysis. We present the R package, FSinR, which implements a variety of widely known…

Machine Learning · Computer Science 2020-02-25 F. Aragón-Royón , A. Jiménez-Vílchez , A. Arauzo-Azofra , J. M. Benítez

Pulsar searches are computationally demanding efforts to discover dispersed periodic signals in time- and frequency-resolved data from radio telescopes. The complexity and computational expense of simultaneously determining the…

Instrumentation and Methods for Astrophysics · Physics 2021-07-14 Lars Künkel , Rajat M. Thomas , Joris P. W. Verbiest

Several data mining problems are characterized by data in high dimensions. One of the popular ways to reduce the dimensionality of the data is to perform feature selection, i.e, select a subset of relevant and non-redundant features.…

Computer Vision and Pattern Recognition · Computer Science 2015-08-12 Yamuna Prasad , K. K. Biswas

Accurate and early prediction of a disease allows to plan and improve a patient's quality of future life. During pandemic situations, the medical decision becomes a speed challenge in which physicians have to act fast to diagnose and…

Machine Learning · Computer Science 2022-06-09 Pierluigi Costanzo , Kalia Orphanou

Feature Selection is a crucial procedure in Data Science tasks such as Classification, since it identifies the relevant variables, making thus the classification procedures more interpretable, cheaper in terms of measurement and more…

Machine Learning · Statistics 2024-01-17 Sandra Benítez-Peña , Rafael Blanquero , Emilio Carrizosa , Pepa Ramírez-Cobo

This paper presents a new filter method for unsupervised feature selection. This method is particularly effective on imbalanced multi-class dataset, as in case of clusters of different anomaly types. Existing methods usually involve the…

Machine Learning · Statistics 2023-06-01 Katarina Firdova , Céline Labart , Arthur Martel

Feature selection (FS) is an important research topic in machine learning. Usually, FS is modelled as a+ bi-objective optimization problem whose objectives are: 1) classification accuracy; 2) number of features. One of the main issues in…

Artificial Intelligence · Computer Science 2021-04-21 Yu Xue , Yihang Tang , Xin Xu , Jiayu Liang , Ferrante Neri

This study proposes a method for imbalanced data classification based on deep probabilistic graphical models (DPGMs) to solve the problem that traditional methods have insufficient learning ability for minority class samples. To address the…

Machine Learning · Computer Science 2025-04-09 Yujia Lou , Jie Liu , Yuan Sheng , Jiawei Wang , Yiwei Zhang , Yaokun Ren

This paper concerns the critical decision process of extracting or selecting the features before applying a clustering algorithm. It is not obvious to evaluate the importance of the features since the most popular methods to do it are…

Machine Learning · Computer Science 2021-11-23 Jean-Sebastien Dessureault , Daniel Massicotte

Modern radio pulsar surveys produce a large volume of prospective candidates, the majority of which are polluted by human-created radio frequency interference or other forms of noise. Typically, large numbers of candidates need to be…

Due to advances in sensors, growing large and complex medical image data have the ability to visualize the pathological change in the cellular or even the molecular level or anatomical changes in tissues and organs. As a consequence, the…

Machine Learning · Statistics 2016-02-17 Nan Lin , Junhai Jiang , Shicheng Guo , Momiao Xiong

Feature selection is a critical task in machine learning and statistics. However, existing feature selection methods either (i) rely on parametric methods such as linear or generalized linear models, (ii) lack theoretical false discovery…

Machine Learning · Statistics 2025-07-18 Omar Melikechi , David B. Dunson , Jeffrey W. Miller

In industry, feature selection is a standard but necessary step to search for an optimal set of informative feature fields for efficient and effective training of deep Click-Through Rate (CTR) models. Most previous works measure the…

Information Retrieval · Computer Science 2022-09-07 Yi Guo , Zhaocheng Liu , Jianchao Tan , Chao Liao , Sen Yang , Lei Yuan , Dongying Kong , Zhi Chen , Ji Liu

The Commensal Radio Astronomy Five-hundred-meter Aperture Spherical radio Telescope (FAST) Survey (CRAFTS) utilizes the novel drift-scan commensal survey mode of FAST and can generate billions of pulsar candidate signals. The human experts…

Instrumentation and Methods for Astrophysics · Physics 2019-03-18 Hongfeng Wang , Weiwei Zhu , Ping Guo , Di Li , Sibo Feng , Qian Yin , Chenchen Miao , Zhenzhao Tao , Zhichen Pan , Pei Wang , Xin Zheng , Xiaodan Deng Zhijie Liu , Xiaoyao Xie , Xuhong Yu , Shanping You , Hui Zhang

Learning from many real-world datasets is limited by a problem called the class imbalance problem. A dataset is imbalanced when one class (the majority class) has significantly more samples than the other class (the minority class). Such…

Machine Learning · Computer Science 2017-11-30 Soroush Saryazdi , Bahareh Nikpour , Hossein Nezamabadi-pour

Here we present an in-depth study of the behaviour of the Fast Folding Algorithm, an alternative pulsar searching technique to the Fast Fourier Transform. Weaknesses in the Fast Fourier Transform, including a susceptibility to red noise,…

Instrumentation and Methods for Astrophysics · Physics 2017-04-19 A. D. Cameron , E. D. Barr , D. J. Champion , M. Kramer , W. W. Zhu

In this paper, a robust weighted score for unbalanced data (ROWSU) is proposed for selecting the most discriminative feature for high dimensional gene expression binary classification with class-imbalance problem. The method addresses one…

Machine Learning · Statistics 2024-01-24 Zardad Khan , Amjad Ali , Saeed Aldahmani

The discovery of pulsars is of great significance in the field of physics and astronomy. As the astronomical equipment produces a large amount of pulsar data, an algorithm for automatically identifying pulsars becomes urgent. We propose a…

Instrumentation and Methods for Astrophysics · Physics 2021-12-08 ShiChuan Zhang , XiangCong Kong , YueYing Zhou , LingYao Chen , XiaoYing Zheng , Chun-Ling Xu , Bao-Qiang Lao , Tao An