English
Related papers

Related papers: MiniAnDE: a reduced AnDE ensemble to deal with mic…

200 papers

Finding the model that best describes a high-dimensional dataset is a daunting task, even more so if one aims to consider all possible high-order patterns of the data, going beyond pairwise models. For binary data, we show that this task…

Artificial Intelligence · Computer Science 2024-08-28 Clélia de Mulatier , Matteo Marsili

Big data applications, such as medical imaging and genetics, typically generate datasets that consist of few observations n on many more variables p, a scenario that we denote as p>>n. Traditional data processing methods are often…

Data Analysis, Statistics and Probability · Physics 2016-05-18 Magnus O. Ulfarsson , Frosti Palsson , Jakob Sigurdsson , Johannes R. Sveinsson

The dynamic ensemble selection of classifiers is an effective approach for processing label-imbalanced data classifications. However, such a technique is prone to overfitting, owing to the lack of regularization methods and the dependence…

Machine Learning · Computer Science 2020-11-09 Chen Wang , Chengyuan Deng , Zhoulu Yu , Dafeng Hui , Xiaofeng Gong , Ruisen Luo

Imbalanced data classification problem has always been a popular topic in the field of machine learning research. In order to balance the samples between majority and minority class. Oversampling algorithm is used to synthesize new minority…

Machine Learning · Computer Science 2019-09-02 Junyi Zou , Jinliang Zhang , Ping Jiang

MOTIVATION: Microarray technology makes it possible to measure thousands of variables and to compare their values under hundreds of conditions. Once microarray data are quantified, normalized and classified, the analysis phase is…

Quantitative Methods · Quantitative Biology 2007-09-11 Claude Pasquier , Fabrice Girardot , Karim Jevardat De Fombelle , Richard Christen

Identifying differentially expressed (DE) genes associated with a sample characteristic is the primary objective of many microarray studies. As more and more studies are carried out with observational rather than well controlled…

Applications · Statistics 2012-07-02 Xi Kathy Zhou , Fei Liu , Andrew J. Dannenberg

Random forest is a classification algorithm well suited for microarray data: it shows excellent performance even when most predictive variables are noise, can be used when the number of variables is much larger than the number of…

Quantitative Methods · Quantitative Biology 2007-05-23 Ramon Diaz-Uriarte , Sara Alvarez de Andres

Discovery of microRNAs (miRNAs) relies on predictive models for characteristic features from miRNA precursors (pre-miRNAs). The short length of miRNA genes and the lack of pronounced sequence features complicate this task. To accommodate…

Methods for unsupervised anomaly detection suffer from the fact that the data is unlabeled, making it difficult to assess the optimality of detection algorithms. Ensemble learning has shown exceptional results in classification and…

Machine Learning · Statistics 2016-10-26 Edward Yu , Parth Parekh

Subdata selection is a study of methods that select a small representative sample of the big data, the analysis of which is fast and statistically efficient. The existing subdata selection methods assume that the big data can be reasonably…

Methodology · Statistics 2024-05-01 Rakhi Singh

For many classification and regression problems, a large number of features are available for possible use - this is typical of DNA microarray data on gene expression, for example. Often, for computational or other reasons, only a small…

Statistics Theory · Mathematics 2007-06-13 Longhai Li , Jianguo Zhang , Radford M. Neal

The two primary approaches for high-dimensional regression problems are sparse methods (e.g., best subset selection, which uses the L0-norm in the penalty) and ensemble methods (e.g., random forests). Although sparse methods typically yield…

Methodology · Statistics 2024-10-31 Anthony-Alexander Christidis , Stefan Van Aelst , Ruben Zamar

In molecular and biological sciences, experiments are expensive, time-consuming, and often subject to ethical constraints. Consequently, one often faces the challenging task of predicting desirable properties from small data sets or…

Machine Learning · Computer Science 2023-01-09 Nicole Hayes , Ekaterina Merkurjev , Guo-Wei Wei

Previous industrial anomaly detection methods often struggle to handle the extensive diversity in training sets, particularly when they contain stylistically diverse and feature-rich samples, which we categorize as feature-rich anomaly…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Fengjie Wang , Chengming Liu , Lei Shi , Pang Haibo

Oxford Nanopore MinION sequencer is currently the smallest sequencing device available. While being able to produce very long reads (reads of up to 100~kbp were reported), it is prone to high sequencing error rates of up to 30%. Since most…

Data Structures and Algorithms · Computer Science 2016-06-29 Rastislav Rabatin , Broňa Brejová , Tomáš Vinař

The applications of artificial intelligence (AI) are rapidly evolving, and they are also commonly used in safety-critical domains, such as autonomous driving and medical diagnosis, where functional safety is paramount. In AI-driven systems,…

Machine Learning · Computer Science 2024-05-12 Soyed Tuhin Ahmed , Michael Hefenbrock , Mehdi B. Tahoori

In recent years, with the development of microarray technique, discovery of useful knowledge from microarray data has become very important. Biclustering is a very useful data mining technique for discovering genes which have similar…

Computational Engineering, Finance, and Science · Computer Science 2009-09-09 Mohsen lashkargir , S. Amirhassan Monadjemi , Ahmad Baraani Dastjerdi

Fast and effective unsupervised anomaly detection algorithms have been proposed for categorical data based on the minimum description length (MDL) principle. However, they can be ineffective when detecting anomalies in heterogeneous…

Databases · Computer Science 2020-06-16 James Cheney , Xavier Gombau , Ghita Berrada , Sidahmed Benabderrahmane

Anomalies are those deviating from the norm. Unsupervised anomaly detection often translates to identifying low density regions. Major problems arise when data is high-dimensional and mixed of discrete and continuous attributes. We propose…

Machine Learning · Computer Science 2016-10-21 Kien Do , Truyen Tran , Svetha Venkatesh

Ensemble learning combines multiple classifiers in the hope of obtaining better predictive performance. Empirical studies have shown that ensemble pruning, that is, choosing an appropriate subset of the available classifiers, can lead to…