English
Related papers

Related papers: How complex is the microarray dataset? A novel dat…

200 papers

Predicting the bioactivity of a ligand is one of the hardest and most important challenges in computer-aided drug discovery. Despite years of data collection and curation efforts by research organizations worldwide, bioactivity data remains…

Quantitative Methods · Quantitative Biology 2023-08-21 Lucian Chan , Marcel Verdonk , Carl Poelking

Machine learning algorithms are designed to capture complex relationships between features. In this context, the high dimensionality of data often results in poor model performance, with the risk of overfitting. Feature selection, the…

Machine Learning · Computer Science 2023-10-18 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli

Recent technological advancements in data acquisition tools allowed life scientists to acquire multimodal data from different biological application domains. Broadly categorized in three types (i.e., sequences, images, and signals), these…

Quantitative Methods · Quantitative Biology 2020-03-03 Mufti Mahmud , M Shamim Kaiser , Amir Hussain

A large driver of the complexity of graph learning is the interplay between structure and features. When analyzing the expressivity of graph neural networks, however, existing approaches ignore features in favor of structure, making it…

Machine Learning · Computer Science 2026-03-04 Martin Carrasco , Olga Zaghen , Kavir Sumaraj , Erik Bekkers , Bastian Rieck

Selectivity estimation aims at estimating the number of database objects that satisfy a selection criterion. Answering this problem accurately and efficiently is essential to many applications, such as density estimation, outlier detection,…

Databases · Computer Science 2021-05-28 Yaoshu Wang , Chuan Xiao , Jianbin Qin , Rui Mao , Onizuka Makoto , Wei Wang , Rui Zhang , Yoshiharu Ishikawa

We introduce a new method of performing high dimensional discriminant analysis, which we call multiDA. We achieve this by constructing a hybrid model that seamlessly integrates a multiclass diagonal discriminant analysis model and feature…

Machine Learning · Statistics 2018-07-05 Sarah Elizabeth Romanes , John Thomas Ormerod , Jean YH Yang

In this work a new way to calculate the multivariate joint entropy is presented. This measure is the basis for a fast information-theoretic based evaluation of gene relevance in a Microarray Gene Expression data context. Its low complexity…

Quantitative Methods · Quantitative Biology 2013-02-08 Fernando González , Lluís A. Belanche

The amount of high-dimensional large-scale RNA sequencing data derived from multiple heterogeneous sources has increased exponentially in biological science. During data collection, significant technical noise or errors may occur. To…

Applications · Statistics 2025-06-24 Xiaolu Jiang , Wei Liu

In data mining applications, feature selection is an essential process since it reduces a model's complexity. The cost of obtaining the feature values must be taken into consideration in many domains. In this paper, we study the…

Machine Learning · Computer Science 2013-06-04 Hong Zhao , Fan Min , William Zhu

Measuring the complexity of high-dimensional data in physical systems becomes a critical factor in determining the information and quality of the systems. However, traditional metrics, such as Lyapunov exponent, fractal dimension, and…

Physics and Society · Physics 2026-03-03 Seong-Gyun Im , Taewoo Kang , S. Joon Kwon

The ever-increasing fine-tuning cost of large-scale pre-trained models gives rise to the importance of dataset pruning, which aims to reduce dataset size while maintaining task performance. However, existing dataset pruning methods require…

Machine Learning · Computer Science 2025-05-09 Wenyu Jiang , Zhenlong Liu , Zejian Xie , Songxin Zhang , Bingyi Jing , Hongxin Wei

We investigate the complexity of logistic regression models which is defined by counting the number of indistinguishable distributions that the model can represent (Balasubramanian, 1997). We find that the complexity of logistic models with…

Machine Learning · Statistics 2019-03-04 Nicola Bulso , Matteo Marsili , Yasser Roudi

Modern self-driving autonomy systems heavily rely on deep learning. As a consequence, their performance is influenced significantly by the quality and richness of the training data. Data collecting platforms can generate many hours of raw…

Machine Learning · Computer Science 2021-01-19 Abbas Sadat , Sean Segal , Sergio Casas , James Tu , Bin Yang , Raquel Urtasun , Ersin Yumer

Feature selection is frequently used as a pre-processing step to machine learning. It is a process of choosing a subset of original features so that the feature space is optimally reduced according to a certain evaluation criterion. The…

Computer Vision and Pattern Recognition · Computer Science 2014-01-07 Vijendra Singh , Shivani Pathak

Genomic complexity is a growing field of evolution, with case studies for comparative evolutionary analyses in model and emerging non-model systems. Understanding complexity and the functional components of the genome is an untapped wealth…

Genomics · Quantitative Biology 2022-11-07 James E. Titus-McQuillan , Adalena V. Nanni , Lauren M. McIntyre , Rebekah L. Rogers

Biomedical data is filled with continuous real values; these values in the feature set tend to create problems like underfitting, the curse of dimensionality and increase in misclassification rate because of higher variance. In response,…

Artificial Intelligence · Computer Science 2020-04-17 Deepak Singh , Dilip Singh Sisodia , Pradeep Singh

The estimation of Bayesian networks given high-dimensional data, in particular gene expression data, has been the focus of much recent research. Whilst there are several methods available for the estimation of such networks, these typically…

Methodology · Statistics 2011-12-01 Jessica Kasza , Gary Glonek , Patty Solomon

Degree heterogeneity and latent geometry, also referred to as popularity and similarity, are key explanatory components underlying the structure of real-world networks. The relationship between these components and the statistical…

Social and Information Networks · Computer Science 2024-09-18 Keith Malcolm Smith , Jason P. Smith

Limited by cognitive abilities, decision-makers (DMs) may struggle to evaluate decision alternatives based on all criteria in multiple criteria decision-making problems. This paper proposes an embedded criteria selection method derived from…

Optimization and Control · Mathematics 2025-06-10 Kun Zhou , Zaiwu Gong , Guo Wei , Roman Slowinski

Complex networks can be understood as graphs whose connectivity deviates from those of regular or near-regular graphs, which are understood as being `simple'. While a great deal of the attention so far dedicated to complex networks has been…

Data Analysis, Statistics and Probability · Physics 2008-08-29 Luciano da Fontoura Costa , Francisco A. Rodrigues