English
Related papers

Related papers: Quantifying Ranking Instability Across Evaluation …

200 papers

Updating machine learning models with new information usually improves their predictive performance, yet, in many applications, it is also desirable to avoid changing the model predictions too much. This property is called stability. In…

Machine Learning · Computer Science 2024-02-22 Morten Blørstad , Berent Å. S. Lunde , Nello Blaser

Networks are widely used in many fields for their powerful ability to provide vivid representations of relationships between variables. However, many of them may be corrupted by experimental noise or inappropriate network inference methods…

Molecular Networks · Quantitative Biology 2021-09-21 Jiating Yu , Jiacheng Leng , Ling-Yun Wu

Online incremental clustering of sequentially incoming data without prior knowledge suffers from changing cluster numbers and tends to fall into local extrema according to given data order. To overcome these limitations, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 In-Ug Yoon , Ue-Hwan Kim , Jong-Hwan

When using graphs and graph transformations to model systems, consistency is an important concern. While consistency has primarily been viewed as a binary property, i.e., a graph is consistent or inconsistent with respect to a set of…

Software Engineering · Computer Science 2026-03-11 Lars Fritsche , Alexander Lauer , Maximilian Kratz , Andy Schürr , Gabriele Taentzer

Gene regulatory network inference uses genome-wide transcriptome measurements in response to genetic, environmental or dynamic perturbations to predict causal regulatory influences between genes. We hypothesized that evolution also acts as…

Genomics · Quantitative Biology 2015-05-20 Anagha Joshi , Yvonne Beck , Tom Michoel

The inference of gene regulatory networks from high throughput gene expression data is one of the major challenges in systems biology. This paper aims at analysing and comparing two different algorithmic approaches. The first approach uses…

Quantitative Methods · Quantitative Biology 2008-12-05 A. Braunstein , A. Pagnani , M. Weigt , R. Zecchina

Reliability of machine learning evaluation -- the consistency of observed evaluation scores across replicated model training runs -- is affected by several sources of nondeterminism which can be regarded as measurement noise. Current…

Machine Learning · Computer Science 2023-10-10 Michael Hagmann , Philipp Meier , Stefan Riezler

Graph neural networks (GNNs) have achieved remarkable performance on graph-structured data. However, GNNs may inherit prejudice from the training data and make discriminatory predictions based on sensitive attributes, such as gender and…

Machine Learning · Computer Science 2024-01-31 Yibo Li , Xiao Wang , Yujie Xing , Shaohua Fan , Ruijia Wang , Yaoqi Liu , Chuan Shi

The stochastic nature of iterative optimization heuristics leads to inherently noisy performance measurements. Since these measurements are often gathered once and then used repeatedly, the number of collected samples will have a…

Neural and Evolutionary Computing · Computer Science 2022-04-25 Diederick Vermetten , Hao Wang , Manuel López-Ibañez , Carola Doerr , Thomas Bäck

We adopt the statistical framework on robustness proposed by Watson and Holmes in 2016 and then tackle the practical challenges that hinder its applicability to network models. The goal is to evaluate how the quality of an inference for a…

Methodology · Statistics 2020-12-08 Marios Papamichalis , Simon Lunagomez , Patrick J. Wolfe

In this work, we consider ranking problems among a finite set of candidates: for instance, selecting the top-$k$ items among a larger list of candidates or obtaining the full ranking of all items in the set. These problems are often…

Machine Learning · Statistics 2025-06-04 Ruiting Liang , Jake A. Soloff , Rina Foygel Barber , Rebecca Willett

Scaling concepts and renormalization group (RG) methods are applied to a simple linear model of human posture control consisting of a trembling or quivering string subject to damping and restoring forces. The string is driven by…

Condensed Matter · Physics 2009-10-31 Francisco Alonso-Sanchez , David Hochberg

Ring oscillators are biochemical circuits consisting of a ring of interactions capable of sustained oscillations. The non-linear interactions between genes hinder the analytical insight into their function, usually requiring computational…

Molecular Networks · Quantitative Biology 2018-02-19 Karen M. Page , Ruben Perez-Carrasco

Graph classification benchmarks, vital for assessing and developing graph neural networks (GNNs), have recently been scrutinized, as simple methods like MLPs have demonstrated comparable performance. This leads to an important question: Do…

Machine Learning · Computer Science 2024-08-14 Zhengdao Li , Yong Cao , Kefan Shuai , Yiming Miao , Kai Hwang

The objective comparison of Reinforcement Learning (RL) algorithms is notoriously complex as outcomes and benchmarking of performances of different RL approaches are critically sensitive to environmental design, reward structures, and…

Machine Learning · Computer Science 2026-03-19 Sinan Ibrahim , Grégoire Ouerdane , Hadi Salloum , Henni Ouerdane , Stefan Streif , Pavel Osinenko

Modern implicit generative models such as generative adversarial networks (GANs) are generally known to suffer from issues such as instability, uninterpretability, and difficulty in assessing their performance. If we see these implicit…

Machine Learning · Statistics 2019-11-05 Arash Mehrjou , Wittawat Jitkrittum , Krikamol Muandet , Bernhard Schölkopf

Modern implicit generative models such as generative adversarial networks (GANs) are generally known to suffer from issues such as instability, uninterpretability, and difficulty in assessing their performance. If we see these implicit…

Machine Learning · Computer Science 2019-11-07 Arash Mehrjou , Wittawat Jitkrittum , Krikamol Muandet , Bernhard Schölkopf

In the problem of structured prediction with graph representation learning (GRL for short), the hypothesis returned by the algorithm maps the set of features in the \emph{receptive field} of the targeted vertex to its label. To understand…

Machine Learning · Computer Science 2021-11-29 Yihan He , Joan Bruna

The solution of linear inverse problems arising, for example, in signal and image processing is a challenging problem since the ill-conditioning amplifies, in the solution, the noise present in the data. Recently introduced algorithms based…

Numerical Analysis · Mathematics 2024-02-08 Davide Evangelista , James Nagy , Elena Morotti , Elena Loli Piccolomini

Spatial transcriptomics (ST) provides essential spatial context by mapping gene expression within tissue, enabling detailed study of cellular heterogeneity and tissue organization. However, aligning ST data with histology images poses…