English
Related papers

Related papers: Quantifying Ranking Instability Across Evaluation …

200 papers

Determining the precise rank is an important problem in many large-scale applications with matrix data exploiting low-rank plus noise models. In this paper, we suggest a universal approach to rank inference via residual subsampling (RIRS)…

Statistics Theory · Mathematics 2024-11-12 Xiao Han , Qing Yang , Yingying Fan

Policy-gradient methods are widely used in reinforcement learning, yet training often becomes unstable or slows down as learning progresses. We study this phenomenon through the noise-to-signal ratio (NSR) of a policy-gradient estimator,…

Optimization and Control · Mathematics 2026-02-10 Haoyu Han , Heng Yang

Exciting new work on the generalization bounds for neural networks (NN) given by Neyshabur et al. , Bartlett et al. closely depend on two parameter-depenedent quantities: the Lipschitz constant upper-bound and the stable rank (a softer…

Machine Learning · Statistics 2020-02-21 Amartya Sanyal , Philip H. S. Torr , Puneet K. Dokania

It is well-known that gene activation/deactivation dynamics may be a major source of randomness in genetic networks, also in the case of large concentrations of the transcription factors. In this work, we investigate the effect of realistic…

Molecular Networks · Quantitative Biology 2014-10-28 Sebastiano de Franciscis , Giulio Caravagna , Alberto d'Onofrio

Frontier large language models are increasingly deployed as orchestration backbones for biological research workflows, yet no shared evidence base exists for comparing their refusal behaviour on legitimate research prompts. RefusalBench,…

Software Engineering · Computer Science 2026-05-22 Lukas Weidener , Marko Brkić , Mihailo Jovanović , Emre Ulgac , Aakaash Meduri

The well-known issue of reconstructing regulatory networks from gene expression measurements has been somewhat disrupted by the emergence and rapid development of single-cell data. Indeed, the traditional way of seeing a gene regulatory…

Molecular Networks · Quantitative Biology 2021-10-01 Ulysse Herbach

Statistical methods for analyzing large-scale biomolecular data are commonplace in computational biology. A notable example is phenotype prediction from gene expression data, for instance, detecting human cancers, differentiating subtypes…

Genomics · Quantitative Biology 2014-11-24 Bahman Afsari , Ulisses M. Braga-Neto , Donald Geman

Boolean networks have been proposed as potentially useful models for genetic control. An important aspect of these networks is the stability of their dynamics in response to small perturbations. Previous approaches to stability have assumed…

Molecular Networks · Quantitative Biology 2015-05-13 Andrew Pomerance , Edward Ott , Michelle Girvan , Wolfgang Losert

\noindent Randomized nomination sampling (RNS) is a rank-based sampling technique which has been shown to be effective in several nonparametric studies involving environmental and ecological applications. In this paper, we investigate…

Methodology · Statistics 2015-12-18 Mohammad Nourmohammadi , Mohammad Jafari Jozani , Brad Johnson

Out-of-distribution generalization in reinforcement learning is hard to diagnose when benchmark shifts mix dynamics, observations, goals, and rewards. We address this with Tape, a controlled benchmark that isolates latent rule-shift in…

Artificial Intelligence · Computer Science 2026-04-21 Enze Pan

We find that the performance of state-of-the-art models on Natural Language Inference (NLI) and Reading Comprehension (RC) analysis/stress sets can be highly unstable. This raises three questions: (1) How will the instability affect the…

Computation and Language · Computer Science 2020-11-17 Xiang Zhou , Yixin Nie , Hao Tan , Mohit Bansal

Sequential Recommender Systems (SRSs) are widely employed to model user behavior over time. However, their robustness in the face of perturbations in training data remains a largely understudied yet critical issue. A fundamental challenge…

Information Retrieval · Computer Science 2024-05-03 Filippo Betello , Federico Siciliano , Pushkar Mishra , Fabrizio Silvestri

Prediction models can exhibit sensitivity with respect to training data: small changes in the training data can produce models that assign conflicting predictions to individual data points during test time. In this work, we study this…

Information Retrieval · Computer Science 2022-08-17 Sejoon Oh , Berk Ustun , Julian McAuley , Srijan Kumar

Generative adversarial networks (GANs) have proven effective in modeling distributions of high-dimensional data. However, their training instability is a well-known hindrance to convergence, which results in practical challenges in their…

Machine Learning · Computer Science 2022-09-28 Alessandro Ferrero , Shireen Elhabian , Ross Whitaker

Prediction models based on deep neural networks are increasingly gaining attention for fast and accurate virtual screening systems. For decision makings in virtual screening, researchers find it useful to interpret an output of…

Machine Learning · Computer Science 2020-03-18 Soojung Yang , Kyung Hoon Lee , Seongok Ryu

Stem cells can precisely and robustly undergo cellular differentiation and lineage commitment, referred to as stemness. However, how the gene network underlying stemness regulation reliably specifies cell fates is not well understood. To…

Molecular Networks · Quantitative Biology 2020-04-02 Bin Huang , Mingyang Lu , Madeline Galbraith , Herbert Levine , Jose N. Onuchic , Dongya Jia

The problem of estimating high-dimensional network models arises naturally in the analysis of many physical, biological and socio-economic systems. Examples include stock price fluctuations in financial markets and gene regulatory networks…

Methodology · Statistics 2013-10-09 Sumanta Basu , Ali Shojaie , George Michailidis

Graph convolutional neural networks (GCNNs) are nonlinear processing tools to learn representations from network data. A key property of GCNNs is their stability to graph perturbations. Current analysis considers deterministic perturbations…

Machine Learning · Computer Science 2021-06-22 Zhan Gao , Elvin Isufi , Alejandro Ribeiro

The reduced-rank regression model is a popular model to deal with multivariate response and multiple predictors, and is widely used in biology, chemometrics, econometrics, engineering, and other fields. In the reduced-rank regression…

Methodology · Statistics 2022-07-05 Canhong Wen , Qin Wang , Yuan Jiang

We study a genetic regulatory network model developed to demonstrate that genetic robustness can evolve through stabilizing selection for optimal phenotypes. We report preliminary results on whether such selection could result in a…

Molecular Networks · Quantitative Biology 2010-12-07 Volkan Sevim , Per Arne Rikvold