English
Related papers

Related papers: A Knowledge Gradient Policy for Sequencing Experim…

200 papers

Knowledge tracing (KT) is the problem of predicting students' future performance based on their historical interaction sequences. With the advanced capability of capturing contextual long-term dependency, attention mechanism becomes one of…

Machine Learning · Computer Science 2024-07-25 Shuyan Huang , Zitao Liu , Xiangyu Zhao , Weiqi Luo , Jian Weng

Inferring the structure of gene regulatory networks (GRN) from gene expression data has many applications, from the elucidation of complex biological processes to the identification of potential drug targets. It is however a notoriously…

Machine Learning · Statistics 2012-05-08 Anne-Claire Haury , Fantine Mordelet , Paola Vera-Licona , Jean-Philippe Vert

This paper proposes a sparse regression strategy for discovery of ordinary differential equations from incomplete and noisy data. Inference is performed over both equation parameters and state variables using a statistically motivated…

Dynamical Systems · Mathematics 2026-02-18 Teddy Meissner , Karl Glasner

While it is commonly observed in practice that pruning networks to a certain level of sparsity can improve the quality of the features, a theoretical explanation of this phenomenon remains elusive. In this work, we investigate this by…

Machine Learning · Statistics 2024-06-14 Nuri Mert Vural , Murat A. Erdogdu

Deep learning can help uncover patterns in resting-state functional Magnetic Resonance Imaging (rs-fMRI) associated with psychiatric disorders and personal traits. Yet the problem of interpreting deep learning findings is rarely more…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Camila González , Yanis Miraoui , Yiran Fan , Ehsan Adeli , Kilian M. Pohl

Motivated by extreme multi-label classification applications, we consider training deep learning models over sparse data in multi-GPU servers. The variance in the number of non-zero features across training batches and the intrinsic GPU…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-15 Yujing Ma , Florin Rusu , Kesheng Wu , Alexander Sim

Variance reduction methods such as SVRG and SpiderBoost use a mixture of large and small batch gradients to reduce the variance of stochastic gradients. Compared to SGD, these methods require at least double the number of operations per…

Machine Learning · Computer Science 2020-01-28 Melih Elibol , Lihua Lei , Michael I. Jordan

Choosing a proper set of kernel functions is an important problem in learning Gaussian Process (GP) models since each kernel structure has different model complexity and data fitness. Recently, automatic kernel composition methods provide…

Machine Learning · Computer Science 2021-02-25 Anh Tong , Toan Tran , Hung Bui , Jaesik Choi

Advances in spatial transcriptomics (ST) technologies enable systematic molecular characterization of tumor microenvironment, tumor gradients and gene regulatory networks. Cancer progression is known to vary along pathological gradients,…

In biological research, fluorescence staining is a key technique to reveal the locations and morphology of subcellular structures. However, it is slow, expensive, and harmful to cells. In this paper, we model it as a deep learning task…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Donghao Zhou , Chunbin Gu , Junde Xu , Furui Liu , Qiong Wang , Guangyong Chen , Pheng-Ann Heng

Informative gradients are often lost in large batch updates. We propose a robust mechanism to reinforce the sparse components within a random batch of data points. A finite queue of online gradients is used to determine their expected…

Machine Learning · Computer Science 2024-04-29 Irfan Mohammad Al Hasib

Self-similarity learning has been recognized as a promising method for single image super-resolution (SR) to produce high-resolution (HR) image in recent years. The performance of learning based SR reconstruction, however, highly depends on…

Computer Vision and Pattern Recognition · Computer Science 2018-09-28 Jiahe Shi , Chun Qi

We present a Bayesian method for feature selection in the presence of grouping information with sparsity on the between- and within group level. Instead of using a stochastic algorithm for parameter inference, we employ expectation…

Machine Learning · Statistics 2018-09-26 Edgar Steiger , Martin Vingron

Using a low-dimensional parametrization of signals is a generic and powerful way to enhance performance in signal processing and statistical inference. A very popular and widely explored type of dimensionality reduction is sparsity; another…

Statistics Theory · Mathematics 2020-04-02 Benjamin Aubin , Bruno Loureiro , Antoine Maillard , Florent Krzakala , Lenka Zdeborová

Super-resolution imaging techniques have largely improved our capabilities to visualize nanometric structures in biological systems. Their application further enables one to potentially quantitate relevant parameters to determine the…

Biological Physics · Physics 2019-12-18 Tina Kosǔta , Marta Cullell-Dalmau , Francesca Cella Zanacchi , Carlo Manzo

In this manuscript, a new high-dimensional approach for simultaneous variable and group selection is proposed, called sparse-group SLOPE (SGS). SGS achieves false discovery rate control at both variable and group levels by incorporating the…

Methodology · Statistics 2023-05-17 Fabio Feser , Marina Evangelou

Cancer is a complex disease characterized by uncontrolled cell growth and proliferation. T cell receptors (TCRs) are essential proteins for the adaptive immune system, and their specific recognition of antigens plays a crucial role in the…

Machine Learning · Computer Science 2023-09-07 Zahra Tayebi , Sarwan Ali , Prakash Chourasia , Taslim Murad , Murray Patterson

Markovian population models are suitable abstractions to describe well-mixed interacting particle systems in situation where stochastic fluctuations are significant due to the involvement of low copy particles. In molecular biology,…

Quantitative Methods · Quantitative Biology 2014-01-17 Christoph Zechner , Federico Wadehn , Heinz Koeppl

Stochastic Gradient Descent (SGD) is a workhorse in machine learning, yet its slow convergence can be a computational bottleneck. Variance reduction techniques such as SAG, SVRG and SAGA have been proposed to overcome this weakness,…

Machine Learning · Computer Science 2016-02-29 Thomas Hofmann , Aurelien Lucchi , Simon Lacoste-Julien , Brian McWilliams

Gaussian Processes (GP) have become popular machine-learning methods for kernel-based learning on datasets with complicated covariance structures. In this paper, we present a novel extension to the GP framework using a contaminated normal…

Machine Learning · Computer Science 2024-07-03 Daniel Iong , Matthew McAnear , Yuezhou Qu , Shasha Zou , Gabor Toth , Yang Chen