English
Related papers

Related papers: DropLasso: A robust variant of Lasso for single ce…

200 papers

Self-training is one of the earliest and simplest semi-supervised methods. The key idea is to augment the original labeled dataset with unlabeled data paired with the model's prediction (i.e. the pseudo-parallel data). While self-training…

Machine Learning · Computer Science 2020-10-20 Junxian He , Jiatao Gu , Jiajun Shen , Marc'Aurelio Ranzato

Recently, ultra high-throughput sequencing of RNA (RNA-Seq) has been developed as an approach for analysis of gene expression. By obtaining tens or even hundreds of millions of reads of transcribed sequences, an RNA-Seq experiment can offer…

Methodology · Statistics 2011-06-17 Julia Salzman , Hui Jiang , Wing Hung Wong

Overfitting to the source domain is a common issue in gradient-based training of deep neural networks. To compensate for the over-parameterized models, numerous regularization techniques have been introduced such as those based on dropout.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Mateusz Michalkiewicz , Masoud Faraki , Xiang Yu , Manmohan Chandraker , Mahsa Baktashmotlagh

We propose a simple yet robust stochastic answer network (SAN) that simulates multi-step reasoning in machine reading comprehension. Compared to previous work such as ReasoNet which used reinforcement learning to determine the number of…

Computation and Language · Computer Science 2018-05-16 Xiaodong Liu , Yelong Shen , Kevin Duh , Jianfeng Gao

Deep convolutional neural networks have shown remarkable performance on various computer vision tasks, and yet, they are susceptible to picking up spurious correlations from the training signal. So called `shortcuts' can occur during…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Mobarakol Islam , Ben Glocker

The widespread collection of data from mobile and wearable devices has created unprecedented opportunities to study human behavior in fine temporal resolution. One common structure for such data is categorical sequences: ordered,…

Methodology · Statistics 2025-07-25 Zuofu Huang , Yingling Fan , James Hodges , Julian Wolfson

Learning with Noisy Labels (LNL) has attracted significant attention from the research community. Many recent LNL methods rely on the assumption that clean samples tend to have "small loss". However, this assumption always fails to…

Machine Learning · Computer Science 2022-11-17 MingCai Chen , Yu Zhao , Bing He , Zongbo Han , Bingzhe Wu , Jianhua Yao

Regularizers help deep neural networks prevent feature co-adaptations. Dropout, as a commonly used regularization technique, stochastically disables neuron activations during network optimization. However, such complete feature disposal can…

Machine Learning · Computer Science 2022-01-25 Tiange Xiang , Chaoyi Zhang , Yang Song , Siqi Liu , Hongliang Yuan , Weidong Cai

The ability to adapt to changing environments and settings is essential for robots acting in dynamic and unstructured environments or working alongside humans with varied abilities or preferences. This work introduces an extremely simple…

Robotics · Computer Science 2022-10-31 Pamela Carreno-Medrano , Dana Kulić , Michael Burke

Large neural networks are often overparameterised and prone to overfitting, Dropout is a widely used regularization technique to combat overfitting and improve model generalization. However, unstructured Dropout is not always effective for…

Machine Learning · Computer Science 2022-10-07 Yiren Zhao , Oluwatomisin Dada , Xitong Gao , Robert D Mullins

A machine learning model that generalizes well should obtain low errors on unseen test examples. Thus, if we know how to optimally perturb training examples to account for test examples, we may achieve better generalization performance.…

Machine Learning · Computer Science 2022-02-15 Hae Beom Lee , Taewook Nam , Eunho Yang , Sung Ju Hwang

Unlike areas such as computer vision and speech recognition where convolutional and recurrent neural networks-based approaches have proven effective to the nature of the respective areas of application, deep learning (DL) still lacks a…

Signal Processing · Electrical Eng. & Systems 2021-05-14 Khalid Youssef , Greg Schuette , Yubin Cai , Daisong Zhang , Yikun Huang , Yahya Rahmat-Samii , Louis-S. Bouchard

We propose a new method that employs transfer learning techniques to effectively correct sampling selection errors introduced by sparse annotations during supervised learning for automated tumor segmentation. The practicality of current…

Single-cell RNA sequencing (scRNA-seq) is essential for unraveling cellular heterogeneity and diversity, offering invaluable insights for bioinformatics advancements. Despite its potential, traditional clustering methods in scRNA-seq data…

Machine Learning · Computer Science 2025-10-01 Ping Xu , Zhiyuan Ning , Meng Xiao , Guihai Feng , Xin Li , Yuanchun Zhou , Pengfei Wang

In this work, we leverage advances in sparse coding techniques to reduce the number of trainable parameters in a fully connected neural network. While most of the works in literature impose $\ell_1$ regularization, DropOut or DropConnect…

Machine Learning · Computer Science 2019-07-04 Arman Hasanzadeh , Nagaraj T. Janakiraman , Vamsi K. Amalladinne , Krishna R. Narayanan

The regression of multiple inter-connected sequence data is a problem in various disciplines. Formally, we name the regression problem of multiple inter-connected data entities as the "dynamic network regression" in this paper. Within the…

Machine Learning · Computer Science 2020-10-19 Yixin Chen , Lin Meng , Jiawei Zhang

Dropout regularization of deep neural networks has been a mysterious yet effective tool to prevent overfitting. Explanations for its success range from the prevention of "co-adapted" weights to it being a form of cheap Bayesian inference.…

Machine Learning · Statistics 2019-05-30 Eric Nalisnick , José Miguel Hernández-Lobato , Padhraic Smyth

Analysis of single-cell transcriptomics often relies on clustering cells and then performing differential gene expression (DGE) to identify genes that vary between these clusters. These discrete analyses successfully determine cell types…

Quantitative Methods · Quantitative Biology 2022-10-07 Renee S. Hoekzema , Lewis Marsh , Otto Sumray , Thomas M. Carroll , Xin Lu , Helen M. Byrne , Heather A. Harrington

In this paper, we present Reed-Solomon coded single-stranded representation learning (RSRL), a novel end-to-end model for learning representations for multi-modal lossless DNA storage. In contrast to existing learning-based methods, the…

Machine Learning · Computer Science 2024-08-05 Ben Cao , Tiantian He , Xue Li , Bin Wang , Xiaohu Wu , Qiang Zhang , Yew-Soon Ong

RNA molecules follow a succession of enzyme-mediated processing steps from transcription until maturation. The participating enzymes, for example the spliceosome for mRNAs and Drosha and Dicer for microRNAs, are also produced in the cell…

Quantitative Methods · Quantitative Biology 2015-06-15 Filippos D. Klironomos , Juliette de Meaux , Johannes Berg