English
Related papers

Related papers: Safe Screening Rules for Group OWL Models

200 papers

Prediction models based on deep neural networks are increasingly gaining attention for fast and accurate virtual screening systems. For decision makings in virtual screening, researchers find it useful to interpret an output of…

Machine Learning · Computer Science 2020-03-18 Soojung Yang , Kyung Hoon Lee , Seongok Ryu

Spectral clustering is an effective methodology for unsupervised learning. Most traditional spectral clustering algorithms involve a separate two-step procedure and apply the transformed new representations for the final clustering results.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Liangchen Liu , Qiuhong Ke , Chaojie Li , Feiping Nie , Yingying Zhu

Multiresponse data with complex group structures in both responses and predictors arises in many fields, yet, due to the difficulty in identifying complex group structures, only a few methods have been studied on this problem. We propose a…

Methodology · Statistics 2022-08-16 Weixiong Liang , Yuehan Yang

In logistic regression, it is often desirable to utilize regularization to promote sparse solutions, particularly for problems with a large number of features compared to available labels. In this paper, we present screening rules that…

Machine Learning · Statistics 2022-02-02 Anna Deza , Alper Atamturk

This work aims at solving the problems with intractable sparsity-inducing norms that are often encountered in various machine learning tasks, such as multi-task learning, subspace clustering, feature selection, robust principal component…

Machine Learning · Computer Science 2019-07-03 Feiping Nie , Zhanxuan Hu , Xiaoqian Wang , Rong Wang , Xuelong Li , Heng Huang

Multi-Task Learning (MTL) can enhance a classifier's generalization performance by learning multiple related tasks simultaneously. Conventional MTL works under the offline or batch setting, and suffers from expensive training cost and poor…

Machine Learning · Computer Science 2017-06-28 Peng Yang , Peilin Zhao , Xin Gao

Recent computational strategies based on screening tests have been proposed to accelerate algorithms addressing penalized sparse regression problems such as the Lasso. Such approaches build upon the idea that it is worth dedicating some…

Machine Learning · Statistics 2015-10-28 Antoine Bonnefoy , Valentin Emiya , Liva Ralaivola , Rémi Gribonval

Much more attention has been paid to unsupervised feature selection nowadays due to the emergence of massive unlabeled data. The distribution of samples and the latent effect of training a learning method using samples in more effective…

Machine Learning · Computer Science 2021-12-15 Weiyi Li , Hongmei Chen , Tianrui Li , Jihong Wan , Binbin Sang

The l1-regularized logistic regression (or sparse logistic regression) is a widely used method for simultaneous classification and feature selection. Although many recent efforts have been devoted to its efficient implementation, its…

Machine Learning · Computer Science 2013-07-22 Jie Wang , Jiayu Zhou , Jun Liu , Peter Wonka , Jieping Ye

Mixed-effect models are very popular for analyzing data with a hierarchical structure, e.g. repeated observations within subjects in a longitudinal design, patients nested within centers in a multicenter design. However, recently, due to…

Methodology · Statistics 2019-05-09 Abhik Ghosh , Magne Thoresen

In this paper we propose a methodology to accelerate the resolution of the so-called "Sorted L-One Penalized Estimation" (SLOPE) problem. Our method leverages the concept of "safe screening", well-studied in the literature for…

Machine Learning · Computer Science 2022-10-05 Clément Elvira , Cédric Herzet

Modern high-dimensional methods often adopt the "bet on sparsity" principle, while in supervised multivariate learning statisticians may face "dense" problems with a large number of nonzero coefficients. This paper proposes a novel…

Machine Learning · Statistics 2022-02-10 Yiyuan She , Jiahui Shen , Chao Zhang

Estimating optimal individualized treatment rules (ITRs) via outcome weighted learning (OWL) often relies on observed rewards that are noisy or optimistic proxies for the true latent utility. Ignoring this reward uncertainty leads to the…

Machine Learning · Computer Science 2026-04-03 Yuya Ishikawa , Shu Tamano

Sparse optimization problems are ubiquitous in many fields such as statistics, signal/image processing and machine learning. This has led to the birth of many iterative algorithms to solve them. A powerful strategy to boost the performance…

Machine Learning · Computer Science 2023-01-09 Cassio F. Dantas , Emmanuel Soubies , Cédric Févotte

Screening rules were recently introduced as a technique for explicitly identifying active structures such as sparsity, in optimization problem arising in machine learning. This has led to new methods of acceleration based on a substantial…

Machine Learning · Statistics 2020-09-08 Eugene Ndiaye , Olivier Fercoq , Joseph Salmon

Support vector machine (SVM) has achieved many successes in machine learning, especially for a small sample problem. As a famous extension of the traditional SVM, the $\nu$ support vector machine ($\nu$-SVM) has shown outstanding…

Machine Learning · Computer Science 2024-03-05 Zhiji Yang , Wanyi Chen , Huan Zhang , Yitian Xu , Lei Shi , Jianhua Zhao

Personalized medicine has received increasing attention among statisticians, computer scientists, and clinical practitioners. A major component of personalized medicine is the estimation of individualized treatment rules (ITRs). Recently,…

Methodology · Statistics 2015-08-14 Xin Zhou , Nicole Mayer-Hamblett , Umer Khan , Michael R. Kosorok

The convolutional neural network (CNN) is vulnerable to degraded images with even very small variations (e.g. corrupted and adversarial samples). One of the possible reasons is that CNN pays more attention to the most discriminative…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Haozhe Liu , Haoqian Wu , Weicheng Xie , Feng Liu , Linlin Shen

In this paper, we address learning problems for high dimensional data. Previously, oblivious random projection based approaches that project high dimensional features onto a random subspace have been used in practice for tackling…

Machine Learning · Computer Science 2016-12-07 Yi Xu , Haiqin Yang , Lijun Zhang , Tianbao Yang

We propose a novel methodology for feature screening in clustering massive datasets, in which both the number of features and the number of observations can potentially be very large. Taking advantage of a fusion penalization based convex…

Methodology · Statistics 2017-10-05 Trambak Banerjee , Gourab Mukherjee , Peter Radchenko