English
Related papers

Related papers: The Logistic Network Lasso

200 papers

In recent years, there is a growing interest in combining techniques attributed to the areas of Statistics and Machine Learning in order to obtain the benefits of both approaches. In this article, the statistical technique lasso for…

Machine Learning · Statistics 2023-09-08 David Delgado , Ernesto Curbelo , Danae Carreras

We introduce the localized Lasso, which is suited for learning models that are both interpretable and have a high predictive power in problems with high dimensionality $d$ and small sample size $n$. More specifically, we consider a function…

Machine Learning · Statistics 2016-10-17 Makoto Yamada , Koh Takeuchi , Tomoharu Iwata , John Shawe-Taylor , Samuel Kaski

In generalized linear regression problems with an abundant number of features, lasso-type regularization which imposes an $\ell^1$-constraint on the regression coefficients has become a widely established technique. Deficiencies of the…

Applications · Statistics 2010-11-11 Martin Slawski , Wolfgang zu Castell , Gerhard Tutz

A recently proposed learning algorithm for massive network-structured data sets (big data over networks) is the network Lasso (nLasso), which extends the well- known Lasso estimator from sparse models to network-structured datasets.…

Machine Learning · Computer Science 2017-10-12 Nguyen Tran , Saeed Basirian , Alexander Jung

$\ell_1$ regularization has been used for logistic regression to circumvent the overfitting and use the estimated sparse coefficient for feature selection. However, the challenge of such a regularization is that the $\ell_1$ norm is not…

Machine Learning · Computer Science 2021-05-13 Majid Mohammadi , Amir Ahooye Atashin , Damian A. Tamburri

Multi-task learning has shown to significantly enhance the performance of multiple related learning tasks in a variety of situations. We present the fused logistic regression, a sparse multi-task learning approach for binary classification.…

Machine Learning · Statistics 2013-12-31 Venelin Mitov , Manfred Claassen

The demand for resilient logistics networks has increased because of recent disasters. When we consider optimization problems, entropy regularization is a powerful tool for the diversification of a solution. In this study, we proposed a…

Systems and Control · Electrical Eng. & Systems 2022-12-06 Koshi Oishi , Yota Hashizume , Tomohiko Jimbo , Hirotaka Kaji , Kenji Kashima

It is known that the Thresholded Lasso (TL), SCAD or MCP correct intrinsic estimation bias of the Lasso. In this paper we propose an alternative method of improving the Lasso for predictive models with general convex loss functions which…

Statistics Theory · Mathematics 2021-01-26 Piotr Pokarowski , Wojciech Rejchel , Agnieszka Soltys , Michal Frej , Jan Mielniczuk

Data driven classification that relies on neural networks is based on optimization criteria that involve some form of distance between the output of the network and the desired label. Using the same mathematical analysis, for a multitude of…

Machine Learning · Computer Science 2019-06-25 Kalliopi Basioti , George V. Moustakides

Recurrent stochastic configuration networks (RSCNs) have shown great potential in modelling nonlinear dynamic systems with uncertainties. This paper presents an RSCN with hybrid regularization to enhance both the learning capacity and…

Machine Learning · Computer Science 2024-12-03 Gang Dang , Dianhui Wang

Complex network reconstruction is a hot topic in many fields. Currently, the most popular data-driven reconstruction framework is based on lasso. However, it is found that, in the presence of noise, lasso loses efficiency for weighted…

Machine Learning · Statistics 2020-03-03 Shuang Xu , Chun-Xia Zhang , Pei Wang , Jiangshe Zhang

High-dimensional graphical models are often estimated using regularization that is aimed at reducing the number of edges in a network. In this work, we show how even simpler networks can be produced by aggregating the nodes of the graphical…

Methodology · Statistics 2021-02-01 Ines Wilms , Jacob Bien

Logistic models are studied as a tool to convert output from numerical weather forecasting systems (deterministic and ensemble) into probability forecasts for binary events. A logistic model obtains by putting the logarithmic odds ratio…

Atmospheric and Oceanic Physics · Physics 2009-01-29 Jochen Bröcker

Much work has been done recently to make neural networks more interpretable, and one obvious approach is to arrange for the network to use only a subset of the available features. In linear models, Lasso (or $\ell_1$-regularized) regression…

Machine Learning · Statistics 2021-06-17 Ismael Lemhadri , Feng Ruan , Louis Abraham , Robert Tibshirani

For various applications, the relations between the dependent and independent variables are highly nonlinear. Consequently, for large scale complex problems, neural networks and regression trees are commonly preferred over linear models…

Machine Learning · Computer Science 2017-05-23 Samet Oymak , Mehrdad Mahdavi , Jiasi Chen

The lasso and elastic net are popular regularized regression models for supervised learning. Friedman, Hastie, and Tibshirani (2010) introduced a computationally efficient algorithm for computing the elastic net regularization path for…

Computation · Statistics 2021-03-08 J. Kenneth Tay , Balasubramanian Narasimhan , Trevor Hastie

We study the problem of modeling multiple symmetric, weighted networks defined on a common set of nodes, where networks arise from different groups or conditions. We propose a model in which each network is expressed as the sum of a shared…

Statistics Theory · Mathematics 2025-06-23 Hao Yan , Keith Levin

We propose a new algorithm called PLUTO for building logistic regression trees to binary response data. PLUTO can capture the nonlinear and interaction patterns in messy data by recursively partitioning the sample space. It fits a simple or…

Machine Learning · Statistics 2014-11-26 Wenwen Zhang , Wei-Yin Loh

Regularizing neural networks is important for anticipating model behavior in regions of the data space that are not well represented. In this work, we propose a regularization technique for enforcing a level of smoothness in the mapping…

Machine Learning · Computer Science 2025-03-05 Ali Hasan , Haoming Yang , Yuting Ng , Vahid Tarokh

A successful approach to structured learning is to write the learning objective as a joint function of linear parameters and inference messages, and iterate between updates to each. This paper observes that if the inference problem is…

Machine Learning · Computer Science 2014-07-04 Justin Domke