中文
相关论文

相关论文: Subsampling for Ridge Regression via Regularized V…

200 篇论文

Recently, deep neural networks have been found to nearly interpolate training data but still generalize well in various applications. To help understand such a phenomenon, it has been of interest to analyze the ridge estimator and its…

统计理论 · 数学 2024-05-03 Libin Liang , Zhiqiang Tan

In experimental design, we are given a large collection of vectors, each with a hidden response value that we assume derives from an underlying linear model, and we wish to pick a small subset of the vectors such that querying the…

机器学习 · 计算机科学 2019-02-05 Michał Dereziński , Kenneth L. Clarkson , Michael W. Mahoney , Manfred K. Warmuth

Real-world datasets commonly exhibit noisy labels and class imbalance, such as long-tailed distributions. While previous research addresses this issue by differentiating noisy and clean samples, reliance on information from predictions…

机器学习 · 计算机科学 2024-03-06 Ying-Hsuan Wu , Jun-Wei Hsieh , Li Xin , Shin-You Teng , Yi-Kuan Hsieh , Ming-Ching Chang

Falsely annotated samples, also known as noisy labels, can significantly harm the performance of deep learning models. Two main approaches for learning with noisy labels are global noise estimation and data filtering. Global noise…

机器学习 · 计算机科学 2025-07-31 Yuval Grinberg , Nimrod Harel , Jacob Goldberger , Ofir Lindenbaum

This paper presents a novel version of the hypergraph neural network method. This method is utilized to solve the noisy label learning problem. First, we apply the PCA dimensional reduction technique to the feature matrices of the image…

机器学习 · 统计学 2022-09-07 Nguyen Trinh Vu Dang , Loc Tran , Linh Tran

In recent years, the remarkable success of deep neural networks (DNNs) in computer vision is largely due to large-scale, high-quality labeled datasets. Training directly on real-world datasets with label noise may result in overfitting. The…

计算机视觉与模式识别 · 计算机科学 2025-01-09 Yuandi Zhao , Qianxi Xia , Yang Sun , Zhijie Wen , Liyan Ma , Shihui Ying

Retinal vessel segmentation from retinal images is an essential task for developing the computer-aided diagnosis system for retinal diseases. Efforts have been made on high-performance deep learning-based approaches to segment the retinal…

图像与视频处理 · 电气工程与系统科学 2021-03-08 Yuqian Zhou , Hanchao Yu , Humphrey Shi

Massive data analysis becomes increasingly prevalent, subsampling methods like BLB (Bag of Little Bootstraps) serves as powerful tools for assessing the quality of estimators for massive data. However, the performance of the subsampling…

统计方法学 · 统计学 2022-01-14 Yingying Ma , Hansheng Wang

In this paper we analyze a budgeted learning setting, in which the learner can only choose and observe a small subset of the attributes of each training example. We develop efficient algorithms for ridge and lasso linear regression, which…

机器学习 · 计算机科学 2014-10-24 Doron Kukliansky , Ohad Shamir

Data imbalance, in which a plurality of the data samples come from a small proportion of labels, poses a challenge in training deep neural networks. Unlike classification, in regression the labels are continuous, potentially boundless, and…

机器学习 · 计算机科学 2022-06-27 Yu Gong , Greg Mori , Frederick Tung

Although the word-popularity based negative sampler has shown superb performance in the skip-gram model, the theoretical motivation behind oversampling popular (non-observed) words as negative samples is still not well understood. In this…

机器学习 · 计算机科学 2018-06-27 Long Chen , Fajie Yuan , Joemon M. Jose , Weinan Zhang

Noisy labels can impair the performance of deep neural networks. To tackle this problem, in this paper, we propose a new method for filtering label noise. Unlike most existing methods relying on the posterior probability of a noisy…

计算机视觉与模式识别 · 计算机科学 2022-01-31 Pengxiang Wu , Songzhu Zheng , Mayank Goswami , Dimitris Metaxas , Chao Chen

A common problem in health research is that we have a large database with many variables measured on a large number of individuals. We are interested in measuring additional variables on a subsample; these measurements may be newly…

统计方法学 · 统计学 2022-03-22 Thomas Lumley , Tong Chen

Multi-label classification has received considerable interest in recent years. Multi-label classifiers have to address many problems including: handling large-scale datasets with many instances and a large set of labels, compensating…

机器学习 · 计算机科学 2016-06-21 Amirhossein Akbarnejad , Mahdieh Soleymani Baghshah

Residual bootstrap is a classical method for statistical inference in regression settings. With massive data sets becoming increasingly common, there is a demand for computationally efficient alternatives to residual bootstrap. We propose a…

统计方法学 · 统计学 2024-09-30 Indrila Ganguly , Srijan Sengupta , Sujit Ghosh

The best subset selection (or "best subsets") estimator is a classic tool for sparse regression, and developments in mathematical optimization over the past decade have made it more computationally tractable than ever. Notwithstanding its…

统计方法学 · 统计学 2022-01-11 Ryan Thompson

Learning with noisy labels aims to ensure model generalization given a label-corrupted training set. The sample selection strategy achieves promising performance by selecting a label-reliable subset for model training. In this paper, we…

机器学习 · 计算机科学 2025-04-11 Qi Wei , Lei Feng , Haobo Wang , Bo An

Learning segmentation from noisy labels is an important task for medical image analysis due to the difficulty in acquiring highquality annotations. Most existing methods neglect the pixel correlation and structural prior in segmentation,…

计算机视觉与模式识别 · 计算机科学 2021-07-22 Shuailin Li , Zhitong Gao , Xuming He

Big data is ubiquitous in practices, and it has also led to heavy computation burden. To reduce the calculation cost and ensure the effectiveness of parameter estimators, an optimal subset sampling method is proposed to estimate the…

统计方法学 · 统计学 2023-11-16 Haohui Han , Liya Fu

Ridge regression with random coefficients provides an important alternative to fixed coefficients regression in high dimensional setting when the effects are expected to be small but not zeros. This paper considers estimation and prediction…

机器学习 · 统计学 2023-06-29 Hongzhe Zhang , Hongzhe Li