English
Related papers

Related papers: A Generalized Meta-loss function for regression an…

200 papers

Existing RNN-based approaches for action recognition from depth sequences require either skeleton joints or hand-crafted depth features as inputs. An end-to-end manner, mapping from raw depth maps to action classes, is non-trivial to design…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Zhiyuan Shi , Tae-Kyun Kim

Learning using privileged information is an attractive problem setting that helps many learning scenarios in the real world. A state-of-the-art method of Gaussian process classification (GPC) with privileged information is GPC+, which…

Machine Learning · Statistics 2018-02-13 Ryosuke Kamesawa , Issei Sato , Masashi Sugiyama

The learning with privileged information setting has recently attracted a lot of attention within the machine learning community, as it allows the integration of additional knowledge into the training process of a classifier, even when this…

There is growing evidence that converting targets to soft targets in supervised learning can provide considerable gains in performance. Much of this work has considered classification, converting hard zero-one values to soft labels---such…

Machine Learning · Statistics 2018-06-13 Ehsan Imani , Martha White

Prediction-powered inference (PPI) is a method that improves statistical estimates based on limited human-labeled data. PPI achieves this by combining small amounts of human-labeled data with larger amounts of data labeled by a reasonably…

Machine Learning · Computer Science 2024-12-05 Adam Fisch , Joshua Maynez , R. Alex Hofer , Bhuwan Dhingra , Amir Globerson , William W. Cohen

In school, a teacher plays an important role in various classroom teaching patterns. Likewise to this human learning activity, the learning using privileged information (LUPI) paradigm provides additional information generated by the…

Machine Learning · Statistics 2019-11-01 Peng-Bo Zhang , Zhi-Xin Yang

We study the fundamental problem of ReLU regression, where the goal is to fit Rectified Linear Units (ReLUs) to data. This supervised learning task is efficiently solvable in the realizable setting, but is known to be computationally hard…

Machine Learning · Computer Science 2022-01-27 Ilias Diakonikolas , Jongho Park , Christos Tzamos

Conventional deep models predict a test sample with a single forward propagation, which, however, may not be sufficient for predicting hard-classified samples. On the contrary, we human beings may need to carefully check the sample many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shuaicheng Niu , Jiaxiang Wu , Yifan Zhang , Guanghui Xu , Haokun Li , Peilin Zhao , Junzhou Huang , Yaowei Wang , Mingkui Tan

To infer a function value on a specific point $x$, it is essential to assign higher weights to the points closer to $x$, which is called local polynomial / multivariable regression. In many practical cases, a limited sample size may ruin…

Machine Learning · Statistics 2024-09-30 Yanwu Gu , Dong Xia

Current deep neural networks (DNNs) can easily overfit to biased training data with corrupted labels or class imbalance. Sample re-weighting strategy is commonly used to alleviate this issue by designing a weighting function mapping from…

Machine Learning · Computer Science 2019-09-30 Jun Shu , Qi Xie , Lixuan Yi , Qian Zhao , Sanping Zhou , Zongben Xu , Deyu Meng

As one of the central tasks in machine learning, regression finds lots of applications in different fields. An existing common practice for solving regression problems is the mean square error (MSE) minimization approach or its regularized…

Machine Learning · Statistics 2022-11-24 Jirong Yi , Qiaosheng Zhang , Zhen Chen , Qiao Liu , Wei Shao , Yusen He , Yaohua Wang

Many applications that use empirically estimated functions face a curse of dimensionality, because the integrals over most function classes must be approximated by sampling. This paper introduces a novel regression-algorithm that learns…

Machine Learning · Computer Science 2015-03-31 Wendelin Böhmer , Klaus Obermayer

Recent advances in artificial intelligence have enabled the generation of large-scale, low-cost predictions with increasingly high fidelity. As a result, the primary challenge in statistical inference has shifted from data scarcity to data…

Statistics Theory · Mathematics 2026-02-12 Shirong Xu , Will Wei Sun

Learning using statistical invariants (LUSI) is a new learning paradigm, which adopts weak convergence mechanism, and can be applied to a wider range of classification problems. However, the computation cost of invariant matrices in LUSI is…

Machine Learning · Computer Science 2024-04-01 Ting-Ting Zhu , Yuan-Hai Shao , Chun-Na Li , Tian Liu

Preoperative prognosis of Ependymoma is critical for treatment planning but challenging due to the lack of semantic insights in MRI compared to post-operative surgical reports. Existing multimodal methods fail to leverage this privileged…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Shuren Gabriel Yu , Sikang Ren , Yongji Tian

Existing driving style recognition systems largely depend on low-level sensor-derived features for training, neglecting the rich semantic reasoning capability inherent to human experts. This discrepancy results in a fundamental misalignment…

Robotics · Computer Science 2026-05-06 Zhaokun Chen , Chaopeng Zhang , Xiaohan Li , Wenshuo Wang , Gentiane Venture , Junqiang Xi

Improving the robustness of neural nets in regression tasks is key to their application in multiple domains. Deep learning-based approaches aim to achieve this goal either by improving their prediction of specific values (i.e., point…

Machine Learning · Computer Science 2021-06-22 Eli Simhayev , Gilad Katz , Lior Rokach

Supervised machine learning describes the practice of fitting a parameterized model to labeled input-output data. Supervised machine learning methods have demonstrated promise in learning efficient surrogate models that can (partially)…

Machine Learning · Statistics 2026-03-24 Atticus Rex , Elizabeth Qian , David Peterson

This paper proposes inverse feature learning as a novel supervised feature learning technique that learns a set of high-level features for classification based on an error representation approach. The key contribution of this method is to…

Machine Learning · Computer Science 2020-03-10 Behzad Ghazanfari , Fatemeh Afghah , MohammadTaghi Hajiaghayi

Label noise significantly degrades the generalization ability of deep models in applications. Effective strategies and approaches, \textit{e.g.} re-weighting, or loss correction, are designed to alleviate the negative impact of label noise…

Machine Learning · Computer Science 2021-11-09 Haoliang Sun , Chenhui Guo , Qi Wei , Zhongyi Han , Yilong Yin