English
Related papers

Related papers: Neural Regression For Scale-Varying Targets

200 papers

The representations of neural networks are often compared to those of biological systems by performing regression between the neural network responses and those measured from biological systems. Many different state-of-the-art deep neural…

Neurons and Cognition · Quantitative Biology 2023-12-13 Abdulkadir Canatar , Jenelle Feather , Albert Wakhloo , SueYeon Chung

Estimation of a regression function from independent and identically distributed random variables is considered. The $L_2$ error with integration with respect to the design measure is used as an error criterion. Over-parametrized deep…

Statistics Theory · Mathematics 2022-10-05 Michael Kohler , Adam Krzyzak

Many machine learning methods operate by inverting a neural network at inference time, which has become a popular technique for solving inverse problems in computer vision, robotics, and graphics. However, these methods often involve…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Ruoshi Liu , Chengzhi Mao , Purva Tendulkar , Hao Wang , Carl Vondrick

We propose a novel approach for loss reserving based on deep neural networks. The approach allows for joint modeling of paid losses and claims outstanding, and incorporation of heterogeneous inputs. We validate the models on loss reserving…

Applications · Statistics 2019-09-17 Kevin Kuo

Causal machine-learning is about predicting the net-effect (true-lift) of treatments. Given the data of a treatment group and a control group, it is similar to a standard supervised-learning problem. Unfortunately, there is no similarly…

Machine Learning · Computer Science 2020-01-06 I-Sheng Yang

Face verification is a problem approached in the literature mainly using nonlinear class-specific subspace learning techniques. While it has been shown that kernel-based Class-Specific Discriminant Analysis is able to provide excellent…

Computer Vision and Pattern Recognition · Computer Science 2018-07-06 Guanqun Cao , Alexandros Iosifidis , Moncef Gabbouj

We propose a novel loss function that dynamically rescales the cross entropy based on prediction difficulty regarding a sample. Deep neural network architectures in image classification tasks struggle to disambiguate visually similar…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Serim Ryou , Seong-Gyun Jeong , Pietro Perona

Transfer learning aims to improve the performance of a target model by leveraging data from related source populations, which is known to be especially helpful in cases with insufficient target data. In this paper, we study the problem of…

Methodology · Statistics 2025-02-19 Tian Gu , Yi Han , Rui Duan

The modern image search system requires semantic understanding of image, and a key yet under-addressed problem is to learn a good metric for measuring the similarity between images. While deep metric learning has yielded impressive…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Jian Wang , Feng Zhou , Shilei Wen , Xiao Liu , Yuanqing Lin

Meta-learning, or learning-to-learn, seeks to design algorithms that can utilize previous experience to rapidly learn new skills or adapt to new environments. Representation learning -- a key tool for performing meta-learning -- learns a…

Machine Learning · Computer Science 2022-01-04 Nilesh Tripuraneni , Chi Jin , Michael I. Jordan

Learning to defer with multiple experts is a framework where the learner can choose to defer the prediction to several experts. While this problem has received significant attention in classification contexts, it presents unique challenges…

Machine Learning · Computer Science 2024-03-29 Anqi Mao , Mehryar Mohri , Yutao Zhong

The effectiveness of non-parametric, kernel-based methods for function estimation comes at the price of high computational complexity, which hinders their applicability in adaptive, model-based control. Motivated by approximation techniques…

Statistics Theory · Mathematics 2023-03-17 Anna Scampicchio , Elena Arcari , Melanie N. Zeilinger

Convolutional neural networks have achieved great improvement on face recognition in recent years because of its extraordinary ability in learning discriminative features of people with different identities. To train such a well-designed…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Xiao Zhang , Zhiyuan Fang , Yandong Wen , Zhifeng Li , Yu Qiao

Communication scene recognition has been widely applied in practice, but using deep learning to address this problem faces challenges such as insufficient data and imbalanced data distribution. To address this, we designed a weighted loss…

Econometrics · Economics 2026-02-10 Jiasong Han , Yufei Feng , Xiaofeng Zhong

Deep learning algorithms can fare poorly when the training dataset suffers from heavy class-imbalance but the testing criterion requires good generalization on less frequent classes. We design two novel methods to improve performance in…

Machine Learning · Computer Science 2019-10-29 Kaidi Cao , Colin Wei , Adrien Gaidon , Nikos Arechiga , Tengyu Ma

To enhance the reproducibility and reliability of deep learning models, we address a critical gap in current training methodologies: the lack of mechanisms that ensure consistent and robust performance across runs. Our empirical analysis…

Machine Learning · Computer Science 2026-01-05 Waqas Ahmed , Sheeba Samuel , Kevin Coakley , Birgitta Koenig-Ries , Odd Erik Gundersen

Deep learning has enjoyed tremendous success in a variety of applications but its application to quantile regressions remains scarce. A major advantage of the deep learning approach is its flexibility to model complex data in a more…

Statistics Theory · Mathematics 2021-06-14 Qixian Zhong , Jane-Ling Wang

Data types that lie in metric spaces but not in vector spaces are difficult to use within the usual regression setting, either as the response and/or a predictor. We represent the information in these variables using distance matrices which…

Methodology · Statistics 2016-01-20 Julian Faraway

Evaluation metrics in machine learning are often hardly taken as loss functions, as they could be non-differentiable and non-decomposable, e.g., average precision and F1 score. This paper aims to address this problem by revisiting the…

Machine Learning · Computer Science 2022-03-01 Tao Huang , Zekang Li , Hua Lu , Yong Shan , Shusheng Yang , Yang Feng , Fei Wang , Shan You , Chang Xu

Class imbalance is a common problem in the case of real-world object detection and classification tasks. Data of some classes is abundant making them an over-represented majority, and data of other classes is scarce, making them an…

Computer Vision and Pattern Recognition · Computer Science 2017-03-24 Salman H. Khan , Munawar Hayat , Mohammed Bennamoun , Ferdous Sohel , Roberto Togneri