English
Related papers

Related papers: Semi-supervised learning in unmatched linear regre…

200 papers

Semi-supervised learning aims to learn prediction models from both labeled and unlabeled samples. There has been extensive research in this area. Among existing work, generative mixture models with Expectation-Maximization (EM) is a popular…

Machine Learning · Computer Science 2020-08-31 Wenchong He , Zhe Jiang

Sequential sensor data is generated in a wide variety of practical applications. A fundamental challenge involves learning effective classifiers for such sequential data. While deep learning has led to impressive performance gains in recent…

Machine Learning · Computer Science 2020-10-07 Nauman Ahad , Mark A. Davenport

To address semi-supervised learning from both labeled and unlabeled data, we present a novel meta-learning scheme. We particularly consider that labeled and unlabeled data share disjoint ground truth label sets, which can be seen tasks like…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Yun-Chun Chen , Chao-Te Chou , Yu-Chiang Frank Wang

In many semiparametric models that are parameterized by two types of parameters---a Euclidean parameter of interest and an infinite-dimensional nuisance parameter---the two parameters are bundled together, that is, the nuisance parameter is…

Statistics Theory · Mathematics 2012-03-13 Ying Ding , Bin Nan

We consider the problem of inference in a linear regression model in which the relative ordering of the input features and output labels is not known. Such datasets naturally arise from experiments in which the samples are shuffled or…

Machine Learning · Statistics 2018-04-04 Abubakar Abid , James Zou

In a broad range of classification and decision making problems, one is given the advice or predictions of several classifiers, of unknown reliability, over multiple questions or queries. This scenario is different from the standard…

Machine Learning · Statistics 2014-02-07 Fabio Parisi , Francesco Strino , Boaz Nadler , Yuval Kluger

Transmission line state assessment and prediction are of great significance for the rational formulation of operation and maintenance strategy and improvement of operation and maintenance level. Aiming at the problem that existing models…

Signal Processing · Electrical Eng. & Systems 2023-12-08 Sizhe Li , Xun Ma , Nan Liu , Yi Jin

Supervisory signals have the potential to make low-dimensional data representations, like those learned by mixture and topic models, more interpretable and useful. We propose a framework for training latent variable models that explicitly…

A common classification task situation is where one has a large amount of data available for training, but only a small portion is annotated with class labels. The goal of semi-supervised training, in this context, is to improve…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Zijian Hu , Zhengyu Yang , Xuefeng Hu , Ram Nevatia

Supervised learning from training data with imbalanced class sizes, a commonly encountered scenario in real applications such as anomaly/fraud detection, has long been considered a significant challenge in machine learning. Motivated by…

Machine Learning · Computer Science 2019-05-27 Yunru Liu , Tingran Gao , Haizhao Yang

We demonstrate how supervised learning can be decomposed into a two-stage procedure, where (1) all model parameters are selected in an unsupervised manner, and (2) the outputs y are added to the model, without changing the parameter values.…

Machine Learning · Statistics 2026-03-30 Oskar Allerbo , Thomas B. Schön

Consider the nonparametric logistic regression problem. In the logistic regression, we usually consider the maximum likelihood estimator, and the excess risk is the expectation of the Kullback-Leibler (KL) divergence between the true and…

Statistics Theory · Mathematics 2025-02-26 Atsutomo Yara , Yoshikazu Terada

We introduce two synthetic likelihood methods for Simulation-Based Inference (SBI), to conduct either amortized or targeted inference from experimental observations when a high-fidelity simulator is available. Both methods learn a…

Machine Learning · Computer Science 2023-04-19 Pierre Glaser , Michael Arbel , Samo Hromadka , Arnaud Doucet , Arthur Gretton

Contrastive learning methods enforce label distance relationships in feature space to improve representation capability for regression models. However, these methods highly depend on label information to correctly recover ordinal…

Machine Learning · Computer Science 2025-12-11 Ce Wang , Weihang Dai , Hanru Bai , Xiaomeng Li

In this work, we propose a deep learning-based method to perform semiparametric regression analysis for spatially dependent data. To be specific, we use a sparsely connected deep neural network with rectified linear unit (ReLU) activation…

Machine Learning · Statistics 2023-12-19 Kexuan Li , Jun Zhu , Anthony R. Ives , Volker C. Radeloff , Fangfang Wang

In unsupervised learning, dimensionality reduction is an important tool for data exploration and visualization. Because these aims are typically open-ended, it can be useful to frame the problem as looking for patterns that are enriched in…

Machine Learning · Statistics 2018-11-16 Kristen Severson , Soumya Ghosh , Kenney Ng

Learning with few labeled data has been a longstanding problem in the computer vision and machine learning research community. In this paper, we introduced a new semi-supervised learning framework, SimMatch, which simultaneously considers…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Mingkai Zheng , Shan You , Lang Huang , Fei Wang , Chen Qian , Chang Xu

In this work, we develop a joint sample discovery and iterative model evolution method for semi-supervised learning on very small labeled training sets. We propose a master-teacher-student model framework to provide multi-layer guidance…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Yang Li , Jianhe Yuan , Zhiqun Zhao , Hao Sun , Zhihai He

Distributional regression aims to find the best candidate in a given parametric family of conditional distributions to model a given dataset. As each candidate in the distribution family can be identified by the corresponding distribution…

Statistics Theory · Mathematics 2026-05-18 Gitte Kremling , Gerhard Dikta

We consider statistical inference under a semi-supervised setting where we have access to both a labeled dataset consisting of pairs $\{X_i, Y_i \}_{i=1}^n$ and an unlabeled dataset $\{ X_i \}_{i=n+1}^{n+N}$. We ask the question: under what…

Statistics Theory · Mathematics 2025-03-20 Zichun Xu , Daniela Witten , Ali Shojaie