English
Related papers

Related papers: Sparse joint shift in multinomial classification

200 papers

One crucial objective of multi-task learning is to align distributions across tasks so that the information between them can be transferred and shared. However, existing approaches only focused on matching the marginal feature distribution…

Machine Learning · Computer Science 2021-03-04 Fan Zhou , Brahim Chaib-draa , Boyu Wang

Unsupervised models can provide supplementary soft constraints to help classify new target data under the assumption that similar objects in the target set are more likely to share the same class label. Such models can also help detect…

Machine Learning · Computer Science 2015-03-13 Ayan Acharya , Eduardo R. Hruschka , Joydeep Ghosh , Badrul Sarwar , Jean-David Ruvini

We consider (nonparametric) sparse (generalized) additive models (SpAM) for classification. The design of a SpAM classifier is based on minimizing the logistic loss with a sparse group Lasso/Slope-type penalties on the coefficients of…

Statistics Theory · Mathematics 2024-05-16 Felix Abramovich

Distribution regression refers to the supervised learning problem where labels are only available for groups of inputs instead of individual inputs. In this paper, we develop a rigorous mathematical framework for distribution regression…

Machine Learning · Computer Science 2021-09-30 Maud Lemercier , Cristopher Salvi , Theodoros Damoulas , Edwin V. Bonilla , Terry Lyons

Support-query shift few-shot learning aims to classify unseen examples (query set) to labeled data (support set) based on the learned embedding in a low-dimensional space under a distribution shift between the support set and the query set.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Siyang Jiang , Rui Fang , Hsi-Wen Chen , Wei Ding , Ming-Syan Chen

Conformal prediction has recently emerged as a promising strategy for quantifying the uncertainty of a predictive model; these algorithms modify the model to output sets of labels that are guaranteed to contain the true label with high…

Machine Learning · Computer Science 2025-03-11 Botong Zhang , Shuo Li , Osbert Bastani

In the high-dimensional sparse modeling literature, it has been crucially assumed that the sparsity structure of the model is homogeneous over the entire population. That is, the identities of important regressors are invariant across the…

Methodology · Statistics 2014-11-20 Sokbae Lee , Yuan Liao , Myung Hwan Seo , Youngki Shin

A common assumption in semi-supervised learning is that the labeled, unlabeled, and test data are drawn from the same distribution. However, this assumption is not satisfied in many applications. In many scenarios, the data is collected…

Information Theory · Computer Science 2022-02-25 Gholamali Aminian , Mahed Abroshan , Mohammad Mahdi Khalili , Laura Toni , Miguel R. D. Rodrigues

Corrupted data sets containing noisy or missing observations are prevalent in various contemporary applications such as economics, finance and bioinformatics. Despite the recent methodological and algorithmic advances in high-dimensional…

Methodology · Statistics 2020-05-12 J. Wu , Z. Zheng , Y. Li , Y. Zhang

The predicament in semi-supervised few-shot learning (SSFSL) is to maximize the value of the extra unlabeled data to boost the few-shot learner. In this paper, we propose a Poisson Transfer Network (PTN) to mine the unlabeled information…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Huaxi Huang , Junjie Zhang , Jian Zhang , Qiang Wu , Chang Xu

Collaboration between different data centers is often challenged by heterogeneity across sites. To account for the heterogeneity, the state-of-the-art method is to re-weight the covariate distributions in each site to match the distribution…

Machine Learning · Statistics 2024-04-25 Tianyu Guo , Sai Praneeth Karimireddy , Michael I. Jordan

Typical causal effects are defined based on the marginal distribution of potential outcomes. However, many real-world applications require causal estimands involving the joint distribution of potential outcomes to enable more nuanced…

Methodology · Statistics 2026-04-17 Peng Wu , Xiaojie Mao

Determining spatial distributions of species and communities are key objectives of ecology and conservation. Joint species distribution models use multi-species detection-nondetection data to estimate species and community distributions.…

Applications · Statistics 2022-12-15 Jeffrey W. Doser , Andrew O. Finley , Sudipto Banerjee

Time-series representation learning can extract representations from data with temporal dynamics and sparse labels. When labeled data are sparse but unlabeled data are abundant, contrastive learning, i.e., a framework to learn a latent…

Machine Learning · Computer Science 2023-03-03 Heejeong Choi , Pilsung Kang

This work addresses the problem of high-dimensional classification by exploring the generalized Bayesian logistic regression method under a sparsity-inducing prior distribution. The method involves utilizing a fractional power of the…

Statistics Theory · Mathematics 2024-03-20 The Tien Mai

In this paper we develop a novel approach for estimating large and sparse dynamic factor models using variational inference, also allowing for missing data. Inspired by Bayesian variable selection, we apply slab-and-spike priors onto the…

Methodology · Statistics 2022-10-14 Erik Spånberg

Significant progress has been witnessed in learning-based Multi-view Stereo (MVS) under supervised and unsupervised settings. To combine their respective merits in accuracy and completeness, meantime reducing the demand for expensive…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Hongbin Xu , Weitao Chen , Yang Liu , Zhipeng Zhou , Haihong Xiao , Baigui Sun , Xuansong Xie , Wenxiong Kang

In recent years there is a surge of interest in applying distant supervision (DS) to automatically generate training data for relation extraction (RE). In this paper, we study the problem what limits the performance of DS-trained neural…

Computation and Language · Computer Science 2019-09-11 Qinyuan Ye , Liyuan Liu , Maosen Zhang , Xiang Ren

Suppose that the only available information in a multi-class problem are expert estimates of the conditional probabilities of occurrence for a set of binary features. The aim is to select a subset of features to be measured in subsequent…

Artificial Intelligence · Computer Science 2012-07-19 Ludmila Kuncheva , C. Whitaker , P. Cockcroft , Z. S. Hoare

Mixup is a highly successful technique to improve generalization of neural networks by augmenting the training data with combinations of random pairs. Selective mixup is a family of methods that apply mixup to specific pairs, e.g. only…

Machine Learning · Computer Science 2023-06-06 Damien Teney , Jindong Wang , Ehsan Abbasnejad