English
Related papers

Related papers: Contrastive inverse regression for dimension reduc…

200 papers

The covariate shift is a challenging problem in supervised learning that results from the discrepancy between the training and test distributions. An effective approach which recently drew a considerable attention in the research community…

Machine Learning · Computer Science 2013-11-27 Yun-Qian Miao , Ahmed K. Farahat , Mohamed S. Kamel

Unsupervised Re-ID methods aim at learning robust and discriminative features from unlabeled data. However, existing methods often ignore the relationship between module parameters of Re-ID framework and feature distributions, which may…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Ziqi He , Mengjia Xue , Yunhao Du , Zhicheng Zhao , Fei Su

Single Image Super-Resolution (SISR) is one of the low-level computer vision problems that has received increased attention in the last few years. Current approaches are primarily based on harnessing the power of deep learning models and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Santiago López-Tapia , Nicolás Pérez de la Blanca

Cross-domain recommendation (CDR), aiming to extract and transfer knowledge across domains, has attracted wide attention for its efficacy in addressing data sparsity and cold-start problems. Despite significant advances in representation…

Information Retrieval · Computer Science 2024-04-02 Luankang Zhang , Hao Wang , Suojuan Zhang , Mingjia Yin , Yongqiang Han , Jiaqing Zhang , Defu Lian , Enhong Chen

Sufficient dimension reduction [J. Amer. Statist. Assoc. 86 (1991) 316-342] has long been a prominent issue in multivariate nonparametric regression analysis. To uncover the central dimension reduction space, we propose in this paper an…

Statistics Theory · Mathematics 2014-08-15 Efang Kong , Yingcun Xia

We focus on controllable disentangled representation learning (C-Dis-RL), where users can control the partition of the disentangled latent space to factorize dataset attributes (concepts) for downstream tasks. Two general problems remain…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Yunhao Ge , Zhi Xu , Yao Xiao , Gan Xin , Yunkui Pang , Laurent Itti

The success of supervised learning hinges on the assumption that the training and test data come from the same underlying distribution, which is often not valid in practice due to potential distribution shift. In light of this, most…

Machine Learning · Computer Science 2021-04-06 Bo Li , Yezhen Wang , Shanghang Zhang , Dongsheng Li , Trevor Darrell , Kurt Keutzer , Han Zhao

Supervised dictionary learning (SDL) is a classical machine learning method that simultaneously seeks feature extraction and classification tasks, which are not necessarily a priori aligned objectives. The goal of SDL is to learn a…

Machine Learning · Statistics 2022-06-15 Joowon Lee , Hanbaek Lyu , Weixin Yao

Dimensionality reduction (DR) is frequently used for analyzing and visualizing high-dimensional data as it provides a good first glance of the data. However, to interpret the DR result for gaining useful insights from the data, it would…

Machine Learning · Computer Science 2019-10-16 Takanori Fujiwara , Oh-Hyun Kwon , Kwan-Liu Ma

As natural language interfaces enable users to express increasingly complex natural language queries, there is a parallel explosion of user review content that can allow users to better find items such as restaurants, books, or movies that…

Distribution Regression (DR) on stochastic processes describes the learning task of regression on collections of time series. Path signatures, a technique prevalent in stochastic analysis, have been used to solve the DR problem. Recent…

Machine Learning · Computer Science 2024-10-15 Andrew Alden , Carmine Ventre , Blanka Horvath

Linear dimensionality reduction methods are a cornerstone of analyzing high dimensional data, due to their simple geometric interpretations and typically attractive computational properties. These methods capture many data features of…

Machine Learning · Statistics 2016-03-22 John P. Cunningham , Zoubin Ghahramani

Dimensionality reduction (DR) plays a vital role in the visual analysis of high-dimensional data. One main aim of DR is to reveal hidden patterns that lie on intrinsic low-dimensional manifolds. However, DR often overlooks important…

Machine Learning · Computer Science 2023-02-28 Takanori Fujiwara , Yun-Hsin Kuo , Anders Ynnerman , Kwan-Liu Ma

Contrastive learning (CL) methods effectively learn data representations in a self-supervision manner, where the encoder contrasts each positive sample over multiple negative samples via a one-vs-many softmax cross-entropy loss. By…

Machine Learning · Computer Science 2023-08-16 Huangjie Zheng , Xu Chen , Jiangchao Yao , Hongxia Yang , Chunyuan Li , Ya Zhang , Hao Zhang , Ivor Tsang , Jingren Zhou , Mingyuan Zhou

This article concerns the dimension reduction in regression for large data set. We introduce a new method based on the sliced inverse regression approach, called cluster-based regularized sliced inverse regression. Our method not only keeps…

Applications · Statistics 2013-12-03 Yue Yu , Zhihong Chen , Jie Yang

The success of deep learning is usually accompanied by the growth in neural network depth. However, the traditional training method only supervises the neural network at its last layer and propagates the supervision layer-by-layer, which…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Linfeng Zhang , Xin Chen , Junbo Zhang , Runpei Dong , Kaisheng Ma

Dimensionality reduction (DR) on the manifold includes effective methods which project the data from an implicit relational space onto a vectorial space. Regardless of the achievements in this area, these algorithms suffer from the lack of…

Machine Learning · Computer Science 2019-09-23 Babak Hosseini , Barbara Hammer

Convolutional neural networks (CNNs) are highly successful for super-resolution (SR) but often require sophisticated architectures with heavy memory cost and computational overhead, significantly restricts their practical deployments on…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Yanbo Wang , Shaohui Lin , Yanyun Qu , Haiyan Wu , Zhizhong Zhang , Yuan Xie , Angela Yao

Contrastive learning applied to self-supervised representation learning has seen a resurgence in recent years, leading to state of the art performance in the unsupervised training of deep image models. Modern batch contrastive approaches…

Machine Learning · Computer Science 2021-03-12 Prannay Khosla , Piotr Teterwak , Chen Wang , Aaron Sarna , Yonglong Tian , Phillip Isola , Aaron Maschinot , Ce Liu , Dilip Krishnan

Individualized treatment regimes (ITRs) aim to improve clinical outcomes by assigning treatment based on patient-specific characteristics. However, existing methods often struggle with high-dimensional covariates, limiting accuracy,…

Machine Learning · Statistics 2026-01-13 Sungtaek Son , Eardi Lila , Kwun Chuen Gary Chan