English
Related papers

Related papers: Measuring the Interpretability of Unsupervised Rep…

200 papers

Developing inherently interpretable models for prediction has gained prominence in recent years. A subclass of these models, wherein the interpretable network relies on learning high-level concepts, are valued because of closeness of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Jayneel Parekh , Quentin Bouniot , Pavlo Mozharovskyi , Alasdair Newson , Florence d'Alché-Buc

Unsupervised learning methods based on contrastive learning have drawn increasing attention and achieved promising results. Most of them aim to learn representations invariant to instance-level variations, which are provided by different…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Feng Wang , Huaping Liu , Di Guo , Fuchun Sun

We address the problem of learning self-supervised representations from unlabeled image collections. Unlike existing approaches that attempt to learn useful features by maximizing similarity between augmented versions of each input image or…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Omiros Pantazis , Gabriel Brostow , Kate Jones , Oisin Mac Aodha

Self-supervised learning (SSL) is a scalable way to learn general visual representations since it learns without labels. However, large-scale unlabeled datasets in the wild often have long-tailed label distributions, where we know little…

Machine Learning · Computer Science 2022-05-24 Hong Liu , Jeff Z. HaoChen , Adrien Gaidon , Tengyu Ma

Probing and enhancing large language models' reasoning capacity remains a crucial open question. Here we re-purpose the reverse dictionary task as a case study to probe LLMs' capacity for conceptual inference. We use in-context learning to…

Computation and Language · Computer Science 2024-02-27 Ningyu Xu , Qi Zhang , Menghan Zhang , Peng Qian , Xuanjing Huang

As large language models are increasingly deployed for clinical text, ensuring they can reliably signal their own uncertainty becomes critical. Most existing uncertainty quantification (UQ) methods are designed for open-domain generation…

Computation and Language · Computer Science 2026-05-28 Bushi Xiao , Sarvesh Soni , Daisy Zhe Wang

Deep neural networks can model images with rich latent representations, but they cannot naturally conceptualize structures of object categories in a human-perceptible way. This paper addresses the problem of learning object structures in an…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Yuting Zhang , Yijie Guo , Yixin Jin , Yijun Luo , Zhiyuan He , Honglak Lee

Concept discovery is one of the open problems in the interpretability literature that is important for bridging the gap between non-deep learning experts and model end-users. Among current formulations, concepts defines them by as a…

Machine Learning · Computer Science 2022-02-11 Adrianna Janik , Kris Sankaran

Computer vision in agriculture is game-changing with its ability to transform farming into a data-driven, precise, and sustainable industry. Deep learning has empowered agriculture vision to analyze vast, complex visual data, but heavily…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Sudhir Sornapudi , Rajhans Singh

Linear probing (LP) (and $k$-NN) on the upstream dataset with labels (e.g., ImageNet) and transfer learning (TL) to various downstream datasets are commonly employed to evaluate the quality of visual representations learned via…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Jae-Hun Lee , Doyoung Yoon , ByeongMoon Ji , Kyungyul Kim , Sangheum Hwang

Recently, contrastive learning has been shown to be effective in improving pre-trained language models (PLM) to derive high-quality sentence representations. It aims to pull close positive examples to enhance the alignment while push apart…

Computation and Language · Computer Science 2022-05-03 Kun Zhou , Beichen Zhang , Wayne Xin Zhao , Ji-Rong Wen

Relation extraction (RE) plays an important role in extracting knowledge from unstructured text but requires a large amount of labeled corpus. To reduce the expensive annotation efforts, semisupervised learning aims to leverage both labeled…

Computation and Language · Computer Science 2021-03-16 Yusen Lin

Numerous approaches have been recently proposed for learning fair representations that mitigate unfair outcomes in prediction tasks. A key motivation for these methods is that the representations can be used by third parties with unknown…

Machine Learning · Computer Science 2024-06-25 Tianhao Wang , Zana Buçinca , Zilin Ma

Self-supervised learning offers an efficient way of extracting rich representations from various types of unlabeled data while avoiding the cost of annotating large-scale datasets. This is achievable by designing a pretext task to form…

Machine Learning · Computer Science 2023-10-11 Pouya Mehralian , Bagher BabaAli , Ashena Gorgan Mohammadi

Recent advancements in self-supervised learning (SSL) made it possible to learn generalizable visual representations from unlabeled data. The performance of Deep Learning models fine-tuned on pretrained SSL representations is on par with…

Machine Learning · Computer Science 2021-09-21 Atharva Tendle , Mohammad Rashedul Hasan

While supervised learning models have shown remarkable performance in various natural language processing (NLP) tasks, their success heavily relies on the availability of large-scale labeled datasets, which can be costly and time-consuming…

Computation and Language · Computer Science 2024-06-04 Wrick Talukdar , Anjanava Biswas

Although unsupervised person re-identification (RE-ID) has drawn increasing research attentions due to its potential to address the scalability problem of supervised RE-ID models, it is very challenging to learn discriminative information…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Hong-Xing Yu , Wei-Shi Zheng , Ancong Wu , Xiaowei Guo , Shaogang Gong , Jian-Huang Lai

Unsupervised visual representation learning remains a largely unsolved problem in computer vision research. Among a big body of recently proposed approaches for unsupervised learning of visual representations, a class of self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2019-01-28 Alexander Kolesnikov , Xiaohua Zhai , Lucas Beyer

Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark…

Machine Learning · Computer Science 2019-05-28 Jiaxing Wang , Yin Zheng , Xiaoshuang Chen , Junzhou Huang , Jian Cheng

Representation learning approaches typically rely on images of objects captured from a single perspective that are transformed using affine transformations. Additionally, self-supervised learning, a successful paradigm of representation…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Omiros Pantazis , Mathew Salvaris