English
Related papers

Related papers: InfoNCE: Identifying the Gap Between Theory and Pr…

200 papers

Contrastive Language-Image Pretraining (CLIP) stands out as a prominent method for image representation learning. Various neural architectures, spanning Transformer-based models like Vision Transformers (ViTs) to Convolutional Networks…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Cristian Rodriguez-Opazo , Edison Marrese-Taylor , Ehsan Abbasnejad , Hamed Damirchi , Ignacio M. Jara , Felipe Bravo-Marquez , Anton van den Hengel

Despite advancements in large language models (LLMs), non-factual responses still persist in fact-seeking question answering. Unlike extensive studies on post-hoc detection of these responses, this work studies non-factuality prediction…

Computation and Language · Computer Science 2025-08-19 Yanling Wang , Haoyang Li , Hao Zou , Jing Zhang , Xinlei He , Qi Li , Ke Xu

While the current state-of-the-art dense retrieval models exhibit strong out-of-domain generalization, they might fail to capture nuanced domain-specific knowledge. In principle, fine-tuning these models for specialized retrieval tasks…

Information Retrieval · Computer Science 2025-02-28 Manveer Singh Tamber , Suleman Kazi , Vivek Sourabh , Jimmy Lin

Given a pre-trained CNN without any testing samples, this paper proposes a simple yet effective method to diagnose feature representations of the CNN. We aim to discover representation flaws caused by potential dataset bias. More…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 Quanshi Zhang , Wenguan Wang , Song-Chun Zhu

Both uncertainty estimation and interpretability are important factors for trustworthy machine learning systems. However, there is little work at the intersection of these two areas. We address this gap by proposing a novel method for…

Machine Learning · Statistics 2021-03-19 Javier Antorán , Umang Bhatt , Tameem Adel , Adrian Weller , José Miguel Hernández-Lobato

Contemporary neural networks are limited in their ability to learn from evolving streams of training data. When trained sequentially on new or evolving tasks, their accuracy drops sharply, making them unsuitable for many real-world…

Computer Vision and Pattern Recognition · Computer Science 2021-02-19 Sudhanshu Mittal , Silvio Galesso , Thomas Brox

In causal inference, it is a fundamental task to estimate the causal effect from observational data. However, latent confounders pose major challenges in causal inference in observational data, for example, confounding bias and M-bias.…

Machine Learning · Computer Science 2023-12-12 Debo Cheng , Yang Xie , Ziqi Xu , Jiuyong Li , Lin Liu , Jixue Liu , Yinghao Zhang , Zaiwen Feng

Contrastive Language-Image Pre-training (CLIP) on large-scale image-caption datasets learns representations that can achieve remarkable zero-shot generalization. However, such models require a massive amount of pre-training data. Improving…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Siddharth Joshi , Arnav Jain , Ali Payani , Baharan Mirzasoleiman

Accessing information in learned representations is critical for annotation, discovery, and data filtering in disciplines where high-dimensional datasets are common. We introduce What We Don't C, a novel approach based on latent flow…

Artificial Intelligence · Computer Science 2026-03-12 Brian Rogers , Micah Bowles , Chris J. Lintott , Steve Croft , Oliver N. F. King , James Kostas Ray

Various contrastive learning approaches have been proposed in recent years and achieve significant empirical success. While effective and prevalent, contrastive learning has been less explored for time series data. A key component of…

In this paper we argue that, to its detriment, transparency research overlooks many foundational concepts of artificial intelligence. As an illustrating example we focus on uncertainty quantification in the context of counterfactual…

Machine Learning · Computer Science 2026-05-19 Kacper Sokol , Santo M. A. R. Thies , Eyke Hüllermeier

It is an ill-posed problem to recover the true scene colors from a color biased image by discounting the effects of scene illuminant and camera spectral sensitivity (CSS) at the same time. Most color constancy (CC) models have been designed…

Computer Vision and Pattern Recognition · Computer Science 2017-10-11 Shao-Bing Gao , Ming Zhang , Chao-Yi Li , Yong-Jie Li

Contrastive learning is a popular form of self-supervised learning that encourages augmentations (views) of the same input to have more similar representations compared to augmentations of different inputs. Recent attempts to theoretically…

Machine Learning · Computer Science 2022-03-01 Nikunj Saunshi , Jordan Ash , Surbhi Goel , Dipendra Misra , Cyril Zhang , Sanjeev Arora , Sham Kakade , Akshay Krishnamurthy

Recent results show that features of adversarially trained networks for classification, in addition to being robust, enable desirable properties such as invertibility. The latter property may seem counter-intuitive as it is widely accepted…

Machine Learning · Computer Science 2020-12-17 Matteo Terzi , Alessandro Achille , Marco Maggipinto , Gian Antonio Susto

Recommendation systems aim to predict users' feedback on items not exposed to them. Confounding bias arises due to the presence of unmeasured variables (e.g., the socio-economic status of a user) that can affect both a user's exposure and…

Machine Learning · Computer Science 2023-06-16 Qing Zhang , Xiaoying Zhang , Yang Liu , Hongning Wang , Min Gao , Jiheng Zhang , Ruocheng Guo

Contrastive learning, which aims at minimizing the distance between positive pairs while maximizing that of negative ones, has been widely and successfully applied in unsupervised feature learning, where the design of positive and negative…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Rui Zhu , Bingchen Zhao , Jingen Liu , Zhenglong Sun , Chang Wen Chen

In causal models, a given mechanism is assumed to be invariant to changes of other mechanisms. While this principle has been utilized for inference in settings where the causal variables are observed, theoretical insights when the variables…

Machine Learning · Statistics 2023-12-07 Simon Bing , Jonas Wahl , Urmi Ninad , Jakob Runge

Contrastive learning has demonstrated promising potential in recommender systems. Existing methods typically construct sparser views by randomly perturbing the original interaction graph, as they have no idea about the authentic user…

Information Retrieval · Computer Science 2025-12-19 Xufeng Liang , Zhida Qin , Chong Zhang , Tianyu Huang , Gangyi Ding

Data augmentation is a widely adopted technique for avoiding overfitting when training deep neural networks. However, this approach requires domain-specific knowledge and is often limited to a fixed set of hard-coded transformations.…

Machine Learning · Statistics 2021-08-19 Oguz Kaan Yuksel , Sebastian U. Stich , Martin Jaggi , Tatjana Chavdarova

Synthetic datasets are often used to pretrain end-to-end optical flow networks, due to the lack of a large amount of labeled, real-scene data. But major drops in accuracy occur when moving from synthetic to real scenes. How do we better…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Zhiqi Zhang , Nitin Bansal , Changjiang Cai , Pan Ji , Qingan Yan , Xiangyu Xu , Yi Xu
‹ Prev 1 8 9 10 Next ›