English
Related papers

Related papers: Generalization properties of contrastive world mod…

200 papers

Recently, Barbu et al introduced a dataset called ObjectNet which includes objects in daily life situations. They showed a dramatic performance drop of the state of the art object recognition models on this dataset. Due to the importance…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Ali Borji

In this paper, we study the problem of unsupervised object segmentation from single images. We do not introduce a new algorithm, but systematically investigate the effectiveness of existing unsupervised models on challenging real-world…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Yafei Yang , Bo Yang

To detect distribution shifts and improve model safety, many out-of-distribution (OOD) detection methods rely on the predictive uncertainty or features of supervised models trained on in-distribution data. In this paper, we critically…

Machine Learning · Computer Science 2025-07-03 Yucen Lily Li , Daohan Lu , Polina Kirichenko , Shikai Qiu , Tim G. J. Rudner , C. Bayan Bruss , Andrew Gordon Wilson

Machine learning models often suffer from catastrophic forgetting of previously learned knowledge when learning new classes. Various methods have been proposed to mitigate this issue. However, rehearsal-based learning, which retains samples…

Machine Learning · Computer Science 2024-10-10 Hossein Rezaei , Mohammad Sabokrou

The performance of existing underwater object detection methods degrades seriously when facing domain shift caused by complicated underwater environments. Due to the limitation of the number of domains in the dataset, deep detectors easily…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Yang Chen , Pinhao Song , Hong Liu , Linhui Dai , Xiaochuan Zhang , Runwei Ding , Shengquan Li

Achieving visual reasoning is a long-term goal of artificial intelligence. In the last decade, several studies have applied deep neural networks (DNNs) to the task of learning visual relations from images, with modest results in terms of…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Guillermo Puebla , Jeffrey S. Bowers

One of the primary challenges limiting the applicability of deep learning is its susceptibility to learning spurious correlations rather than the underlying mechanisms of the task of interest. The resulting failure to generalise cannot be…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Damien Teney , Ehsan Abbasnedjad , Anton van den Hengel

Generalization of models to out-of-distribution (OOD) data has captured tremendous attention recently. Specifically, compositional generalization, i.e., whether a model generalizes to new structures built of components observed during…

Computation and Language · Computer Science 2020-10-13 Inbar Oren , Jonathan Herzig , Nitish Gupta , Matt Gardner , Jonathan Berant

As counterfactual examples become increasingly popular for explaining decisions of deep learning models, it is essential to understand what properties quantitative evaluation metrics do capture and equally important what they do not…

Machine Learning · Computer Science 2021-11-02 Frederik Hvilshøj , Alexandros Iosifidis , Ira Assent

World models aim to capture the dynamics of the environment, enabling agents to predict and plan for future states. In most scenarios of interest, the dynamics are highly centered on interactions among objects within the environment. This…

Machine Learning · Computer Science 2025-07-08 Zizhao Wang , Kaixin Wang , Li Zhao , Peter Stone , Jiang Bian

Human perception of the empirical world involves recognizing the diverse appearances, or 'modalities', of underlying objects. Despite the longstanding consideration of this perspective in philosophy and cognitive science, the study of…

Machine Learning · Computer Science 2023-12-19 Zhou Lu

The objective of this work is to learn an object-centric video representation, with the aim of improving transferability to novel tasks, i.e., tasks different from the pre-training task of action classification. To this end, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Chuhan Zhang , Ankush Gupta , Andrew Zisserman

The standard approach to contrastive learning is to maximize the agreement between different views of the data. The views are ordered in pairs, such that they are either positive, encoding different views of the same object, or negative,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Artem Moskalev , Ivan Sosnovik , Volker Fischer , Arnold Smeulders

Predictive models that generalize well under distributional shift are often desirable and sometimes crucial to building robust and reliable machine learning applications. We focus on distributional shift that arises in causal inference from…

Machine Learning · Statistics 2018-02-27 Fredrik D. Johansson , Nathan Kallus , Uri Shalit , David Sontag

Open Set Recognition (OSR) extends image classification to an open-world setting, by simultaneously classifying known classes and identifying unknown ones. While conventional OSR approaches can detect Out-of-Distribution (OOD) samples, they…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Piyapat Saranrittichai , Chaithanya Kumar Mummadi , Claudia Blaiotta , Mauricio Munoz , Volker Fischer

Object proposal has become a popular paradigm to replace exhaustive sliding window search in current top-performing methods in PASCAL VOC and ImageNet. Recently, Hosang et al. conduct the first unified study of existing methods' in terms of…

Computer Vision and Pattern Recognition · Computer Science 2015-07-17 Hongyuan Zhu , Shijian Lu , Jianfei Cai , Quangqing Lee

Neural networks trained with SGD were recently shown to rely preferentially on linearly-predictive features and can ignore complex, equally-predictive ones. This simplicity bias can explain their lack of robustness out of distribution…

Machine Learning · Computer Science 2022-09-13 Damien Teney , Ehsan Abbasnejad , Simon Lucey , Anton van den Hengel

Detecting Out-of-Domain (OOD) or unknown intents from user queries is essential in a task-oriented dialog system. A key challenge of OOD detection is to learn discriminative semantic features. Traditional cross-entropy loss only focuses on…

Computation and Language · Computer Science 2021-06-01 Zhiyuan Zeng , Keqing He , Yuanmeng Yan , Zijun Liu , Yanan Wu , Hong Xu , Huixing Jiang , Weiran Xu

Contrastive learning is commonly used as a method of self-supervised learning with the "anchor" and "positive" being two random augmentations of a given input image, and the "negative" is the set of all other images. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Rishab Balasubramanian , Kunal Rathore

Building models of the world from observation, i.e., induction, is one of the major challenges in machine learning. In order to be useful, models need to maintain accuracy when used in novel situations, i.e., generalize. In addition, they…

Machine Learning · Computer Science 2026-02-10 Gabriel Stella , Dmitri Loguinov