English
Related papers

Related papers: Training Under Attentional Competition Produces Pe…

200 papers

We investigate attention as the active pursuit of useful information. This contrasts with attention as a mechanism for the attenuation of irrelevant information. We also consider the role of short-term memory, whose use is critical to any…

Machine Learning · Computer Science 2015-11-02 Philip Bachman , David Krueger , Doina Precup

This study provides a new understanding of the adversarial attack problem by examining the correlation between adversarial attack and visual attention change. In particular, we observed that: (1) images with incomplete attention regions are…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Shangxi Wu , Jitao Sang , Kaiyuan Xu , Jiaming Zhang , Jian Yu

The salience of reference points may theoretically influence the loss aversion mechanism in effort provision. However, we still lack a direct test from real competitive settings that uses exogenous variation to measure the effect of…

General Economics · Economics 2025-11-03 Alex Krumer , Felix Otto , Tim Pawlowski

Contrastive learning is a popular form of self-supervised learning that encourages augmentations (views) of the same input to have more similar representations compared to augmentations of different inputs. Recent attempts to theoretically…

Machine Learning · Computer Science 2022-03-01 Nikunj Saunshi , Jordan Ash , Surbhi Goel , Dipendra Misra , Cyril Zhang , Sanjeev Arora , Sham Kakade , Akshay Krishnamurthy

Contrastive representation learning has gained much attention due to its superior performance in learning representations from both image and sequential data. However, the learned representations could potentially lead to performance…

Computation and Language · Computer Science 2022-11-01 Jianfeng Chi , William Shand , Yaodong Yu , Kai-Wei Chang , Han Zhao , Yuan Tian

Post-training has greatly improved reasoning in frontier vision-language models, yet its gains for perception remain comparatively limited, creating a bottleneck for end-to-end visual reasoning. To investigate this gap, we introduce a…

Computation and Language · Computer Science 2026-05-29 Xueqing Wu , Yu-Chi Lin , Kai-Wei Chang , Nanyun Peng

Although attention mechanisms have been applied to a variety of deep learning models and have been shown to improve the prediction performance, it has been reported to be vulnerable to perturbations to the mechanism. To overcome the…

Computation and Language · Computer Science 2022-11-23 Shunsuke Kitada , Hitoshi Iyatomi

Tournaments are frequently used incentive mechanisms to enhance performance. In this paper, we use field data and show that skill disparities among contestants asymmetrically affect the performance of contestants. Skill disparities have…

General Economics · Economics 2024-10-29 Enzo Brox , Daniel Goller

Adversarial training is a common approach for bias mitigation in natural language processing. Although most work on debiasing is motivated by equal opportunity, it is not explicitly captured in standard adversarial training. In this paper,…

Computation and Language · Computer Science 2022-05-17 Xudong Han , Timothy Baldwin , Trevor Cohn

When conflicting images are presented to either eye, binocular fusion is disrupted. Rather than experiencing a blend of both percepts, often only one eye's image is experienced, whilst the other is suppressed from awareness. Importantly,…

The tendency of repeating past choices more often than expected from the history of outcomes has been repeatedly empirically observed in reinforcement learning experiments. It can be explained by at least two computational processes:…

Neural and Evolutionary Computing · Computer Science 2024-10-28 Isabelle Hoxha , Leo Sperber , Stefano Palminteri

A prominent technique for self-supervised representation learning has been to contrast semantically similar and dissimilar pairs of samples. Without access to labels, dissimilar (negative) points are typically taken to be randomly sampled…

Machine Learning · Computer Science 2020-10-22 Ching-Yao Chuang , Joshua Robinson , Lin Yen-Chen , Antonio Torralba , Stefanie Jegelka

Contrastive self-supervised learning (CSL) has managed to match or surpass the performance of supervised learning in image and video classification. However, it is still largely unknown if the nature of the representations induced by the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Rohit Gupta , Naveed Akhtar , Ajmal Mian , Mubarak Shah

Human visual perception is a complex, dynamic and fluctuating process. In addition to the incoming visual stimulus, it is affected by many other factors including temporal context, both external and internal to the observer. In this study…

Neurons and Cognition · Quantitative Biology 2020-07-01 Urit Gordon , Shimon Marom , Naama Brenner

Self-supervision allows learning meaningful representations of natural images, which usually contain one central object. How well does it transfer to multi-entity scenes? We discuss key aspects of learning structured object-centric…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Federico Baldassarre , Hossein Azizpour

Existing approaches for unsupervised metric learning focus on exploring self-supervision information within the input image itself. We observe that, when analyzing images, human eyes often compare images against each other instead of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Yang Li , Shichao Kan , Zhihai He

Computer vision models learn to perform a task by capturing relevant statistics from training data. It has been shown that models learn spurious age, gender, and race correlations when trained for seemingly unrelated tasks like activity…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Zeyu Wang , Klint Qinami , Ioannis Christos Karakozis , Kyle Genova , Prem Nair , Kenji Hata , Olga Russakovsky

Cross-modal attention mechanisms have been widely applied to the image-text matching task and have achieved remarkable improvements thanks to its capability of learning fine-grained relevance across different modalities. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Yuxiao Chen , Jianbo Yuan , Long Zhao , Tianlang Chen , Rui Luo , Larry Davis , Dimitris N. Metaxas

Presence of bias (in datasets or tasks) is inarguably one of the most critical challenges in machine learning applications that has alluded to pivotal debates in recent years. Such challenges range from spurious associations between…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Ehsan Adeli , Qingyu Zhao , Adolf Pfefferbaum , Edith V. Sullivan , Li Fei-Fei , Juan Carlos Niebles , Kilian M. Pohl

Neural networks have a number of shortcomings. Amongst the severest ones is the sensitivity to distribution shifts which allows models to be easily fooled into wrong predictions by small perturbations to inputs that are often imperceivable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Paul Gavrikov , Janis Keuper , Margret Keuper