English
Related papers

Related papers: Contrastive Reasoning in Neural Networks

200 papers

Conventional works that learn grasping affordance from demonstrations need to explicitly predict grasping configurations, such as gripper approaching angles or grasping preshapes. Classic motion planners could then sample trajectories by…

Robotics · Computer Science 2021-08-17 Yantian Zha , Siddhant Bhambri , Lin Guan

Reasoning is an essential part of human intelligence and thus has been a long-standing goal in artificial intelligence research. With the recent success of deep learning, incorporating reasoning with deep learning systems, i.e.,…

Artificial Intelligence · Computer Science 2021-10-19 Hikaru Shindo , Devendra Singh Dhami , Kristian Kersting

Deep-predictive-coding networks (DPCNs) are hierarchical, generative models. They rely on feed-forward and feed-back connections to modulate latent feature representations of stimuli in a dynamic and context-sensitive manner. A crucial…

Artificial Intelligence · Computer Science 2021-09-27 Isaac J. Sledge , Jose C. Principe

Contrastive learning has led to substantial improvements in the quality of learned embedding representations for tasks such as image classification. However, a key drawback of existing contrastive augmentation methods is that they may lead…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Zhibo Zhang , Jongseong Jang , Chiheb Trabelsi , Ruiwen Li , Scott Sanner , Yeonjeong Jeong , Dongsub Shim

Contrastive learning has proven instrumental in learning unbiased representations of data, especially in complex environments characterized by high-cardinality and high-dimensional sensitive information. However, existing approaches within…

Machine Learning · Computer Science 2024-11-25 Stefan K. Nielsen , Tan M. Nguyen

Reason and inference require process as well as memory skills by humans. Neural networks are able to process tasks like image recognition (better than humans) but in memory aspects are still limited (by attention mechanism, size). Recurrent…

Machine Learning · Computer Science 2017-03-03 Amit Sahu

While deep feature learning has revolutionized techniques for static-image understanding, the same does not quite hold for video processing. Architectures and optimization techniques used for video are largely based off those for static…

Computer Vision and Pattern Recognition · Computer Science 2017-12-13 Achal Dave , Olga Russakovsky , Deva Ramanan

Artificial Neural Networks are connectionist systems that perform a given task by learning on examples without having prior knowledge about the task. This is done by finding an optimal point estimate for the weights in every node.…

Machine Learning · Computer Science 2019-01-10 Kumar Shridhar , Felix Laumann , Marcus Liwicki

Contrastive learning is a powerful framework for learning self-supervised representations that generalize well to downstream supervised tasks. We show that multiple existing contrastive learning methods can be reinterpreted as learning…

Machine Learning · Computer Science 2023-02-16 Daniel D. Johnson , Ayoub El Hanchi , Chris J. Maddison

The regression of a functional response on a set of scalar predictors can be a challenging task, especially if there is a large number of predictors, or the relationship between those predictors and the response is nonlinear. In this work,…

Machine Learning · Statistics 2023-08-24 Sidi Wu , Cédric Beaulac , Jiguo Cao

An important goal in visual recognition is to devise image representations that are invariant to particular transformations. In this paper, we address this goal with a new type of convolutional neural network (CNN) whose invariance is…

Computer Vision and Pattern Recognition · Computer Science 2015-01-08 Julien Mairal , Piotr Koniusz , Zaid Harchaoui , Cordelia Schmid

We introduce a new neural architecture for solving visual abstract reasoning tasks inspired by human cognition, specifically by observations that human abstract reasoning often interleaves perceptual and conceptual processing as part of a…

Artificial Intelligence · Computer Science 2023-10-23 Yuan Yang , Deepayan Sanyal , James Ainooson , Joel Michelson , Effat Farhana , Maithilee Kunda

Neural networks are prone to learning shortcuts -- they often model simple correlations, ignoring more complex ones that potentially generalize better. Prior works on image classification show that instead of learning a connection to object…

Machine Learning · Computer Science 2021-01-18 Axel Sauer , Andreas Geiger

We introduce provenance networks, a novel class of neural models designed to provide end-to-end, training-data-driven explainability. Unlike conventional post-hoc methods, provenance networks learn to link each prediction directly to its…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Ali Kayyam , Anusha Madan Gopal , M. Anthony Lewis

With the ongoing development of deep learning, an increasing number of AI models have surpassed the performance levels of human clinical practitioners. However, the prevalence of AI diagnostic products in actual clinical practice remains…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Chenglong Wang , Yinqiao Yi , Yida Wang , Chengxiu Zhang , Yun Liu , Kensaku Mori , Mei Yuan , Guang Yang

We present a method for neural network interpretability by combining feature attribution with counterfactual explanations to generate attribution maps that highlight the most discriminative features between pairs of classes. We show that…

Machine Learning · Computer Science 2021-09-29 Nils Eckstein , Alexander S. Bates , Gregory S. X. E. Jefferis , Jan Funke

In human perception and cognition, a fundamental operation that brains perform is interpretation: constructing coherent neural states from noisy, incomplete, and intrinsically ambiguous evidence. The problem of interpretation is well…

Machine Learning · Computer Science 2019-09-30 Michael Iuzzolino , Yoram Singer , Michael C. Mozer

We focus on the robustness of neural networks for classification. To permit a fair comparison between methods to achieve robustness, we first introduce a standard based on the mensuration of a classifier's degradation. Then, we propose…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Sadaf Gulshad , Arnold Smeulders

This paper addresses the task of set prediction using deep feed-forward neural networks. A set is a collection of elements which is invariant under permutation and the size of a set is not fixed in advance. Many real-world problems, such as…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Hamid Rezatofighi , Tianyu Zhu , Roman Kaskman , Farbod T. Motlagh , Qinfeng Shi , Anton Milan , Daniel Cremers , Laura Leal-Taixé , Ian Reid

Modeling uncertainty in deep neural networks, despite recent important advances, is still an open problem. Bayesian neural networks are a powerful solution, where the prior over network weights is a design choice, often a normal…

Machine Learning · Statistics 2019-10-29 Raanan Y. Rohekar , Yaniv Gurwicz , Shami Nisimov , Gal Novik