English
Related papers

Related papers: What Makes a Good Example? Modeling Exemplar Selec…

200 papers

Though neural network models demonstrate impressive performance, we do not understand exactly how these black-box models make individual predictions. This drawback has led to substantial research devoted to understand these models in areas…

Machine Learning · Computer Science 2020-01-10 Serena Booth , Ankit Shah , Yilun Zhou , Julie Shah

Representation learning aims to extract meaningful lower-dimensional embeddings from data, known as representations. Despite its widespread application, there is no established definition of a ``good'' representation. Typically, the…

Machine Learning · Computer Science 2024-12-05 Mahalakshmi Sabanayagam , Omar Al-Dabooni , Pascal Esser

In recent years, many explanation methods have been proposed to explain individual classifications of deep neural networks. However, how to leverage the created explanations to improve the learning process has been less explored. As the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Jindong Gu , Zhiliang Wu , Volker Tresp

Teachers intentionally pick the most informative examples to show their students. However, if the teacher and student are neural networks, the examples that the teacher network learns to give, although effective at teaching the student, are…

Artificial Intelligence · Computer Science 2018-02-15 Smitha Milli , Pieter Abbeel , Igor Mordatch

Deep Learning shows very good performance when trained on large labeled data sets. The problem of training a deep net on a few or one sample per class requires a different learning approach which can generalize to unseen classes using only…

Machine Learning · Computer Science 2018-08-23 Jinchao Liu , Stuart J. Gibson , Margarita Osadchy

Prototype methods seek a minimal subset of samples that can serve as a distillation or condensed view of a data set. As the size of modern data sets grows, being able to present a domain specialist with a short list of "representative"…

Applications · Statistics 2012-03-19 Jacob Bien , Robert Tibshirani

Representation knowledge distillation aims at transferring rich information from one model to another. Common approaches for representation distillation mainly focus on the direct minimization of distance metrics between the models'…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Emanuel Ben-Baruch , Matan Karklinsky , Yossi Biton , Avi Ben-Cohen , Hussam Lawen , Nadav Zamir

Human categorization is one of the most important and successful targets of cognitive modeling in psychology, yet decades of development and assessment of competing models have been contingent on small sets of simple, artificial…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Ruairidh M. Battleday , Joshua C. Peterson , Thomas L. Griffiths

Joint machine learning models that allow synthesizing and classifying data often offer uneven performance between those tasks or are unstable to train. In this work, we depart from a set of empirical observations that indicate the…

Machine Learning · Computer Science 2023-04-06 Kamil Deja , Tomasz Trzcinski , Jakub M. Tomczak

Deep neural networks use multiple layers of functions to map an object represented by an input vector progressively to different representations, and with sufficient training, eventually to a single score for each class that is the output…

Machine Learning · Computer Science 2022-09-02 Tin Kam Ho

Providing users with alternatives to choose from is an essential component in many online platforms, making the accurate prediction of choice vital to their success. A renewed interest in learning choice models has led to significant…

Machine Learning · Computer Science 2020-01-22 Nir Rosenfeld , Kojin Oshiba , Yaron Singer

Deep metric learning aims to transform input data into an embedding space, where similar samples are close while dissimilar samples are far apart from each other. In practice, samples of new categories arrive incrementally, which requires…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Gao-Dong Liu , Wan-Lei Zhao , Jie Zhao

Humans have come to rely on machines for reducing excessive information to manageable representations. But this reliance can be abused -- strategic machines might craft representations that manipulate their users. How can a user make good…

Machine Learning · Computer Science 2022-06-20 Vineet Nair , Ganesh Ghalme , Inbal Talgam-Cohen , Nir Rosenfeld

There is a growing discrepancy in computer vision between large-scale models that achieve state-of-the-art performance and models that are affordable in practical applications. In this paper we address this issue and significantly bridge…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Lucas Beyer , Xiaohua Zhai , Amélie Royer , Larisa Markeeva , Rohan Anil , Alexander Kolesnikov

Imitation learning has achieved great success in many sequential decision-making tasks, in which a neural agent is learned by imitating collected human demonstrations. However, existing algorithms typically require a large number of…

Machine Learning · Computer Science 2023-06-14 Tianxiang Zhao , Wenchao Yu , Suhang Wang , Lu Wang , Xiang Zhang , Yuncong Chen , Yanchi Liu , Wei Cheng , Haifeng Chen

Decades of psychological research have been aimed at modeling how people learn features and categories. The empirical validation of these theories is often based on artificial stimuli with simple representations. Recently, deep neural…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Joshua C. Peterson , Joshua T. Abbott , Thomas L. Griffiths

One of the key limitations of modern deep learning approaches lies in the amount of data required to train them. Humans, by contrast, can learn to recognize novel categories from just a few examples. Instrumental to this rapid learning…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Pavel Tokmakov , Yu-Xiong Wang , Martial Hebert

Humans leverage compositionality to efficiently learn new concepts, understanding how familiar parts can combine together to form novel objects. In contrast, popular computer vision models struggle to make the same types of inferences,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Yanli Zhou , Reuben Feinman , Brenden M. Lake

Deep-learning vision models have shown intriguing similarities and differences with respect to human vision. We investigate how to bring machine visual representations into better alignment with human representations. Human representations…

Neural and Evolutionary Computing · Computer Science 2021-01-13 Maria Attarian , Brett D. Roads , Michael C. Mozer

When working with three-dimensional data, choice of representation is key. We explore voxel-based models, and present evidence for the viability of voxellated representations in applications including shape modeling and object…

Computer Vision and Pattern Recognition · Computer Science 2016-08-17 Andrew Brock , Theodore Lim , J. M. Ritchie , Nick Weston