English
Related papers

Related papers: Learning to Teach

200 papers

Effective training of deep neural networks can be challenging, and there remain many open questions on how to best learn these models. Recently developed methods to improve neural network training examine teaching: providing learned…

Machine Learning · Computer Science 2021-03-15 Aniruddh Raghu , Maithra Raghu , Simon Kornblith , David Duvenaud , Geoffrey Hinton

In humans and animals, curriculum learning -- presenting data in a curated order - is critical to rapid learning and effective pedagogy. Yet in machine learning, curricula are not widely used and empirically often yield only moderate…

Machine Learning · Computer Science 2022-12-07 Luca Saglietti , Stefano Sarao Mannelli , Andrew Saxe

We propose a novel knowledge distillation approach to facilitate the transfer of dark knowledge from a teacher to a student. Contrary to most of the existing methods that rely on effective training of student models given pretrained…

Machine Learning · Computer Science 2022-01-25 Dae Young Park , Moon-Hyun Cha , Changwook Jeong , Dae Sin Kim , Bohyung Han

Deep Learning shows very good performance when trained on large labeled data sets. The problem of training a deep net on a few or one sample per class requires a different learning approach which can generalize to unseen classes using only…

Machine Learning · Computer Science 2018-08-23 Jinchao Liu , Stuart J. Gibson , Margarita Osadchy

Event processing is the cornerstone of the dynamic and responsive Internet of Things (IoT). Recent approaches in this area are based on representational state transfer (REST) principles, which allow event processing tasks to be placed at…

Machine Learning · Computer Science 2021-12-08 A. Mazayev , F. Al-Tam , N. Correia

Deep learning has emerged as a compelling solution to many NLP tasks with remarkable performances. However, due to their opacity, such models are hard to interpret and trust. Recent work on explaining deep models has introduced approaches…

Computation and Language · Computer Science 2019-05-21 Reza Ghaeini , Xiaoli Z. Fern , Hamed Shahbazi , Prasad Tadepalli

Visual explanation is an approach for visualizing the grounds of judgment by deep learning, and it is possible to visually interpret the grounds of a judgment for a certain input by visualizing an attention map. As for deep-learning models…

Artificial Intelligence · Computer Science 2023-06-06 Kohei Hattori , Tsubasa Hirakawa , Takayoshi Yamashita , Hironobu Fujiyoshi

In recent years, many explanation methods have been proposed to explain individual classifications of deep neural networks. However, how to leverage the created explanations to improve the learning process has been less explored. As the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Jindong Gu , Zhiliang Wu , Volker Tresp

Machine unlearning has become an important area of research due to an increasing need for machine learning (ML) applications to comply with the emerging data privacy regulations. It facilitates the provision for removal of certain set or…

Machine Learning · Computer Science 2023-06-01 Vikram S Chundawat , Ayush K Tarun , Murari Mandal , Mohan Kankanhalli

In real-world applications of education, an effective teacher adaptively chooses the next example to teach based on the learner's current state. However, most existing work in algorithmic machine teaching focuses on the batch setting, where…

Machine Learning · Computer Science 2018-12-11 Yuxin Chen , Adish Singla , Oisin Mac Aodha , Pietro Perona , Yisong Yue

Learning analytics research increasingly studies classroom learning with AI-based systems through rich contextual data from outside these systems, especially student-teacher interactions. One key challenge in leveraging such data is…

Computers and Society · Computer Science 2023-12-19 Conrad Borchers , Yeyu Wang , Shamya Karumbaiah , Muhammad Ashiq , David Williamson Shaffer , Vincent Aleven

Deep neural networks (DNNs) are often trained on the premise that the complete training data set is provided ahead of time. However, in real-world scenarios, data often arrive in chunks over time. This leads to important considerations…

Machine Learning · Computer Science 2023-03-21 Vijaya Raghavan T. Ramkumar , Elahe Arani , Bahram Zonooz

A good teacher should not only be knowledgeable, but should also be able to communicate in a way that the student understands -- to share the student's representation of the world. In this work, we introduce a new controlled experimental…

We investigate a simple model for social learning with two agents: a teacher and a student. The teacher's goal is to teach the student the state of the world; however, the teacher himself is not certain about the state of the world and…

Information Theory · Computer Science 2020-10-08 Varun Jog , Po-Ling Loh

Teachers intentionally pick the most informative examples to show their students. However, if the teacher and student are neural networks, the examples that the teacher network learns to give, although effective at teaching the student, are…

Artificial Intelligence · Computer Science 2018-02-15 Smitha Milli , Pieter Abbeel , Igor Mordatch

The learning process is a process of communication and interaction between the teacher and his students on one side and between the students and each others on the other side. Interaction of the teacher with his students has a great…

Other Computer Science · Computer Science 2009-11-03 A. E. E. Elalfi , M. E. Elalami , Y. M . Asem

Humans can often quickly and efficiently solve complex new learning tasks given only a small set of examples. In contrast, modern artificially intelligent systems often require thousands or millions of observations in order to solve even…

Machine Learning · Computer Science 2025-05-08 Christian Raymond

Sharing knowledge between tasks is vital for efficient learning in a multi-task setting. However, most research so far has focused on the easier case where knowledge transfer is not harmful, i.e., where knowledge from one task cannot…

Machine Learning · Computer Science 2019-07-08 Timo Bram , Gino Brunner , Oliver Richter , Roger Wattenhofer

Continual learning-the ability to learn many tasks in sequence-is critical for artificial learning systems. Yet standard training methods for deep networks often suffer from catastrophic forgetting, where learning new tasks erases knowledge…

Machine Learning · Statistics 2021-07-12 Sebastian Lee , Sebastian Goldt , Andrew Saxe

Asking questions is one of the most crucial pedagogical techniques used by teachers in class. It not only offers open-ended discussions between teachers and students to exchange ideas but also provokes deeper student thought and critical…

Computation and Language · Computer Science 2020-05-19 Gale Yan Huang , Jiahao Chen , Haochen Liu , Weiping Fu , Wenbiao Ding , Jiliang Tang , Songfan Yang , Guoliang Li , Zitao Liu