English
Related papers

Related papers: iPad Screencasts as Evidence of Accountable Discip…

200 papers

Knowledge distillation is an effective approach to learn compact models (students) with the supervision of large and strong models (teachers). As empirically there exists a strong correlation between the performance of teacher and student…

Machine Learning · Computer Science 2022-10-13 Chaofei Wang , Qisen Yang , Rui Huang , Shiji Song , Gao Huang

Knowledge Distillation (KD) has proven effective for compressing large teacher models into smaller student models. While it is well known that student models can achieve similar accuracies as the teachers, it has also been shown that they…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Amin Parchami-Araghi , Moritz Böhle , Sukrut Rao , Bernt Schiele

This work introduces a novel knowledge distillation framework for classification tasks where information on existing subclasses is available and taken into consideration. In classification tasks with a small number of classes or binary…

Machine Learning · Computer Science 2022-07-19 Ahmad Sajedi , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

This paper examines the role of artificial intelligence in scientific problem-solving, with a focus on its implications for disciplinary creativity. Drawing on recent work in the philosophy of creativity, I distinguish between creative…

Artificial Intelligence · Computer Science 2025-10-29 Eamon Duede

Knowledge tracing (KT), aiming to mine students' mastery of knowledge by their exercise records and predict their performance on future test questions, is a critical task in educational assessment. While researchers achieved tremendous…

Artificial Intelligence · Computer Science 2024-05-28 Haoxuan Li , Jifan Yu , Yuanxin Ouyang , Zhuang Liu , Wenge Rong , Juanzi Li , Zhang Xiong

In knowledge distillation, a student model is trained with supervisions from both knowledge from a teacher and observations drawn from a training data distribution. Knowledge of a teacher is considered a subject that holds inter-class…

Computation and Language · Computer Science 2022-10-25 Dongkyu Lee , Zhiliang Tian , Yingxiu Zhao , Ka Chun Cheung , Nevin L. Zhang

Accountability aims to provide explanations for why unwanted situations occurred, thus providing means to assign responsibility and liability. As such, accountability has slightly different meanings across the sciences. In computer science,…

Computers and Society · Computer Science 2016-08-30 Severin Kacianka , Florian Kelbert , Alexander Pretschner

Traditional tests are not effective tools for diagnosing the content and structure of students' knowledge of physics. As a possible alternative, a set of term-association tasks (the "ConMap" tasks) was developed to probe the…

Physics Education · Physics 2015-06-26 Ian D. Beatty , William J. Gerace

Knowledge distillation aims at transferring knowledge acquired in one model (a teacher) to another model (a student) that is typically smaller. Previous approaches can be expressed as a form of training the student to mimic output…

Computer Vision and Pattern Recognition · Computer Science 2019-05-02 Wonpyo Park , Dongju Kim , Yan Lu , Minsu Cho

Knowledge distillation~(KD) is an effective learning paradigm for improving the performance of lightweight student networks by utilizing additional supervision knowledge distilled from teacher networks. Most pioneering studies either learn…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Yuang Liu , Wei Zhang , Jun Wang

Continual learning, involving sequential training on diverse tasks, often faces catastrophic forgetting. While knowledge distillation-based approaches exhibit notable success in preventing forgetting, we pinpoint a limitation in their…

Machine Learning · Computer Science 2024-05-17 Zenglin Shi , Pei Liu , Tong Su , Yunpeng Wu , Kuien Liu , Yu Song , Meng Wang

Knowledge distillation (KD) is one of the most potent ways for model compression. The key idea is to transfer the knowledge from a deep teacher model (T) to a shallower student (S). However, existing methods suffer from performance…

Machine Learning · Computer Science 2020-02-24 Mengya Gao , Yujun Shen , Quanquan Li , Chen Change Loy

Adaptive learning often diagnoses precisely yet intervenes weakly, yielding help that is mistimed or misaligned. This study presents evidence supporting an instructor-governed feedback loop that converts concept-level assessment evidence…

Artificial Intelligence · Computer Science 2025-11-19 Amirreza Mehrabi , Jason W. Morphew , Breejha Quezada , N. Sanjay Rebello

Knowledge Graphs (KGs), and Linked Open Data in particular, enable the generation and exchange of more and more information on the Web. In order to use and reuse these data properly, the presence of accountability information is essential.…

Databases · Computer Science 2023-09-29 Jennie Andersen , Sylvie Cazalens , Philippe Lamarre , Pierre Maillot

Accountability is the property of a system that enables the uncovering of causes for events and helps understand who or what is responsible for these events. Definitions and interpretations of accountability differ; however, they are…

Software Engineering · Computer Science 2018-10-24 Severin Kacianka , Alexander Pretschner

Typical technique in knowledge distillation (KD) is regularizing the learning of a limited capacity model (student) by pushing its responses to match a powerful model's (teacher). Albeit useful especially in the penultimate layer and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Ada Gorgun , Yeti Z. Gurbuz , A. Aydin Alatan

Reasoning with declarative knowledge (RDK) and sequential decision-making (SDM) are two key research areas in artificial intelligence. RDK methods reason with declarative domain knowledge, including commonsense knowledge, that is either…

Artificial Intelligence · Computer Science 2022-07-01 Shiqi Zhang , Mohan Sridharan

Argumentation theory is a powerful paradigm that formalizes a type of commonsense reasoning that aims to simulate the human ability to resolve a specific problem in an intelligent manner. A classical argumentation process takes into account…

Artificial Intelligence · Computer Science 2019-03-06 Maximiliano C. D. Budán , Gerardo I. Simari , Ignacio Viglizzo , Guillermo R. Simari

We propose the DHAC conceptual model of teacher preparation (Development of Habits through Apprenticeship in a Community), which builds on the contemporary literature on teacher preparation in physics and other disciplines and strives to…

Physics Education · Physics 2016-06-03 Eugenia Etkina , Bor Gregorcic , Stamatis Vokos

We introduce and study knowledge drift (KD), a complex form of drift that occurs in hierarchical classification. Under KD the vocabulary of concepts, their individual distributions, and the is-a relations between them can all change over…

Machine Learning · Computer Science 2021-03-30 Andrea Bontempelli , Fausto Giunchiglia , Andrea Passerini , Stefano Teso