English
Related papers

Related papers: Improving Knowledge Tracing via Pre-training Quest…

200 papers

Knowledge tracing aims to track students' knowledge status over time to predict students' future performance accurately. Markov chain-based knowledge tracking (MCKT) models can track knowledge concept mastery probability over time. However,…

Machine Learning · Computer Science 2023-02-20 Hengyu Liu , Tiancheng Zhang , Fan Li , Minghe Yu , Ge Yu

Knowledge Tracing (KT) is a fundamental technology in intelligent tutoring systems used to simulate changes in students' knowledge state during learning, track personalized knowledge mastery, and predict performance. However, current KT…

Artificial Intelligence · Computer Science 2025-05-01 Jiahui Cen , Jianghao Lin , Weixuan Zhong , Dong Zhou , Jin Chen , Aimin Yang , Yongmei Zhou

In this paper, we study knowledge tracing in the domain of programming education and make two important contributions. First, we harvest and publish so far the most comprehensive dataset, namely BePKT, which covers various online behaviors…

Programming Languages · Computer Science 2021-12-16 Renyu Zhu , Dongxiang Zhang , Chengcheng Han , Ming Gao , Xuesong Lu , Weining Qian , Aoying Zhou

Text embedding representing natural language documents in a semantic vector space can be used for document retrieval using nearest neighbor lookup. In order to study the feasibility of neural models specialized for retrieval in a…

Information Retrieval · Computer Science 2019-05-03 Tolgahan Cakaloglu , Christian Szegedy , Xiaowei Xu

We present a novel mechanism to embed prior knowledge in a model for visual question answering. The open-set nature of the task is at odds with the ubiquitous approach of training of a fixed classifier. We show how to exploit additional…

Computer Vision and Pattern Recognition · Computer Science 2020-05-05 Violetta Shevchenko , Damien Teney , Anthony Dick , Anton van den Hengel

Knowledge tracing (KT) is the problem of predicting students' future performance based on their historical interaction sequences. With the advanced capability of capturing contextual long-term dependency, attention mechanism becomes one of…

Machine Learning · Computer Science 2024-07-25 Shuyan Huang , Zitao Liu , Xiangyu Zhao , Weiqi Luo , Jian Weng

Deep learning based knowledge tracing model has been shown to outperform traditional knowledge tracing model without the need for human-engineered features, yet its parameters and representations have long been criticized for not being…

Machine Learning · Computer Science 2019-04-29 Chun-Kit Yeung

Pretrained models are ubiquitous in the current deep learning landscape, offering strong results on a broad range of tasks. Recent works have shown that models differing in various design choices exhibit categorically diverse generalization…

Machine Learning · Computer Science 2025-10-28 Siddharth Jain , Shyamgopal Karthik , Vineet Gandhi

Neural approaches to learning term embeddings have led to improved computation of similarity and ranking in information retrieval (IR). So far neural representation learning has not been extended to meta-textual information that is readily…

Information Retrieval · Computer Science 2021-02-03 Toshitaka Kuwa , Shigehiko Schamoni , Stefan Riezler

Language models (LMs) have been shown to memorize a great deal of factual knowledge contained in their training data. But when an LM generates an assertion, it is often difficult to determine where it learned this information and whether it…

Computation and Language · Computer Science 2022-10-26 Ekin Akyürek , Tolga Bolukbasi , Frederick Liu , Binbin Xiong , Ian Tenney , Jacob Andreas , Kelvin Guu

Knowledge-enhanced language representation learning has shown promising results across various knowledge-intensive NLP tasks. However, prior methods are limited in efficient utilization of multilingual knowledge graph (KG) data for language…

Computation and Language · Computer Science 2022-10-20 Linlin Liu , Xin Li , Ruidan He , Lidong Bing , Shafiq Joty , Luo Si

With the rapid proliferation of textual data, predicting long texts has emerged as a significant challenge in the domain of natural language processing. Traditional text prediction methods encounter substantial difficulties when grappling…

Computation and Language · Computer Science 2024-01-24 Jiahui Zhao , Ziyi Meng , Stepan Gordeev , Zijie Pan , Dongjin Song , Sandro Steinbach , Caiwen Ding

Knowledge Tracing (KT), which aims to model student knowledge level and predict their performance, is one of the most important applications of user modeling. Modern KT approaches model and maintain an up-to-date state of student knowledge…

Computers and Society · Computer Science 2022-10-18 Chunpai Wang , Shaghayegh Sahebi , Siqian Zhao , Peter Brusilovsky , Laura O. Moraes

In order for large language model (LLM)-based assistants to effectively adapt to evolving information needs, it must be possible to update their factual knowledge through continued training on new data. The standard recipe for doing so…

Computation and Language · Computer Science 2024-05-28 Zhengbao Jiang , Zhiqing Sun , Weijia Shi , Pedro Rodriguez , Chunting Zhou , Graham Neubig , Xi Victoria Lin , Wen-tau Yih , Srinivasan Iyer

Knowledge tracing is the task of modeling each student's mastery of knowledge concepts (KCs) as (s)he engages with a sequence of learning activities. Each student's knowledge is modeled by estimating the performance of the student on the…

Machine Learning · Computer Science 2019-07-17 Shalini Pandey , George Karypis

The task of link prediction aims to solve the problem of incomplete knowledge caused by the difficulty of collecting facts from the real world. GCNs-based models are widely applied to solve link prediction problems due to their…

Artificial Intelligence · Computer Science 2022-09-07 Shuanglong Yao , Dechang Pi , Junfu Chen , Yufei Liu , Zhiyuan Wu

Knowledge graphs (KGs) are the key components of various natural language processing applications. To further expand KGs' coverage, previous studies on knowledge graph completion usually require a large number of training instances for each…

Computation and Language · Computer Science 2018-08-29 Wenhan Xiong , Mo Yu , Shiyu Chang , Xiaoxiao Guo , William Yang Wang

Knowledge distillation refers to the process of training a compact student network to achieve better accuracy by learning from a high capacity teacher network. Most of the existing knowledge distillation methods direct the student to follow…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Himalaya Jain , Spyros Gidaris , Nikos Komodakis , Patrick Pérez , Matthieu Cord

We introduce a simple yet effective method of integrating contextual embeddings with commonsense graph embeddings, dubbed BERT Infused Graphs: Matching Over Other embeDdings. First, we introduce a preprocessing method to improve the speed…

Computation and Language · Computer Science 2019-10-18 Jeff Da

Knowledge tracing (KT) aims to predict learners' future performance based on historical learning interactions. However, existing KT models predominantly focus on data from a single course, limiting their ability to capture a comprehensive…

Artificial Intelligence · Computer Science 2025-05-21 Wenkang Han , Wang Lin , Liya Hu , Zhenlong Dai , Yiyun Zhou , Mengze Li , Zemin Liu , Chang Yao , Jingyuan Chen