English
Related papers

Related papers: Integrating LSTM and BERT for Long-Sequence Data A…

200 papers

Students in online courses generate large amounts of data that can be used to personalize the learning process and improve quality of education. In this paper, we present the Latent Skill Embedding (LSE), a probabilistic model of students…

Machine Learning · Computer Science 2016-02-24 Siddharth Reddy , Igor Labutov , Thorsten Joachims

Knowledge tracing (KT) is a popular approach for modeling students' learning progress over time, which can enable more personalized and adaptive learning. However, existing KT approaches face two major limitations: (1) they rely heavily on…

Machine Learning · Computer Science 2025-03-14 Yilmazcan Ozyurt , Stefan Feuerriegel , Mrinmaya Sachan

Answering complex queries over incomplete knowledge graphs (KGs) is a challenging job. Most previous works have focused on learning entity/relation embeddings and simulating first-order logic operators with various neural networks. However,…

Computation and Language · Computer Science 2025-03-04 Tianle Xia , Liang Ding , Guojia Wan , Yibing Zhan , Bo Du , Dacheng Tao

The world has transitioned into a new phase of online learning in response to the recent Covid19 pandemic. Now more than ever, it has become paramount to push the limits of online learning in every manner to keep flourishing the education…

Machine Learning · Computer Science 2020-08-31 Shalini Pandey , Jaideep Srivastava

BERT is a widely used pre-trained model in natural language processing. However, since BERT is quadratic to the text length, the BERT model is difficult to be used directly on the long-text corpus. In some fields, the collected text data…

Computation and Language · Computer Science 2022-09-27 Yufeng Zhao , Haiying Che

Medical text learning has recently emerged as a promising area to improve healthcare due to the wide adoption of electronic health record (EHR) systems. The complexity of the medical text such as diverse length, mixed text types, and full…

Computation and Language · Computer Science 2022-10-11 Yong He , Cheng Wang , Shun Zhang , Nan Li , Zhaorong Li , Zhenyu Zeng

The 2017 ASSISTments Data Mining competition aims to use data from a longitudinal study for predicting a brand-new outcome of students which had never been studied before by the educational data mining research community. Specifically, it…

Computers and Society · Computer Science 2018-06-11 Chun-kit Yeung , Zizheng Lin , Kai Yang , Dit-yan Yeung

While Large Language Models (LLMs) acquire vast knowledge during pre-training, they often lack domain-specific, new, or niche information. Continual pre-training (CPT) attempts to address this gap but suffers from catastrophic forgetting…

Computation and Language · Computer Science 2025-04-09 Oded Ovadia , Meni Brief , Rachel Lemberg , Eitam Sheetrit

This paper presents novel techniques for enhancing the performance of knowledge tracing (KT) models by focusing on the crucial factor of question and concept difficulty level. Despite the acknowledged significance of difficulty, previous KT…

Computation and Language · Computer Science 2023-12-20 Unggi Lee , Sungjun Yoon , Joon Seo Yun , Kyoungsoo Park , YoungHoon Jung , Damji Stratton , Hyeoncheol Kim

An emerging recipe for achieving state-of-the-art effectiveness in neural document re-ranking involves utilizing large pre-trained language models - e.g., BERT - to evaluate all individual passages in the document and then aggregating the…

Information Retrieval · Computer Science 2021-05-21 Sebastian Hofstätter , Bhaskar Mitra , Hamed Zamani , Nick Craswell , Allan Hanbury

The expansion of Internet of Things (IoT) devices has increased the attack surface of networks, necessitating a robust and adaptive intrusion detection systems. Machine learning based systems have been considered promising in enhancing the…

Cryptography and Security · Computer Science 2026-03-13 Muaan Ur Rehman , Hayretdin Bahsi , Rajesh Kalakoti

Educational systems often assume learners can identify their knowledge gaps, yet research consistently shows that students struggle to recognize what they don't know they need to learn-the "unknown unknowns" problem. This paper presents a…

Human-Computer Interaction · Computer Science 2025-09-10 Jinwen Tang , Qiming Guo , Zhicheng Tang , Yi Shang

This paper focuses on how to take advantage of external knowledge bases (KBs) to improve recurrent neural networks for machine reading. Traditional methods that exploit knowledge from KBs encode knowledge as discrete indicator features. Not…

Computation and Language · Computer Science 2019-02-26 Bishan Yang , Tom Mitchell

Growing number of network devices and services have led to increasing demand for protective measures as hackers launch attacks to paralyze or steal information from victim systems. Intrusion Detection System (IDS) is one of the essential…

Machine Learning · Computer Science 2019-11-27 Hyeokmin Gwon , Chungjun Lee , Rakun Keum , Heeyoul Choi

The integration of quantum computing into classical machine learning architectures has emerged as a promising approach to enhance model efficiency and computational capacity. In this work, we introduce the Quantum Kernel-Based Long…

Quantum Physics · Physics 2024-11-21 Yu-Chao Hsu , Tai-Yu Li , Kuan-Cheng Chen

Knowledge tracing (KT) aims to trace students' knowledge states by predicting whether students answer correctly on exercises. Despite the excellent performance of existing Transformer-based KT approaches, they are criticized for the…

Neural and Evolutionary Computing · Computer Science 2023-10-03 Shangshang Yang , Xiaoshan Yu , Ye Tian , Xueming Yan , Haiping Ma , Xingyi Zhang

Humans learn from the occurrence of events in a different place and time to predict similar trajectories of events. We define Loosely Decoupled Timeseries (LDT) phenomena as two or more events that could happen in different places and…

Machine Learning · Computer Science 2022-08-29 Christian Manasseh , Razvan Veliche , Jared Bennett , Hamilton Clouse

Recent advancements in large language models (LLMs) have facilitated the development of chatbots with sophisticated conversational capabilities. However, LLMs exhibit frequent inaccurate responses to queries, hindering applications in…

Human-Computer Interaction · Computer Science 2024-07-17 Blake Castleman , Mehmet Kerem Turkcan

Predictive business process monitoring methods exploit logs of completed cases of a process in order to make predictions about running cases thereof. Existing methods in this space are tailor-made for specific prediction tasks. Moreover,…

Applications · Statistics 2017-12-20 Niek Tax , Ilya Verenich , Marcello La Rosa , Marlon Dumas

Detecting plagiarism involves finding similar items in two different sources. In this article, we propose a novel method for detecting plagiarism that is based on attention mechanism-based long short-term memory (LSTM) and bidirectional…

Computation and Language · Computer Science 2023-05-05 Seyed Vahid Moravvej , Seyed Jalaleddin Mousavirad , Diego Oliva , Fardin Mohammadi