English
Related papers

Related papers: Computerized adaptive testing: implementation issu…

200 papers

Interim assessment is frequently administered via computerized adaptive testing (CAT), offering direct support to teaching and learning. This study attempted to fill a vital knowledge gap about the nuanced landscape of examinees'…

Applications · Statistics 2024-08-22 Dandan Chen Kaptur , Elizabeth Patton , Logan Rome

Existing Computerized Adaptive Testing (CAT) frameworks typically select questions based on the predicted likelihood that the student will answer correctly. This design ignores information contained in students' open-ended responses,…

Computation and Language · Computer Science 2026-05-28 Wanyong Feng , Alexander Scarlatos , Ruochen Sun , Andrew Lan

The integration of artificial intelligence tools such as ChatGPT in the education system has gained attention in recent years. This experience report explores students' perceptions and suggestions for integrating ChatGPT in a computer…

Computers and Society · Computer Science 2024-02-06 Kehinde Aruleba , Ismaila Temitayo Sanusi , George Obaido , Blessing Ogbuokiri

Assessing forecasting performance is a time intensive activity, often requiring months or years before we know whether or not the reported forecasts were accurate. Cognitive tests can be quickly administered and are predictive of…

The remarkable success of Artificial Intelligence in advancing automated decision-making is evident both in academia and industry. Within the plethora of applications, ranking systems hold significant importance in various domains. This…

Information Retrieval · Computer Science 2023-12-19 Alessandro Castelnovo , Riccardo Crupi , Nicolò Mombelli , Gabriele Nanino , Daniele Regoli

Adversarial training has become one of the most effective methods for improving robustness of neural networks. However, it often suffers from poor generalization on both clean and perturbed data. In this paper, we propose a new algorithm,…

Machine Learning · Computer Science 2020-02-19 Minhao Cheng , Qi Lei , Pin-Yu Chen , Inderjit Dhillon , Cho-Jui Hsieh

Computerized Adaptive Testing (CAT) has proven effective for efficient LLM evaluation on multiple-choice benchmarks, but modern LLM evaluation increasingly relies on generation tasks where outputs are scored continuously rather than marked…

Computation and Language · Computer Science 2026-01-21 Esma Balkır , Alice Pernthaller , Marco Basaldella , José Hernández-Orallo , Nigel Collier

In this paper, we present a complete framework for quickly calibrating and administering a robust large-scale computerized adaptive test (CAT) with a small number of responses. Calibration - learning item parameters in a test - is done…

With the rapid advancement of intelligent education, Computerized Adaptive Testing (CAT) has attracted increasing attention by integrating educational psychology with deep learning technologies. Unlike traditional paper-and-pencil testing,…

Information Retrieval · Computer Science 2025-12-02 Xiaoshan Yu , Ziwei Huang , Shangshang Yang , Ziwen Wang , Haiping Ma , Xingyi Zhang

This experiment research study examines how traditional assessment methods such as written tests and presentations compared to the new online tests in higher education We want to know how the use of the Internet for assessment affects how…

Human-Computer Interaction · Computer Science 2023-12-22 Santhosh Pogaku

In recent years, the interest in developing adaptive solutions for online testing has grown significantly in the industry. While the advances related to this relative new technology have been developed in multiple domains, it lacks in the…

Methodology · Statistics 2022-03-16 Da Xu , Bo Yang

Random testing (RT) is a well-studied testing method that has been widely applied to the testing of many applications, including embedded software systems, SQL database systems, and Android applications. Adaptive random testing (ART) aims…

Software Engineering · Computer Science 2020-07-15 Rubing Huang , Weifeng Sun , Yinyin Xu , Haibo Chen , Dave Towey , Xin Xia

The goal of this paper is to offer a full support for universities and quality assessment committees in retrieving the feedback from their students regarding to their teaching staff. The computer based application presented before ([Cri07])…

Human-Computer Interaction · Computer Science 2009-06-01 Tiberiu Marius Karnyanszky , Ovidiu Crista , Catalin Tuican

Intelligent systems have the ability to improve their behaviour over time taking observations, experiences or explicit feedback into account. Traditional approaches separate the learning problem and make isolated use of techniques from…

Machine Learning · Computer Science 2022-01-12 Simon Reichhuber , Sven Tomforde

The article highlights the issues of personalized learning as the global trend of the modern ICTbased educational systems development. The notion, the main stages of evolution, the main features and principles of adaptive learning systems…

Physics Education · Physics 2020-06-12 Maiia Marienko , Yulia Nosenko , Alisa Sukhikh , Viktor Tataurov , Mariya Shyshkina

The use of AI assistants, along with the challenges they present, has sparked significant debate within the community of computer science education. While these tools demonstrate the potential to support students' learning and instructors'…

Human-Computer Interaction · Computer Science 2023-11-14 Tianjia Wang , Daniel Vargas-Díaz , Chris Brown , Yan Chen

The analysis of the adaptive behaviour of many different kinds of systems such as humans, animals and machines, requires more general ways of assessing their cognitive abilities. This need is strengthened by increasingly more tasks being…

Artificial Intelligence · Computer Science 2013-05-10 David L. Dowe , Jose Hernandez-Orallo

Model evaluation is a critical component in supervised machine learning classification analyses. Traditional metrics do not currently incorporate case difficulty. This renders the classification results unbenchmarked for generalization.…

Machine Learning · Computer Science 2023-02-10 Adrienne Kline , Joon Lee

The article discusses the quantitative assessment approach to the innovation of engineering system components. The validity of the approach is based on the expert appraisal of the university's electronic information educational environment…

Computers and Society · Computer Science 2021-04-12 V. K. Ivanov , A. G. Glebova , I. V. Obrazthov

Teaching software testing presents difficulties due to its abstract and conceptual nature. The lack of tangible outcomes and limited emphasis on hands-on experience further compound the challenge, often leading to difficulties in…

Software Engineering · Computer Science 2023-10-11 Chakkrit Tantithamthavorn , Norman Chen