English
Related papers

Related papers: Reducing the Cost: Cross-Prompt Pre-Finetuning for…

200 papers

Self-supervised learning (SSL) has proven vital in speech and audio-related applications. The paradigm trains a general model on unlabeled data that can later be used to solve specific downstream tasks. This type of model is costly to train…

Pre-trained language models have shown excellent results in few-shot learning scenarios using in-context learning. Although it is impressive, the size of language models can be prohibitive to make them usable in on-device applications, such…

Computation and Language · Computer Science 2022-04-27 Navid Rezaei , Marek Z. Reformat

Automated short answer scoring (ASAS) is shifting from discriminative, fine-tuned models to large language models (LLMs) used in few-shot settings. This paradigm leverages LLMs broad world knowledge and ease of deployment, but limited…

Computation and Language · Computer Science 2026-05-26 Abigail Victoria Gurin Schleifer , Moriah Ariely , Beata Beigman Klebanov , Asaf Salman , Giora Alexandron

Automated Essay Scoring (AES) plays a crucial role in education by providing scalable and efficient assessment tools. However, in real-world settings, the extreme scarcity of labeled data severely limits the development and practical…

Computation and Language · Computer Science 2026-02-03 Hongseok Choi , Serynn Kim , Wencke Liermann , Jin Seong , Jin-Xia Huang

Automatic assessment needs short answer based evaluation and automated assessment. Various techniques used are Ontology, Semantic similarity matching and Statistical methods. An automatic short answer assessment system is attempted in this…

Other Computer Science · Computer Science 2010-11-09 P. Selvi , A. K. Bnerjee

Automated Short Answer Scoring (ASAS) is a critical component in educational assessment. While traditional ASAS systems relied on rule-based algorithms or complex deep learning methods, recent advancements in Generative Language Models…

Computation and Language · Computer Science 2024-08-08 Zifan Wang , Christopher Ormerod

Automated Essay Score (AES) is proven to be one of the cutting-edge technologies. Scoring techniques are used for various purposes. Reliable scores are calculated based on influential variables. Such variables can be computed by different…

Machine Learning · Computer Science 2023-10-05 Bagiya Lakshmi S , Sanjjushri Varshini R , Rohith Mahadevan , Raja CSP Raman

Automated Text Scoring (ATS) provides a cost-effective and consistent alternative to human marking. However, in order to achieve good performance, the predictive features of the system need to be manually engineered by human experts. We…

Computation and Language · Computer Science 2017-07-18 Dimitrios Alikaniotis , Helen Yannakoudakis , Marek Rei

In automated essay scoring (AES), recent efforts have shifted toward cross-prompt settings that score essays on unseen prompts for practical applicability. However, prior methods trained with essay-score pairs of specific prompts pose…

Computation and Language · Computer Science 2025-02-13 Heejin Do , Taehee Park , Sangwon Ryu , Gary Geunbae Lee

Enhancing word usage is a desired feature for writing assistance. To further advance research in this area, this paper introduces "Smart Word Suggestions" (SWS) task and benchmark. Unlike other works, SWS emphasizes end-to-end evaluation…

Computation and Language · Computer Science 2023-05-18 Chenshuo Wang , Shaoguang Mao , Tao Ge , Wenshan Wu , Xun Wang , Yan Xia , Jonathan Tien , Dongyan Zhao

Automated answer grading is a critical challenge in educational technology, with the potential to streamline assessment processes, ensure grading consistency, and provide timely feedback to students. However, existing approaches are often…

Computation and Language · Computer Science 2025-06-02 Masoud Safilian , Amin Beheshti , Stephen Elbourn

Automatic Speech Scoring (ASS) is the computer-assisted evaluation of a candidate's speaking proficiency in a language. ASS systems face many challenges like open grammar, variable pronunciations, and unstructured or semi-structured…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-07 Yaman Kumar Singla , Avykat Gupta , Shaurya Bagga , Changyou Chen , Balaji Krishnamurthy , Rajiv Ratn Shah

The attention mechanism is a core component of the Transformer architecture. Various methods have been developed to compute attention scores, including multi-head attention (MHA), multi-query attention, group-query attention and so on. We…

One of the fundamental challenges towards building any intelligent tutoring system is its ability to automatically grade short student answers. A typical automatic short answer grading system (ASAG) grades student answers across multiple…

Computation and Language · Computer Science 2019-02-26 Swarnadeep Saha , Tejas I. Dhamecha , Smit Marvaniya , Peter Foltz , Renuka Sindhgatta , Bikram Sengupta

Cross-topic automated essay scoring (AES) aims to develop a transferable model capable of effectively evaluating essays on a target topic. A significant challenge in this domain arises from the inherent discrepancies between topics. While…

Computation and Language · Computer Science 2025-08-11 Chunyun Zhang , Hongyan Zhao , Chaoran Cui , Qilong Song , Zhiqing Lu , Shuai Gong , Kailin Liu

In this work, we explore "prompt tuning", a simple yet effective mechanism for learning "soft prompts" to condition frozen language models to perform specific downstream tasks. Unlike the discrete text prompts used by GPT-3, soft prompts…

Computation and Language · Computer Science 2021-09-03 Brian Lester , Rami Al-Rfou , Noah Constant

This study illustrates how incorporating feedback-oriented annotations into the scoring pipeline can enhance the accuracy of automated essay scoring (AES). This approach is demonstrated with the Persuasive Essays for Rating, Selecting, and…

Computation and Language · Computer Science 2025-09-03 Christopher Ormerod

Recent advances in cross-prompt automated essay scoring (AES) typically train models jointly on all source prompts, often requiring additional access to unlabeled target prompt essays simultaneously. However, using all sources is suboptimal…

Computation and Language · Computer Science 2025-05-27 Sanwoo Lee , Kun Liang , Yunfang Wu

Sketch-and-solve (SAS) is a very successful method to efficiently estimate the solution of heavily overdetermined large linear least squares problems. It uses random sketching to reduce the size of the problem, hence reducing the…

Numerical Analysis · Mathematics 2026-05-26 Irina-Beatrice Haas , Michael B. Giles , Yuji Nakatsukasa

The problem of keyword spotting i.e. identifying keywords in a real-time audio stream is mainly solved by applying a neural network over successive sliding windows. Due to the difficulty of the task, baseline models are usually large,…

Machine Learning · Computer Science 2018-11-19 Tom Véniat , Olivier Schwander , Ludovic Denoyer