English
Related papers

Related papers: Optimizing Student Ability Assessment: A Hierarchy…

200 papers

How do computers and intelligent agents view the world around them? Feature extraction and representation constitutes one the basic building blocks towards answering this question. Traditionally, this has been done with carefully engineered…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Jaime Spencer , Richard Bowden , Simon Hadfield

Knowledge Distillation (KD) is a model-agnostic technique to improve model quality while having a fixed capacity budget. It is a commonly used technique for model compression, where a larger capacity teacher model with better quality is…

Machine Learning · Computer Science 2021-03-02 Jiaxi Tang , Rakesh Shivanna , Zhe Zhao , Dong Lin , Anima Singh , Ed H. Chi , Sagar Jain

Knowledge tracing (KT) which aims at predicting learner's knowledge mastery plays an important role in the computer-aided educational system. In recent years, many deep learning models have been applied to tackle the KT task, which have…

Computers and Society · Computer Science 2022-08-30 Hanshuang Tong , Zhen Wang , Yun Zhou , Shiwei Tong , Wenyuan Han , Qi Liu

Knowledge distillation (KD) is a model compression technique that transfers knowledge from a large teacher model to a smaller student model to enhance its performance. Existing methods often assume that the student model is inherently…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Jianhua Zhang , Yi Gao , Ruyu Liu , Xu Cheng , Houxiang Zhang , Shengyong Chen

Knowledge Distillation (KD) aims to transfer knowledge from a large teacher model to a smaller student model. While contrastive learning has shown promise in self-supervised learning by creating discriminative representations, its…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Nikolaos Giakoumoglou , Tania Stathaki

We tackle the generalized category discovery (GCD) problem, which aims to discover novel classes in unlabeled datasets by leveraging the knowledge of known classes. Previous works utilize the known class knowledge through shared…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Chuyu Zhang , Peiyan Gu , Xueyang Yu , Xuming He

Fine-Grained Visual Classification (FGVC) aims to categorize closely related subclasses, a task complicated by minimal inter-class differences and significant intra-class variance. Existing methods often rely on additional annotations for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Pengxiang Gao , Yihao Liang , Yanzhi Song , Zhouwang Yang

To understand the biological characteristics of neurological disorders with functional connectivity (FC), recent studies have widely utilized deep learning-based models to identify the disease and conducted post-hoc analyses via explainable…

Machine Learning · Computer Science 2023-10-09 Eunsong Kang , Da-woon Heo , Jiwon Lee , Heung-Il Suk

Users often possess a clear visual intent but struggle to articulate it precisely in language. This intention-expression gap makes aligning generated images with latent visual preferences a fundamental challenge in text-to-image diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Wenxi Wang , Hongbin Liu , Mingqian Li , Junyan Yuan , Junqi Zhang

The growth of Massive Open Online Courses (MOOCs) presents significant challenges for personalized learning, where concept recommendation is crucial. Existing approaches typically rely on heterogeneous information networks or knowledge…

Information Retrieval · Computer Science 2025-11-27 Xiangrui Xiong , Yichuan Lu , Zifei Pan , Chang Sun

Reliable and interpretable tumor classification from clinical imaging remains a core challenge. The main difficulties arise from heterogeneous modality quality, limited annotations, and the absence of structured anatomical guidance. We…

Image and Video Processing · Electrical Eng. & Systems 2025-10-21 Hongzhao Chen , Hexiao Ding , Yufeng Jiang , Jing Lan , Ka Chun Li , Gerald W. Y. Cheng , Nga-Chun Ng , Yao Pu , Jing Cai , Liang-ting Lin , Jung Sun Yoo

Human attribute analysis is a challenging task in the field of computer vision, since the data is largely imbalance-distributed. Common techniques such as re-sampling and cost-sensitive learning require prior-knowledge to train the system.…

Computer Vision and Pattern Recognition · Computer Science 2019-08-16 Yiru Wang , Weihao Gan , Jie Yang , Wei Wu , Junjie Yan

Knowledge distillation (KD) has demonstrated remarkable success across various domains, but its application to medical imaging tasks, such as kidney and liver tumor segmentation, has encountered challenges. Many existing KD methods are not…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Vandan Gorade , Sparsh Mittal , Debesh Jha , Ulas Bagci

Multiview feature learning aims to learn discriminative features by integrating the distinct information in each view. However, most existing methods still face significant challenges in learning view-consistency features, which are crucial…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Chengwei Xia , Chaoxi Niu , Kun Zhan

At present, the educational data mining community lacks many tools needed for ensuring equitable ability estimation for Neurodivergent (ND) learners. On one hand, most learner models are susceptible to under-estimating ND ability since…

Computers and Society · Computer Science 2022-05-10 Niall Twomey , Sarah McMullan , Anat Elhalal , Rafael Poyiadzi , Luis Vaquero

The rapid increase in multimodal data availability has sparked significant interest in cross-modal knowledge distillation (KD) techniques, where richer "teacher" modalities transfer information to weaker "student" modalities during model…

Machine Learning · Computer Science 2025-10-16 Rongrong Xie , Yizhou Xu , Guido Sanguinetti

Several methods of knowledge distillation have been developed for neural network compression. While they all use the KL divergence loss to align the soft outputs of the student model more closely with that of the teacher, the various…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Huan Wang , Suhas Lohit , Michael Jones , Yun Fu

The ability of Large Language Models (LLMs) to use external tools unlocks powerful real-world interactions, making rigorous evaluation essential. However, current benchmarks primarily report final accuracy, revealing what models can do but…

Computation and Language · Computer Science 2026-01-29 Qihao Wang , Yue Hu , Mingzhe Lu , Jiayue Wu , Yanbing Liu , Yuanmin Tang

Object identification is one of the most fundamental and difficult issues in computer vision. It aims to discover object instances in real pictures from a huge number of established categories. In recent years, deep learning-based object…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Venkata Beri

In the era of modern education, addressing cross-school learner diversity is crucial, especially in personalized recommender systems for elective course selection. However, privacy concerns often limit cross-school data sharing, which…

Information Retrieval · Computer Science 2024-02-20 Chengyi Ju , Jiannong Cao , Yu Yang , Zhen-Qun Yang , Ho Man Lee