English

An Application of HodgeRank to Online Peer Assessment

Machine Learning 2018-03-08 v1 Artificial Intelligence
Authors: Tse-Yu Lin , Yen-Lung Tsai
View on arXiv ↗ PDF ↗

Abstract

Bias and heterogeneity in peer assessment can lead to the issue of unfair scoring in the educational field. To deal with this problem, we propose a reference ranking method for an online peer assessment system using HodgeRank. Such a scheme provides instructors with an objective scoring reference based on mathematics.

Keywords

hodgerank online peer assessment bias heterogeneity reference ranking educational scoring

Cite

@article{arxiv.1803.02509,
  title  = {An Application of HodgeRank to Online Peer Assessment},
  author = {Tse-Yu Lin and Yen-Lung Tsai},
  journal= {arXiv preprint arXiv:1803.02509},
  year   = {2018}
}

Comments

7 pages. To appear in MLRec 2018

Related papers

View all related →
Artificial Intelligence · Computer Science
The PeerRank Method for Peer Assessment
Toby Walsh
2014-05-29
Computers and Society · Computer Science
Optimizing Peer Grading: A Systematic Literature Review of Reviewer Assignment Strategies and Quantity of Reviewers
Uchswas Paul, Shail Shah, Sri Vaishnavi Mylavarapu, M. Parvez Rashid +1
2025-08-26
Artificial Intelligence · Computer Science
A difficulty ranking approach to personalization in E-learning
Avi Segal, Kobi Gal, Guy Shani, Bracha Shapira
2019-07-30
Computer Science and Game Theory · Computer Science
Interactive and Iterative Peer Assessment
Lihi Dery
2025-03-25
Computers and Society · Computer Science
A Motivation Model of Peer Assessment in Programming Language Learning
Yanqing Wang, Yaowen Liang, Luning Liu, Ying Liu
2015-06-19
Computation and Language · Computer Science
Assisting Decision Making in Scholarly Peer Review: A Preference Learning Perspective
Nils Dycke, Edwin Simpson, Ilia Kuznetsov, Iryna Gurevych
2022-05-30
Artificial Intelligence · Computer Science
PeerRank: Autonomous LLM Evaluation Through Web-Grounded, Bias-Controlled Peer Review
Yanki Margalit, Erni Avram, Ran Taig, Oded Margalit +1
2026-02-04
Quantum Physics · Physics
Quantum HodgeRank: Topology-Based Rank Aggregation on Quantum Computers
Caesnan M. G. Leditto, Angus Southwell, Behnam Tonekaboni, Muhammad Usman +1
2025-06-26
Computers and Society · Computer Science
Systematic Review of Approaches to Improve Peer Assessment at Scale
Manikandan Ravikiran
2020-01-31
Computers and Society · Computer Science
Improving Assessment on MOOCs Through Peer Identification and Aligned Incentives
Dilrukshi Gamage, Mark Whiting, Thejan Rajapakshe, Haritha Thilakarathne +2
2021-01-01
Artificial Intelligence · Computer Science
Multiple-criteria Heuristic Rating Estimation
Anna Kędzior, Konrad Kułakowski
2022-05-24
Artificial Intelligence · Computer Science
Better Peer Grading through Bayesian Inference
Hedayat Zarkoob, Greg d'Eon, Lena Podina, Kevin Leyton-Brown
2022-12-05
Artificial Intelligence · Computer Science
Aggregating partial rankings with applications to peer grading in massive online open courses
Ioannis Caragiannis, George A. Krimpas, Alexandros A. Voudouris
2014-11-18
Machine Learning · Statistics
TopRank: A practical algorithm for online stochastic ranking
Tor Lattimore, Branislav Kveton, Shuai Li, Csaba Szepesvari
2019-03-20
Information Retrieval · Computer Science
Hybrid Multi-Criteria Preference Ranking by Subsorting
Yong Zheng, David Xuejun Wang
2023-06-21
Discrete Mathematics · Computer Science
Heuristic rating estimation - geometric approach
Konrad Kułakowski, Katarzyna Grobler-Dębska, Jarosław Wąs
2015-09-25
Methodology · Statistics
Pairwise ranking: choice of method can produce arbitrarily different rank order
Ngoc Mai Tran
2011-03-08
Discrete Mathematics · Computer Science
Notes on the existence of solutions in the pairwise comparisons method using the Heuristic Rating Estimation approach
Konrad Kułakowski
2015-09-25
Applications · Statistics
Unfolding the Network of Peer Grades: A Latent Variable Approach
Giuseppe Mignemi, Yunxiao Chen, Irini Moustaki
2025-10-01
Machine Learning · Computer Science
Tuned Models of Peer Assessment in MOOCs
Chris Piech, Jonathan Huang, Zhenghao Chen, Chuong Do +2
2013-07-11
Machine Learning · Computer Science
Peer Grading in a Course on Algorithms and Data Structures: Machine Learning Algorithms do not Improve over Simple Baselines
Mehdi S. M. Sajjadi, Morteza Alamgir, Ulrike von Luxburg
2016-02-11
Artificial Intelligence · Computer Science
An Educational System for Personalized Teacher Recommendation in K-12 Online Classrooms
Jiahao Chen, Hang Li, Wenbiao Ding, Zitao Liu
2021-07-16
Digital Libraries · Computer Science
Peer Prediction for Peer Review: Designing a Marketplace for Ideas
Alexander Ugarov
2023-03-30
Social and Information Networks · Computer Science
CrowdGrader: Crowdsourcing the Evaluation of Homework Assignments
Luca de Alfaro, Michael Shavlovsky
2013-08-27
Information Retrieval · Computer Science
Study of a bias in the offline evaluation of a recommendation algorithm
Arnaud De Myttenaere, Boris Golden, Bénédicte Le Grand, Fabrice Rossi
2015-11-05