Measuring intergroup agreement and disagreement
Applications
2018-06-18 v1
Abstract
This work is motivated by the need to assess the degree of agreement between two independent groups of raters. It proposes two new methods.
Keywords
Cite
@article{arxiv.1806.05821,
title = {Measuring intergroup agreement and disagreement},
author = {Madhusmita Panda and Sharayu Paranjpe and Anil Gore},
journal= {arXiv preprint arXiv:1806.05821},
year = {2018}
}
Comments
18 pages 2 tables 1 figure
Related papers
View all related →
Methodology · Statistics
A new metric of consensus for Likert scales
Oscar Claveria
2018-10-26
Information Theory · Computer Science
Consensus analysis of a two-step communication opinion dynamics model with group pressure and self-confidence
Wenjuan Wang, Zhongmei Wang, Xinmin Song
2024-06-21
Social and Information Networks · Computer Science
Measuring social consensus
David Flater
2024-11-20
Multiagent Systems · Computer Science
Measuring and Controlling Divisiveness in Rank Aggregation
Rachael Colley, Umberto Grandi, César Hidalgo, Mariana Macedo +1
2023-06-16
Computation and Language · Computer Science
Emotion Ratings: How Intensity, Annotation Confidence and Agreements are Entangled
Enrica Troiano, Sebastian Padó, Roman Klinger
2021-03-03
Social and Information Networks · Computer Science
Evaluation and Control of Opinion Polarization and Disagreement: A Review
Yuejiang Li, Hong Vicky Zhao
2021-04-13
Physics and Society · Physics
Interplay between consensus and coherence in a model of interacting opinions
Federico Battiston, Andrea Cairoli, Vincenzo Nicosia, Adrian Baule +1
2017-04-18
Physics and Society · Physics
Meet, Discuss and Trust each other: large versus small groups
Timoteo Carletti, Duccio Fanelli, Alessio Guarino, Andrea Guazzini
2008-07-28
Computation and Language · Computer Science
A Decomposition-Based Approach for Evaluating and Analyzing Inter-Annotator Disagreement
Effi Levi, Shaul R. Shenhav
2025-06-11
Computer Science and Game Theory · Computer Science
Sharing a Reward Based on Peer Evaluations
Arthur Carvalho, Kate Larson
2013-06-04
Physics and Society · Physics
Disagreement and fragmentation in growing groups
Fanyuan Meng, Jiadong Zhu, Yuheng Yao, Enrico Maria Fenoaltea +4
2023-01-25
Computation and Language · Computer Science
Do Differences in Values Influence Disagreements in Online Discussions?
Michiel van der Meer, Piek Vossen, Catholijn M. Jonker, Pradeep K. Murukannaiah
2024-10-03
Computation and Language · Computer Science
Inter-rater Agreement on Sentence Formality
Shibamouli Lahiri, Xiaofei Lu
2014-04-22
Methodology · Statistics
Interrater agreement statistics under the two-rater dichotomous-response case with correlated decisions
Zizhong Tian, Vernon M. Chinchilli, Chan Shen, Shouhao Zhou
2024-02-14
Social and Information Networks · Computer Science
Echoes of Disagreement: Measuring Disparity in Social Consensus
Marios Papachristou, Jon Kleinberg
2025-04-11
Physics and Society · Physics
We both think you did wrong -- How agreement shapes and is shaped by indirect reciprocity
Marcus Krellner, The Anh Han
2026-04-21
Computation and Language · Computer Science
What makes you change your mind? An empirical investigation in online group decision-making conversations
Georgi Karadzhov, Tom Stafford, Andreas Vlachos
2022-07-26
Social and Information Networks · Computer Science
Effect of Group Means on the Probability of Consensus
Yoshiko Arima
2014-07-01
Discrete Mathematics · Computer Science
My part is bigger than yours -- assessment within a group of peers
Konrad Kułakowski, Jacek Szybowski
2026-03-09
Computation and Language · Computer Science
GRASP: A Disagreement Analysis Framework to Assess Group Associations in Perspectives
Vinodkumar Prabhakaran, Christopher Homan, Lora Aroyo, Aida Mostafazadeh Davani +5
2024-06-17
Social and Information Networks · Computer Science
Do peers share the same criteria for assessing grant applications?
Sven E. Hug, Michael Ochsner
2022-01-10
Computation and Language · Computer Science
Counting on Consensus: Selecting the Right Inter-annotator Agreement Metric for NLP Annotation and Evaluation
Joseph James
2026-04-02
Computer Science and Game Theory · Computer Science
A Measure of Synergy in Coalitions
Talal Rahwan, Tomasz Michalak, Michael Wooldridge
2014-04-14
General Economics · Economics
Value of agreement in decision analysis: Concept, measures and application
Tom Pape
2020-12-29
Methodology · Statistics
Sequential rank agreement methods for comparison of ranked lists
Claus Thorn Ekstrøm, Thomas Alexander Gerds, Andreas Kryger Jensen, Kasper Brink-Jensen
2015-08-28