English

Do Schwartz Higher-Order Values Help Sentence-Level Human Value Detection? A Study of Hierarchical Gating and Calibration

Computation and Language 2026-04-08 v3 Artificial Intelligence Machine Learning

Abstract

Human value detection from single sentences is a sparse, imbalanced multi-label task. We study whether Schwartz higher-order (HO) categories help this setting on ValueEval'24 / ValuesML (74K English sentences) under a compute-frugal budget. Rather than proposing a new architecture, we compare direct supervised transformers, hard HO\rightarrowvalues pipelines, Presence\rightarrowHO\rightarrowvalues cascades, compact instruction-tuned large language models (LLMs), QLoRA, and low-cost upgrades such as threshold tuning and small ensembles. HO categories are learnable: the easiest bipolar pair, Growth vs. Self-Protection, reaches Macro-F1=0.58F_1=0.58. The most reliable gains come from calibration and ensembling: threshold tuning improves Social Focus vs. Personal Focus from 0.410.41 to 0.570.57 (+0.16+0.16), transformer soft voting lifts Growth from 0.2860.286 to 0.3030.303, and a Transformer+LLM hybrid reaches 0.3530.353 on Self-Protection. In contrast, hard hierarchical gating does not consistently improve the end task. Compact LLMs also underperform supervised encoders as stand-alone systems, although they sometimes add useful diversity in hybrid ensembles. Under this benchmark, the HO structure is more useful as an inductive bias than as a rigid routing rule.

Keywords

Cite

@article{arxiv.2602.00913,
  title  = {Do Schwartz Higher-Order Values Help Sentence-Level Human Value Detection? A Study of Hierarchical Gating and Calibration},
  author = {Víctor Yeste and Paolo Rosso},
  journal= {arXiv preprint arXiv:2602.00913},
  year   = {2026}
}

Comments

Code: https://github.com/VictorMYeste/human-value-detection, models: https://huggingface.co/papers/2602.00913, 27 pages, 4 figures