English
Related papers

Related papers: PAGAN: Video Affect Annotation Made Easy

200 papers

We employ crowdsourcing to acquire time-continuous affective annotations for movie clips, and refine noisy models trained from these crowd annotations incorporating expert information within a Multi-task Learning (MTL) framework. We propose…

Multimedia · Computer Science 2021-12-17 Ramanathan Subramanian , Yan Yan , Nicu Sebe

Avatar creation from human images allows users to customize their digital figures in different styles. Existing rendering systems like Bitmoji, MetaHuman, and Google Cartoonset provide expressive rendering systems that serve as excellent…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Minghao Liu , Zeyu Cheng , Shen Sang , Jing Liu , James Davis

Physiological signals hold immense potential for ubiquitous emotion monitoring, presenting numerous applications in emotion recognition. However, harnessing this potential is hindered by significant challenges, particularly in the…

Human-Computer Interaction · Computer Science 2025-03-30 Pragya Singh , Ritvik Budhiraja , Pankaj Jalote , Mohan Kumar , Pushpendra Singh

This paper introduces a new web-based software tool for annotating text, Text Annotation Graphs, or TAG. It provides functionality for representing complex relationships between words and word phrases that are not available in other…

Computation and Language · Computer Science 2018-03-02 Angus G. Forbes , Kristine Lee , Gus Hahn-Powell , Marco A. Valenzuela-Escárcega , Mihai Surdeanu

How can we model affect in a general fashion, across dissimilar tasks, and to which degree are such general representations of affect even possible? To address such questions and enable research towards general affective computing, this…

Human-Computer Interaction · Computer Science 2022-07-29 David Melhart , Antonios Liapis , Georgios N. Yannakakis

Interpretability and human oversight are fundamental pillars of deploying complex NLP models into real-world applications. However, applying explainability and human-in-the-loop methods requires technical proficiency. Despite existing…

Computation and Language · Computer Science 2023-10-03 Edoardo Mosca , Daryna Dementieva , Tohid Ebrahim Ajdari , Maximilian Kummeth , Kirill Gringauz , Yutong Zhou , Georg Groh

Object affordance is an important concept in human-object interaction, providing information on action possibilities based on human motor capacity and objects' physical property thus benefiting tasks such as action anticipation and robot…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Zecheng Yu , Yifei Huang , Ryosuke Furuta , Takuma Yagi , Yusuke Goutsu , Yoichi Sato

We propose a multi-explanation graph attention network (MEGAN). Unlike existing graph explainability methods, our network can produce node and edge attributional explanations along multiple channels, the number of which is independent of…

Machine Learning · Computer Science 2024-02-20 Jonas Teufel , Luca Torresi , Patrick Reiser , Pascal Friederich

We propose a point cloud annotation framework that employs human-in-loop learning to enable the creation of large point cloud datasets with per-point annotations. Sparse labels from a human annotator are iteratively propagated to generate a…

Computer Vision and Pattern Recognition · Computer Science 2019-06-12 Siddhant Jain , Sowmya Munukutla , David Held

Annotating data via crowdsourcing is time-consuming and expensive. Due to these costs, dataset creators often have each annotator label only a small subset of the data. This leads to sparse datasets with examples that are marked by few…

Computation and Language · Computer Science 2023-10-06 London Lowmanstone , Ruyuan Wan , Risako Owan , Jaehyung Kim , Dongyeop Kang

Map representations learned by expert demonstrations have shown promising research value. However, the field of visual navigation still faces challenges due to the lack of real-world human-navigation datasets that can support efficient,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Faith Johnson , Bryan Bo Cao , Kristin Dana , Shubham Jain , Ashwin Ashok

Deep learning in medical imaging faces obstacles: limited data diversity, ethical issues, high acquisition costs, and the need for precise annotations. Bleeding detection and localization during surgery is especially challenging due to the…

Image and Video Processing · Electrical Eng. & Systems 2025-06-18 Niran Nataraj , Maina Sogabe , Kenji Kawashima

Relying on crowdsourced workers, data crowdsourcing platforms are able to efficiently provide vast amounts of labeled data. Due to the variability in the annotation quality of crowd workers, modern techniques resort to redundant annotations…

Human-Computer Interaction · Computer Science 2023-11-28 Haoyu Liu , Fei Wang , Minmin Lin , Runze Wu , Renyu Zhu , Shiwei Zhao , Kai Wang , Tangjie Lv , Changjie Fan

A lot of real-world phenomena are complex and cannot be captured by single task annotations. This causes a need for subsequent annotations, with interdependent questions and answers describing the nature of the subject at hand. Even in the…

Computation and Language · Computer Science 2020-10-05 Moritz Wolf , Dana Ruiter , Ashwin Geet D'Sa , Liane Reiners , Jan Alexandersson , Dietrich Klakow

Supervised classification heavily depends on datasets annotated by humans. However, in subjective tasks such as toxicity classification, these annotations often exhibit low agreement among raters. Annotations have commonly been aggregated…

Computation and Language · Computer Science 2024-05-17 Negar Mokhberian , Myrl G. Marmarelis , Frederic R. Hopp , Valerio Basile , Fred Morstatter , Kristina Lerman

Large-scale annotated datasets allow AI systems to learn from and build upon the knowledge of the crowd. Many crowdsourcing techniques have been developed for collecting image annotations. These techniques often implicitly rely on the fact…

Human-Computer Interaction · Computer Science 2016-10-07 Gunnar A. Sigurdsson , Olga Russakovsky , Ali Farhadi , Ivan Laptev , Abhinav Gupta

Affect recognition aims to detect a person's affective state based on observables, with the goal to e.g. provide reasoning for decision making or support mental wellbeing. Recently, besides approaches based on audio, visual or text…

Human-Computer Interaction · Computer Science 2018-11-22 Philip Schmidt , Attila Reiss , Robert Duerichen , Kristof Van Laerhoven

We have seen significant leapfrog advancement in machine learning in recent decades. The central idea of machine learnability lies on constructing learning algorithms that learn from good data. The availability of more data being made…

Computer Vision and Pattern Recognition · Computer Science 2020-08-07 Ng Hui Xian Lynnette , Henry Ng Siong Hock , Nguwi Yok Yen

Understanding human affect can be used in robotics, marketing, education, human-computer interaction, healthcare, entertainment, autonomous driving, and psychology to enhance decision-making, personalize experiences, and improve emotional…

Human-Computer Interaction · Computer Science 2025-10-02 Helen Schneider , Svetlana Pavlitska , Helen Gremmelmaier , J. Marius Zöllner

Crowdsourcing platforms use various truth discovery algorithms to aggregate annotations from multiple labelers. In an online setting, however, the main challenge is to decide whether to ask for more annotations for each item to efficiently…

Human-Computer Interaction · Computer Science 2024-01-30 Reshef Meir , Viet-An Nguyen , Xu Chen , Jagdish Ramakrishnan , Udi Weinsberg