English
Related papers

Related papers: Whether, Not Which: Mechanistic Interpretability R…

200 papers

Large Language Models (LLMs) are becoming increasingly popular in pervasive computing due to their versatility and strong performance. However, despite their ubiquitous use, the exact mechanisms underlying their outstanding performance…

Computation and Language · Computer Science 2026-02-02 Alhassan Abdelhalim , Janick Edinger , Sören Laue , Michaela Regneri

Recent studies on reasoning in language models (LMs) have sparked a debate on whether they can learn systematic inferential principles or merely exploit superficial patterns in the training data. To understand and uncover the mechanisms…

Computation and Language · Computer Science 2025-06-24 Geonhee Kim , Marco Valentino , André Freitas

Speech Emotion Recognition is a crucial area of research in human-computer interaction. While significant work has been done in this field, many state-of-the-art networks struggle to accurately recognize emotions in speech when the data is…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-23 Rashedul Hasan , Meher Nigar , Nursadul Mamun , Sayan Paul

Through considerable effort and intuition, several recent works have reverse-engineered nontrivial behaviors of transformer models. This paper systematizes the mechanistic interpretability process they followed. First, researchers choose a…

Machine Learning · Computer Science 2023-10-31 Arthur Conmy , Augustine N. Mavor-Parker , Aengus Lynch , Stefan Heimersheim , Adrià Garriga-Alonso

Annotating and recognizing speech emotion using prompt engineering has recently emerged with the advancement of Large Language Models (LLMs), yet its efficacy and reliability remain questionable. In this paper, we conduct a systematic study…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-01 Yuanchao Li , Yuan Gong , Chao-Han Huck Yang , Peter Bell , Catherine Lai

The widespread adoption of automatic sentiment and emotion classifiers makes it important to ensure that these tools perform reliably across different populations. Yet their reliability is typically assessed using benchmarks that rely on…

Computation and Language · Computer Science 2026-01-09 Ivan Smirnov , Segun T. Aroyehun , Paul Plener , David Garcia

Emotions widely affect human decision-making. This fact is taken into account by affective computing with the goal of tailoring decision support to the emotional states of individuals. However, the accurate recognition of emotions within…

Computation and Language · Computer Science 2018-11-14 Bernhard Kratzwald , Suzana Ilic , Mathias Kraus , Stefan Feuerriegel , Helmut Prendinger

This research aims at identifying the unknown emotion using speaker cues. In this study, we identify the unknown emotion using a two-stage framework. The first stage focuses on identifying the speaker who uttered the unknown emotion, while…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-11 Ismail Shahin

The subjective perception of emotion leads to inconsistent labels from human annotators. Typically, utterances lacking majority-agreed labels are excluded when training an emotion classifier, which cause problems when encountering ambiguous…

Computation and Language · Computer Science 2024-10-14 Wen Wu , Bo Li , Chao Zhang , Chung-Cheng Chiu , Qiujia Li , Junwen Bai , Tara N. Sainath , Philip C. Woodland

Affective Computing (AC) is essential for advancing Artificial General Intelligence (AGI), with emotion recognition serving as a key component. However, human emotions are inherently dynamic, influenced not only by an individual's…

Computation and Language · Computer Science 2025-03-31 Yupei Li , Qiyang Sun , Sunil Munthumoduku Krishna Murthy , Emran Alturki , Björn W. Schuller

Transformer-based large-scale language models (LLMs) are able to generate highly realistic text. They are duly able to express, and at least implicitly represent, a wide range of sentiments and color, from the obvious, such as valence and…

Computation and Language · Computer Science 2023-07-06 Chris Gagne , Peter Dayan

Emotional and cognitive factors are essential for understanding mental health disorders. However, existing methods often treat multi-modal data as classification tasks, limiting interpretability especially for emotion and cognition.…

Multimedia · Computer Science 2026-03-03 Zhiyuan Zhou , Yanrong Guo , Shijie Hao

Mechanistic interpretability produces circuit-level causal analyses of neural network behaviour, but discovered circuits often remain isolated experimental artefacts: there is no shared formal representation for what circuits compute, how…

Machine Learning · Computer Science 2026-05-21 Nura Aljaafari , Danilo S. Carvalho , Andre Freitas

Implicit Sentiment Analysis (ISA) aims to infer sentiment that is implied rather than explicitly stated, requiring models to perform deeper reasoning over subtle contextual cues. While recent prompting-based methods using Large Language…

Computation and Language · Computer Science 2025-07-02 Jing Ren , Wenhao Zhou , Bowen Li , Mujie Liu , Nguyen Linh Dan Le , Jiade Cen , Liping Chen , Ziqi Xu , Xiwei Xu , Xiaodong Li

In recent years, speech emotion recognition (SER) has been used in wide ranging applications, from healthcare to the commercial sector. In addition to signal processing approaches, methods for SER now also use deep learning techniques.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-06 Sneha Das , Nicole Nadine Lønfeldt , Anne Katrine Pagsberg , Line H. Clemmensen

Human verbal communication includes affective messages which are conveyed through use of emotionally colored words. There has been a lot of research in this direction but the problem of integrating state-of-the-art neural language models…

Computation and Language · Computer Science 2017-04-25 Sayan Ghosh , Mathieu Chollet , Eugene Laksana , Louis-Philippe Morency , Stefan Scherer

Speech Emotion Recognition (SER) is essential for improving human-computer interaction, yet its accuracy remains constrained by the complexity of emotional nuances in speech. In this study, we distinguish between descriptive semantics,…

Computation and Language · Computer Science 2025-10-06 Rongchen Guo , Vincent Francoeur , Isar Nejadgholi , Sylvain Gagnon , Miodrag Bolic

Emotional tone is pervasive in human communication, yet its influence on large language model (LLM) behaviour remains unclear. Here, we examine how first-person emotional framing in user-side queries affect LLM performance across six…

Artificial Intelligence · Computer Science 2026-04-03 Minda Zhao , Yutong Yang , Chufei Peng , Rachel Gonsalves , Weiyue Li , Ruyi Yang , Zhixi Liu , Mengyu Wang

Emotion recognition from speech is a challenging task that requires capturing both linguistic and paralinguistic cues, with critical applications in human-computer interaction and mental health monitoring. Recent works have highlighted the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-21 Hugo Thimonier , Antony Perzo , Renaud Seguier

Understanding emotions is fundamental to human interaction and experience. Humans easily infer emotions from situations or facial expressions, situations from emotions, and do a variety of other affective cognition. How adept is modern AI…

Computation and Language · Computer Science 2026-02-18 Kanishk Gandhi , Zoe Lynch , Jan-Philipp Fränken , Kayla Patterson , Sharon Wambu , Tobias Gerstenberg , Desmond C. Ong , Noah D. Goodman