English
Related papers

Related papers: AULLM++: Structural Reasoning with Large Language …

200 papers

The Facial Action Coding System (FACS) encodes the action units (AUs) in facial images, which has attracted extensive research attention due to its wide use in facial expression analysis. Many methods that perform well on automatic facial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Xuri Ge , Joemon M. Jose , Songpei Xu , Xiao Liu , Hu Han

Compound Expression Recognition (CER) is crucial for understanding human emotions and improving human-computer interaction. However, CER faces challenges due to the complexity of facial expressions and the difficulty of capturing subtle…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Jun Yu , Xilong Lu

With the rapid development of Multimodal Large Language Models (MLLMs), their potential in Micro-Action understanding, a vital role in human emotion analysis, remains unexplored due to the absence of specialized benchmarks. To tackle this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Kun Li , Jihao Gu , Fei Wang , Zhiliang Wu , Hehe Fan , Dan Guo

Unlike macro-expression, micro-expression does not follow a strictly consistent mapping rule between emotions and Action Units (AUs). As a result, some micro-expressions share identical AUs yet represent completely opposite emotional…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Chenxing Hu , Kun Xie , Qiguang Miao , Ruyi Liu , Quan Wang , Zongkai Yang

Audio-Visual Large Language Models (AVLLMs) are emerging as unified interfaces to multimodal perception. We present the first mechanistic interpretability study of AVLLMs, analyzing how audio and visual features evolve and fuse through…

Artificial Intelligence · Computer Science 2026-04-06 Ramaneswaran Selvakumar , Kaousheik Jayakumar , S Sakshi , Sreyan Ghosh , Ruohan Gao , Dinesh Manocha

Facial Action Units (AUs) detection is a cornerstone of objective facial expression analysis and a critical focus in affective computing. Despite its importance, AU detection faces significant challenges, such as the high cost of AU…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Bohao Xing , Kaishen Yuan , Zitong Yu , Xin Liu , Heikki Kälviäinen

This paper describes our system submitted to SemEval-2026 Task 11: Disentangling Content and Formal Reasoning in Large Language Models. We present an efficient modular neuro-symbolic approach, combining a symbolic prover with small…

Computation and Language · Computer Science 2026-05-07 Ivan Kartáč , Kristýna Onderková , Jan Bronec , Zdeněk Kasner , Mateusz Lango , Ondřej Dušek

Human language is grounded on multimodal knowledge including visual knowledge like colors, sizes, and shapes. However, current large-scale pre-trained language models rely on text-only self-supervised training with massive text data, which…

Computation and Language · Computer Science 2023-02-28 Weizhi Wang , Li Dong , Hao Cheng , Haoyu Song , Xiaodong Liu , Xifeng Yan , Jianfeng Gao , Furu Wei

Recent studies have demonstrated the effectiveness of Large Language Models (LLMs) as reasoning modules that can deconstruct complex tasks into more manageable sub-tasks, particularly when applied to visual reasoning tasks for images. In…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ahmad Mahmood , Ashmal Vayani , Muzammal Naseer , Salman Khan , Fahad Shahbaz Khan

The demand for efficient large language model (LLM) inference has propelled the development of dedicated accelerators. As accelerators are vulnerable to hardware faults due to aging, variation, etc, existing accelerator designs often…

Hardware Architecture · Computer Science 2025-04-08 Tong Xie , Jiawang Zhao , Zishen Wan , Zuodong Zhang , Yuan Wang , Runsheng Wang , Ru Huang , Meng Li

Large Language Models have advanced clinical text classification, but their opaque predictions remain a critical barrier to practical adoption in research and clinical settings where investigators and physicians need to understand which…

Computation and Language · Computer Science 2025-11-18 Karthikeyan K , Raghuveer Thirukovalluru , David Carlson

Current video understanding models excel at recognizing "what" is happening but fall short in high-level cognitive tasks like causal reasoning and future prediction, a limitation rooted in their lack of commonsense world knowledge. To…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 L'ea Dubois , Klaus Schmidt , Chengyu Wang , Ji-Hoon Park , Lin Wang , Santiago Munoz

Datasets used for emotion recognition tasks typically contain overt cues that can be used in predicting the emotions expressed in a text. However, one challenge is that texts sometimes contain covert contextual cues that are rich in…

Computation and Language · Computer Science 2025-06-03 Gerard Christopher Yeo , Kokil Jaidka

When performing complex multi-step reasoning tasks, the ability of Large Language Models (LLMs) to derive structured intermediate proof steps is important for ensuring that the models truly perform the desired reasoning and for improving…

Computation and Language · Computer Science 2025-01-31 Zi'ou Zheng , Christopher Malon , Martin Renqiang Min , Xiaodan Zhu

Small Language Models (SLMs) are a cost-effective alternative to Large Language Models (LLMs), but often struggle with complex reasoning due to their limited capacity and a tendency to produce mistakes or inconsistent answers during…

Computation and Language · Computer Science 2025-08-19 Yuanfeng Xu , Zehui Dai , Jian Liang , Jiapeng Guan , Guangrun Wang , Liang Lin , Xiaohui Lv

In this paper, we propose BeamLLM, a vision-aided millimeter-wave (mmWave) beam prediction framework leveraging large language models (LLMs) to address the challenges of high training overhead and latency in mmWave communication systems. By…

Machine Learning · Computer Science 2025-06-30 Can Zheng , Jiguang He , Guofa Cai , Zitong Yu , Chung G. Kang

Facial expression recognition (FER) is an important research topic in emotional artificial intelligence. In recent decades, researchers have made remarkable progress. However, current FER paradigms face challenges in generalization, lack…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Bohao Xing , Zitong Yu , Xin Liu , Kaishen Yuan , Qilang Ye , Weicheng Xie , Huanjing Yue , Jingyu Yang , Heikki Kälviäinen

Affective computing seeks to support the holistic development of artificial intelligence by enabling machines to engage with human emotion. Recent foundation models, particularly large language models (LLMs), have been trained and evaluated…

Computation and Language · Computer Science 2026-03-16 Sree Bhattacharyya , Evgenii Kuriabov , Lucas Craig , Tharun Dilliraj , Reginald B. Adams, , Jia Li , James Z. Wang

Although Large Language Models (LLMs) excel at addressing straightforward reasoning tasks, they frequently struggle with difficulties when confronted by more complex multi-step reasoning due to a range of factors. Firstly, natural language…

Computation and Language · Computer Science 2024-02-22 Kewei Cheng , Nesreen K. Ahmed , Theodore Willke , Yizhou Sun

Many recent studies have found evidence for emergent reasoning capabilities in large language models (LLMs), but debate persists concerning the robustness of these capabilities, and the extent to which they depend on structured reasoning…

Computation and Language · Computer Science 2025-06-09 Yukang Yang , Declan Campbell , Kaixuan Huang , Mengdi Wang , Jonathan Cohen , Taylor Webb