English
Related papers

Related papers: Cognitive Principles in Robust Multimodal Interpre…

200 papers

The Memory-Centred Cognition perspective places an active association substrate at the heart of cognition, rather than as a passive adjunct. Consequently, it places prediction and priming on the basis of prior experience to be inherent and…

Robotics · Computer Science 2016-02-19 Paul Baxter

Society's capacity for algorithmic problem-solving has never been greater. Artificial Intelligence is now applied across more domains than ever, a consequence of powerful abstractions, abundant data, and accessible software. As capabilities…

Machine Learning · Statistics 2024-08-20 Kris Sankaran

Machine common sense remains a broad, potentially unbounded problem in artificial intelligence (AI). There is a wide range of strategies that can be employed to make progress on this challenge. This article deals with the aspects of…

Artificial Intelligence · Computer Science 2020-06-16 Alexander Gavrilenko , Katerina Morozova

With the recently increasing capabilities of modern vehicles, novel approaches for interaction emerged that go beyond traditional touch-based and voice command approaches. Therefore, hand gestures, head pose, eye gaze, and speech have been…

Human-Computer Interaction · Computer Science 2022-11-08 Amr Gomaa

As a paradigm that delves into the deep seated drivers of user behavior, motivation-based recommendation systems have emerged as a prominent research direction in the field of personalized information retrieval. Unlike traditional…

Information Retrieval · Computer Science 2026-03-16 Yicheng Di

Reasoning is central to human intelligence, enabling structured problem-solving across diverse tasks. Recent advances in large language models (LLMs) have greatly enhanced their reasoning abilities in arithmetic, commonsense, and symbolic…

Multi-choice machine reading comprehension (MRC) requires models to choose the correct answer from candidate options given a passage and a question. Our research focuses dialogue-based MRC, where the passages are multi-turn dialogues. It…

Computation and Language · Computer Science 2020-09-11 Junlong Li , Zhuosheng Zhang , Hai Zhao

As the boundaries of human computer interaction expand, Generative AI emerges as a key driver in reshaping user interfaces, introducing new possibilities for personalized, multimodal and cross-platform interactions. This integration…

Human-Computer Interaction · Computer Science 2024-11-18 J. Bieniek , M. Rahouti , D. C. Verma

Multi-role dialogue summarization requires modeling complex interactions among multiple speakers while preserving role-specific information and factual consistency. However, most existing methods optimize for automatic metrics such as ROUGE…

Computation and Language · Computer Science 2026-04-29 Xiaoyong Mei , Tingting Zuo , Da Chen , Guangyu Hu , Xiangyu Wen , Chao Duan , Mingyan Zhang , Fudan Zheng

Semantic communication aims to transmit information most relevant to a task rather than raw data, offering significant gains in communication efficiency for applications such as telepresence, augmented reality, and remote sensing. Recent…

Machine Learning · Computer Science 2025-12-18 Matin Mortaheb , Erciyes Karakaya , Sennur Ulukus

Human-robot interaction is increasingly moving toward multi-robot, socially grounded environments. Existing systems struggle to integrate multimodal perception, embodied expression, and coordinated decision-making in a unified framework.…

Robotics · Computer Science 2026-03-25 Shaid Hasan , Breenice Lee , Sujan Sarker , Tariq Iqbal

Human emotions are expressed through multiple modalities, including verbal and non-verbal information. Moreover, the affective states of human users can be the indicator for the level of engagement and successful interaction, suitable for…

Robotics · Computer Science 2021-10-12 Baijun Xie , Chung Hyuk Park

This work discusses how to build more rational language and multimodal agents and what criteria define rationality in intelligent systems. Rationality is the quality of being guided by reason, characterized by decision-making that aligns…

Artificial Intelligence · Computer Science 2025-02-18 Bowen Jiang , Yangxinyu Xie , Xiaomeng Wang , Yuan Yuan , Zhuoqun Hao , Xinyi Bai , Weijie J. Su , Camillo J. Taylor , Tanwi Mallick

Traditional psychological evaluations rely heavily on human observation and interpretation, which are prone to subjectivity, bias, fatigue, and inconsistency. To address these limitations, this work presents a multimodal emotion recognition…

Human-Computer Interaction · Computer Science 2024-12-25 Kris Kraack

Multimodal sentiment analysis benefits various applications such as human-computer interaction and recommendation systems. It aims to infer the users' bipolar ideas using visual, textual, and acoustic signals. Although researchers affirm…

Machine Learning · Computer Science 2021-06-29 Sana Rahmani , Saeid Hosseini , Raziyeh Zall , Mohammad Reza Kangavari , Sara Kamran , Wen Hua

There is a growing need for social robots and intelligent agents that can effectively interact with and support users. For the interactions to be seamless, the agents need to analyse social scenes and behavioural cues from their (robot's)…

Robotics · Computer Science 2025-10-28 Tongfei Bian , Mathieu Chollet , Tanaya Guha

We describe an ongoing project in learning to perform primitive actions from demonstrations using an interactive interface. In our previous work, we have used demonstrations captured from humans performing actions as training samples for a…

Robotics · Computer Science 2018-10-02 Tuan Do , Nikhil Krishnaswamy , Kyeongmin Rim , James Pustejovsky

Humans convey their intentions through the usage of both verbal and nonverbal behaviors during face-to-face communication. Speaker intentions often vary dynamically depending on different nonverbal contexts, such as vocal patterns and…

Computation and Language · Computer Science 2018-11-27 Yansen Wang , Ying Shen , Zhun Liu , Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency

In this paper, we advance the study of AI-augmented reasoning in the context of Human-Computer Interaction (HCI), psychology and cognitive science, focusing on the critical task of visual perception. Specifically, we investigate the…

Human-Computer Interaction · Computer Science 2025-04-18 Shravan Chaudhari , Trilokya Akula , Yoon Kim , Tom Blake

Reward modeling has emerged as a crucial component in aligning large language models with human values. Significant attention has focused on using reward models as a means for fine-tuning generative models. However, the reward models…

Computation and Language · Computer Science 2026-02-04 Brian Christian , Hannah Rose Kirk , Jessica A. F. Thompson , Christopher Summerfield , Tsvetomira Dumbalska