English
Related papers

Related papers: Conversational Crowdsensing: A Parallel Intelligen…

200 papers

In the last decade, crowdsourcing has become a popular method for conducting quantitative empirical studies in human-machine interaction. The remote work on a given task in crowdworking settings suits the character of typical…

Human-Computer Interaction · Computer Science 2024-11-19 Annalena Aicher , Stefan Hillmann , Isabel Feustel , Thilo Michael , Sebastian Möller , Wolfgang Minker

Human communication involves more than explicit semantics, with implicit signals and contextual cues playing a critical role in shaping meaning. However, modern speech technologies, such as Automatic Speech Recognition (ASR) and…

Current crowd-counting models often rely on single-modal inputs, such as visual images or wireless signal data, which can result in significant information loss and suboptimal recognition performance. To address these shortcomings, we…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Zhe Cui , Yuli Li , Le-Nam Tran

As humans, we experience the world with all our senses or modalities (sound, sight, touch, smell, and taste). We use these modalities, particularly sight and touch, to convey and interpret specific meanings. Multimodal expressions are…

Machine Learning · Computer Science 2022-05-17 Anirudh Sundar , Larry Heck

Real-time conversational deliberation is a critical groupwise method for reaching decisions, solving problems, evaluating priorities, generating ideas, and producing insights. Unfortunately, real-time conversations are difficult to scale,…

Human-Computer Interaction · Computer Science 2023-09-25 Louis Rosenberg , Gregg Willcox , Hans Schumann , Ganesh Mani

Mastering commonsense understanding and reasoning is a pivotal skill essential for conducting engaging conversations. While there have been several attempts to create datasets that facilitate commonsense inferences in dialogue contexts,…

Computation and Language · Computer Science 2024-01-30 Sarah E. Finch , Jinho D. Choi

Concurrent computations resemble conversations. In a conversation, participants direct utterances at others and, as the conversation evolves, exploit the known common context to advance the conversation. Similarly, collaborating software…

Programming Languages · Computer Science 2024-09-09 Tony Garnock-Jones

Empathy is increasingly recognized as a key factor in human-AI communication, yet conventional approaches to "digital empathy" often focus on simulating internal, human-like emotional states while overlooking the inherently subjective,…

Human-Computer Interaction · Computer Science 2025-09-23 Jina Suh , Lindy Le , Erfan Shayegani , Gonzalo Ramos , Judith Amores , Desmond C. Ong , Mary Czerwinski , Javier Hernandez

We introduce Omni-MMSI, a new task that requires comprehensive social interaction understanding from raw audio, vision, and speech input. The task involves perceiving identity-attributed social cues (e.g., who is speaking what) and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Xinpeng Li , Bolin Lai , Hardy Chen , Shijian Deng , Cihang Xie , Yuyin Zhou , James Matthew Rehg , Yapeng Tian

Human conversation involves language, speech, and visual cues, with each medium providing complementary information. For instance, speech conveys a vibe or tone not fully captured by text alone. While multimodal LLMs focus on generating…

Human-Computer Interaction · Computer Science 2025-09-19 Taesoo Kim , Yongsik Jo , Hyunmin Song , Taehwan Kim

With the advent of seamless connection of human, machine, and smart things, there is an emerging trend to leverage the power of crowds (e.g., citizens, mobile devices, and smart things) to monitor what is happening in a city, understand how…

Human-Computer Interaction · Computer Science 2018-05-23 Jiangtao Wang , Yasha Wang , Daqing Zhang , Qin Lv , Chao Chen

With the development of mobile social networks, more and more crowdsourced data are generated on the Web or collected from real-world sensing. The fragment, heterogeneous, and noisy nature of online/offline crowdsourced data, however, makes…

Human-Computer Interaction · Computer Science 2019-08-08 Bin Guo , Huihui Chen , Yan Liu , Chao Chen , Qi Han , Zhiwen Yu

Recently, there has been a heightened interest in building chatbots based on Large Language Models (LLMs) to emulate human-like qualities in multi-turn conversations. Despite having access to commonsense knowledge to better understand the…

Computation and Language · Computer Science 2025-01-22 Lanrui Wang , Jiangnan Li , Chenxu Yang , Zheng Lin , Hongyin Tang , Huan Liu , Yanan Cao , Jingang Wang , Weiping Wang

Conversational recommender systems (CRSs) have become crucial emerging research topics in the field of RSs, thanks to their natural advantages of explicitly acquiring user preferences via interactive conversations and revealing the reasons…

Information Retrieval · Computer Science 2023-06-16 Xinghua Qu , Hongyang Liu , Zhu Sun , Xiang Yin , Yew Soon Ong , Lu Lu , Zejun Ma

The main goal of this paper is to discuss how to integrate the possibilities of crowdsourcing platforms with systems supporting workflow to enable the engagement and interaction with business tasks of a wider group of people. Thus, this…

Human-Computer Interaction · Computer Science 2021-01-05 Rafał Masłyk , Kinga Skorupska , Piotr Gago , Marcin Niewiński , Barbara Karpowicz , Anna Jaskulska , Katarzyna Abramczuk , Wiesław Kopeć

TalkWithMachines aims to enhance human-robot interaction by contributing to interpretable industrial robotic systems, especially for safety-critical applications. The presented paper investigates recent advancements in Large Language Models…

Robotics · Computer Science 2024-12-23 Ammar N. Abbas , Csaba Beleznai

Instruments such as eye-tracking devices have contributed to understanding how users interact with screen-based search engines. However, user-system interactions in audio-only channels -- as is the case for Spoken Conversational Search…

Human-Computer Interaction · Computer Science 2024-08-08 Kaixin Ji , Sachin Pathiyan Cherumanal , Johanne R. Trippas , Danula Hettiachchi , Flora D. Salim , Falk Scholer , Damiano Spina

Over the past decade, wearable computing devices (``smart glasses'') have undergone remarkable advancements in sensor technology, design, and processing power, ushering in a new era of opportunity for high-density human behavior data.…

The prevailing paradigm in the domain of Open-Domain Dialogue agents predominantly focuses on the English language, encompassing both models and datasets. Furthermore, the financial and temporal investments required for crowdsourcing such…

Computation and Language · Computer Science 2025-03-06 Ahmed Njifenjou , Virgile Sucal , Bassam Jabaian , Fabrice Lefèvre

Some complex problems, such as image tagging and natural language processing, are very challenging for computers, where even state-of-the-art technology is yet able to provide satisfactory accuracy. Therefore, rather than relying solely on…

Databases · Computer Science 2012-07-03 Xuan Liu , Meiyu Lu , Beng Chin Ooi , Yanyan Shen , Sai Wu , Meihui Zhang