English
Related papers

Related papers: Estuary: A Framework For Building Multimodal Low-L…

200 papers

Current validation methods often rely on recorded data and basic functional checks, which may not be sufficient to encompass the scenarios an autonomous vehicle might encounter. In addition, there is a growing need for complex scenarios…

Robotics · Computer Science 2024-02-08 Marc Kaufeld , Rainer Trauth , Johannes Betz

Rapid identification of hazardous events is essential for next-generation Earth Observation (EO) missions supporting disaster response. However, current monitoring pipelines remain largely ground-centric, introducing latency due to downlink…

AI systems are becoming active participants in organizational and knowledge work. They increasingly interact with humans, coordinate workflows, and operate in multi-agent arrangements. Understanding their effects therefore requires more…

Artificial Intelligence · Computer Science 2026-05-19 Yingjie Zhang , Chun Feng , Weizhang Zhu , Tianshu Sun

The interaction context (or environment) is key to any HCI task and especially to adaptive user interfaces (AUIs), since it represents the conditions under which users interact with computers. Unfortunately, there are currently no formal…

Human-Computer Interaction · Computer Science 2022-04-01 Mateusz Dubiel , Bereket Abera Yilma , Kayhan Latifzadeh , Luis A. Leiva

Generative design, an AI-assisted technology for optimizing design through algorithmic processes, is propelling advancements across numerous fields. As the use of immersive environments such as Augmented Reality (AR) continues to rise,…

Human-Computer Interaction · Computer Science 2025-03-28 Sora Kang , Kaiwen Yu , Xinyi Zhou , Joonhwan Lee

Task-oriented dialogue systems can efficiently serve a large number of customers and relieve people from tedious works. However, existing task-oriented dialogue systems depend on handcrafted actions and states or extra semantic labels,…

Computation and Language · Computer Science 2017-11-13 Weiyan Wang , Yuxiang WU , Yu Zhang , Zhongqi Lu , Kaixiang Mo , Qiang Yang

With the rapid development of mobile intelligent assistant technologies, multi-modal AI assistants have become essential interfaces for daily user interactions. However, current evaluation methods face challenges including high manual…

Artificial Intelligence · Computer Science 2025-10-22 Meiping Wang , Jian Zhong , Rongduo Han , Liming Kang , Zhengkun Shi , Xiao Liang , Xing Lin , Nan Gao , Haining Zhang

Many challenges remain before AI agents can be deployed in real-world environments. However, one virtue of such environments is that they are inherently multi-agent and contain human experts. Using advanced social intelligence in such an…

Machine Learning · Computer Science 2025-08-22 Eric Ye , Ren Tao , Natasha Jaques

Contemporary multi-agent systems encounter persistent challenges in cross-platform interoperability, dynamic task scheduling, and efficient resource sharing. Agents with heterogeneous implementations often lack standardized interfaces;…

Artificial Intelligence · Computer Science 2025-07-08 Yuyang Cheng , Yumiao Xu , Chaojia Yu , Yong Zhao

Conversational human-AI interaction (CHAI) have recently driven mainstream adoption of AI. However, CHAI poses two key challenges for designers and researchers: users frequently have ambiguous goals and an incomplete understanding of AI…

Human-Computer Interaction · Computer Science 2025-01-31 Arthur Caetano , Kavya Verma , Atieh Taheri , Radha Kumaran , Zichen Chen , Jiaao Chen , Tobias Höllerer , Misha Sra

We introduce the concept of "Design Agents" for engineering applications, particularly focusing on the automotive design process, while emphasizing that our approach can be readily extended to other engineering and design domains. Our…

Artificial Intelligence · Computer Science 2025-12-04 Mohamed Elrefaie , Janet Qian , Raina Wu , Qian Chen , Angela Dai , Faez Ahmed

This study proposes a multi-agent language framework that enables continual strategy evolution without fine-tuning the language model's parameters. The core idea is to liberate the latent vectors of abstract concepts from traditional static…

Machine Learning · Computer Science 2026-01-06 Wenlong Tang

Multimodal Large Language Model (MLLM)-based Graphical User Interface (GUI) agents develop rapidly, with visual grounding that maps natural language instructions to target UI elements serving as the core capability. Existing GUI agents…

Machine Learning · Computer Science 2026-03-17 Ziwei Liu , Tao Feng , Borui Kang , Yanbing Yang , Jun Luo

Problem: Effective patient-centered communication is a core competency for physicians. However, both seasoned providers and medical trainees report decreased confidence in leading conversations on sensitive topics such as goals of care or…

Human-Computer Interaction · Computer Science 2024-05-31 Simon N. Chu , Alex J. Goodell

Recent developments in Generative Artificial Intelligence (GenAI) have created significant uncertainty in education, particularly in terms of assessment practices. Against this backdrop, we present an updated version of the AI Assessment…

Computers and Society · Computer Science 2025-10-01 Mike Perkins , Jasper Roe , Leon Furze

To support the stringent requirements of the future intelligent and interactive applications, intelligence needs to become an essential part of the resource management in the edge environment. Developing intelligent orchestration solutions…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-03 Henna Kokkonen , Susanna Pirttikangas , Lauri Lovén

The increasing deployment of autonomous AI agents on the web is hampered by a fundamental misalignment: agents must infer affordances from human-oriented user interfaces, leading to brittle, inefficient, and insecure interactions. To…

Human-Computer Interaction · Computer Science 2025-11-17 Sven Schultze , Meike Verena Kietzmann , Nils-Lucas Schönfeld , Ruth Stock-Homburg

Agentic AI (AAI), which extends Large Language Models with enhanced reasoning capabilities, has emerged as a promising paradigm for autonomous edge service scheduling. However, user mobility creates highly dynamic service demands in edge…

Networking and Internet Architecture · Computer Science 2026-01-21 Yan Sun , Yinqiu Liu , Shaoyong Guo , Ruichen Zhang , Feng Qi , Xuesong Qiu , Weifeng Gong , Dusit Niyato , Qihui Wu

As large language models (LLMs) are embedded into mental health technologies, they are often framed either as tools assisting therapists or autonomous therapeutic systems. Such perspectives overlook their potential to mediate relational…

Human-Computer Interaction · Computer Science 2025-12-30 Jiatao Quan , Ziyue Li , Tian Qi Zhu , Yuxuan Li , Baoying Wang , Wanda Pratt , Nan Gao

Real-time speech interaction, serving as a fundamental interface for human-machine collaboration, holds immense potential. However, current open-source models face limitations such as high costs in voice data collection, weakness in dynamic…

Computation and Language · Computer Science 2025-02-19 Ailin Huang , Boyong Wu , Bruce Wang , Chao Yan , Chen Hu , Chengli Feng , Fei Tian , Feiyu Shen , Jingbei Li , Mingrui Chen , Peng Liu , Ruihang Miao , Wang You , Xi Chen , Xuerui Yang , Yechang Huang , Yuxiang Zhang , Zheng Gong , Zixin Zhang , Hongyu Zhou , Jianjian Sun , Brian Li , Chengting Feng , Changyi Wan , Hanpeng Hu , Jianchang Wu , Jiangjie Zhen , Ranchen Ming , Song Yuan , Xuelin Zhang , Yu Zhou , Bingxin Li , Buyun Ma , Hongyuan Wang , Kang An , Wei Ji , Wen Li , Xuan Wen , Xiangwen Kong , Yuankai Ma , Yuanwei Liang , Yun Mou , Bahtiyar Ahmidi , Bin Wang , Bo Li , Changxin Miao , Chen Xu , Chenrun Wang , Dapeng Shi , Deshan Sun , Dingyuan Hu , Dula Sai , Enle Liu , Guanzhe Huang , Gulin Yan , Heng Wang , Haonan Jia , Haoyang Zhang , Jiahao Gong , Junjing Guo , Jiashuai Liu , Jiahong Liu , Jie Feng , Jie Wu , Jiaoren Wu , Jie Yang , Jinguo Wang , Jingyang Zhang , Junzhe Lin , Kaixiang Li , Lei Xia , Li Zhou , Liang Zhao , Longlong Gu , Mei Chen , Menglin Wu , Ming Li , Mingxiao Li , Mingliang Li , Mingyao Liang , Na Wang , Nie Hao , Qiling Wu , Qinyuan Tan , Ran Sun , Shuai Shuai , Shaoliang Pang , Shiliang Yang , Shuli Gao , Shanshan Yuan , Siqi Liu , Shihong Deng , Shilei Jiang , Sitong Liu , Tiancheng Cao , Tianyu Wang , Wenjin Deng , Wuxun Xie , Weipeng Ming , Wenqing He , Wen Sun , Xin Han , Xin Huang , Xiaomin Deng , Xiaojia Liu , Xin Wu , Xu Zhao , Yanan Wei , Yanbo Yu , Yang Cao , Yangguang Li , Yangzhen Ma , Yanming Xu , Yaoyu Wang , Yaqiang Shi , Yilei Wang , Yizhuang Zhou , Yinmin Zhong , Yang Zhang , Yaoben Wei , Yu Luo , Yuanwei Lu , Yuhe Yin , Yuchu Luo , Yuanhao Ding , Yuting Yan , Yaqi Dai , Yuxiang Yang , Zhe Xie , Zheng Ge , Zheng Sun , Zhewei Huang , Zhichao Chang , Zhisheng Guan , Zidong Yang , Zili Zhang , Binxing Jiao , Daxin Jiang , Heung-Yeung Shum , Jiansheng Chen , Jing Li , Shuchang Zhou , Xiangyu Zhang , Xinhao Zhang , Yibo Zhu