English
Related papers

Related papers: GridMind: A Multi-Agent NLP Framework for Unified,…

200 papers

Depression poses significant challenges to patients and healthcare organizations, necessitating efficient assessment methods. Existing paradigms typically focus on a patient-doctor way that overlooks multi-role interactions, such as family…

Human-Computer Interaction · Computer Science 2026-03-10 Zhiyuan Zhou , Jilong Liu , Sanwang Wang , Shijie Hao , Yanrong Guo , Richang Hong

Multimodal large language models (MLLMs) have shown remarkable capabilities in cross-modal understanding and reasoning, offering new opportunities for intelligent assistive systems, yet existing systems still struggle with risk-aware…

Robotics · Computer Science 2026-04-08 Renjun Gao

Recent advances in large language models (LLMs) have enabled fluent dialogue systems, but most remain reactive and struggle in emotionally rich, goal-oriented settings such as marketing conversations. To address this limitation, we propose…

Computation and Language · Computer Science 2025-12-23 Lin Yu , Xiaofei Han , Yifei Kang , Chiung-Yi Tseng , Danyang Zhang , Ziqian Bi , Zhimo Han

Understanding how humans collaborate and communicate in teams is essential for improving human-agent teaming and AI-assisted decision-making. However, relying solely on data from large-scale user studies is impractical due to logistical,…

Foundation Models (FMs) have shown remarkable capabilities in various natural language tasks. However, their ability to accurately capture stakeholder requirements remains a significant challenge for using FMs for software development. This…

Software Engineering · Computer Science 2025-05-29 Keheliya Gallaba , Ali Arabat , Dayi Lin , Mohammed Sayagh , Ahmed E. Hassan

Unified multimodal models provide a natural and promising architecture for understanding diverse and complex real-world knowledge while generating high-quality images. However, they still rely primarily on frozen parametric knowledge, which…

Over the past decade, wearable computing devices (``smart glasses'') have undergone remarkable advancements in sensor technology, design, and processing power, ushering in a new era of opportunity for high-density human behavior data.…

The rapid evolution of artificial intelligence (AI) has shifted from static, data-driven models to dynamic systems capable of perceiving and interacting with real-world environments. Despite advancements in pattern recognition and symbolic…

Multimodal pre-training breaks down the modality barriers and allows the individual modalities to be mutually augmented with information, resulting in significant advances in representation learning. However, graph modality, as a very…

Multimedia · Computer Science 2022-11-01 Xuan Yang , Quanjin Tao , Xiao Feng , Donghong Cai , Xiang Ren , Yang Yang

This paper introduces LLM-MARL, a unified framework that incorporates large language models (LLMs) into multi-agent reinforcement learning (MARL) to enhance coordination, communication, and generalization in simulated game environments. The…

Artificial Intelligence · Computer Science 2025-11-04 Zhengyang Li , Sawyer Campos , Nana Wang

Multi-agent systems built on large language models (LLMs) are expected to enhance decision-making by pooling distributed information, yet systematically evaluating this capability has remained challenging. We introduce HiddenBench, a…

Computation and Language · Computer Science 2026-05-14 Yuxuan Li , Aoi Naito , Hirokazu Shirado

Data marketplaces, which mediate the purchase and exchange of data from third parties, have attracted growing attention for reducing the cost and effort of data collection while enabling the trading of diverse datasets. However, a…

Multiagent Systems · Computer Science 2025-11-18 Jun Sashihara , Yukihisa Fujita , Kota Nakamura , Masahiro Kuwahara , Teruaki Hayashi

Graph Neural Networks (GNNs) have empowered the advance in graph-structured data analysis. Recently, the rise of Large Language Models (LLMs) like GPT-4 has heralded a new era in deep learning. However, their application to graph data poses…

Machine Learning · Computer Science 2024-04-12 Runjin Chen , Tong Zhao , Ajay Jaiswal , Neil Shah , Zhangyang Wang

Multimodal empathetic response generation (MERG) aims to generate emotionally engaging and empathetic responses based on users' multimodal contexts. Existing approaches usually rely on an implicit one-pass generation paradigm from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Liping Wang , Cheng Ye , Weidong Chen , Peipei Song , Bo Hu , Zhendong Mao

Modern engineered systems increasingly involve complex sociotechnical environments where multiple agents, including humans and the emerging paradigm of agentic AI powered by large language models, must navigate social dilemmas that pit…

Artificial Intelligence · Computer Science 2025-10-28 Qiliang Chen , Sepehr Ilami , Nunzio Lore , Babak Heydari

Predicting multiple real-world tasks in a single model often requires a particularly diverse feature space. Multimodal (MM) models aim to extract the synergistic predictive potential of multiple data types to create a shared feature space…

Machine Learning · Computer Science 2023-11-07 Vinitra Swamy , Malika Satayeva , Jibril Frej , Thierry Bossy , Thijs Vogels , Martin Jaggi , Tanja Käser , Mary-Anne Hartley

Developing a universal model that can effectively harness heterogeneous resources and respond to a wide range of personalized needs has been a longstanding community aspiration. Our daily choices, especially in domains like fashion and…

Information Retrieval · Computer Science 2024-03-29 Tianxin Wei , Bowen Jin , Ruirui Li , Hansi Zeng , Zhengyang Wang , Jianhui Sun , Qingyu Yin , Hanqing Lu , Suhang Wang , Jingrui He , Xianfeng Tang

Multimodal recommendation systems utilize various types of information, including images and text, to enhance the effectiveness of recommendations. The key challenge is predicting user purchasing behavior from the available data. Current…

Information Retrieval · Computer Science 2025-11-04 Ke Shi , Yan Zhang , Miao Zhang , Lifan Chen , Jiali Yi , Kui Xiao , Xiaoju Hou , Zhifei Li

With the powerful reasoning capabilities of large language models (LLMs) and vision-language models (VLMs), many recent works have explored using them for decision-making. However, most of these approaches rely solely on language-based…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yihao Sun , Zhilong Zhang , Yang Yu , Pierre-Luc Bacon

Using Large Language Models (LLMs) to process graph-structured data is an active research area, yet current state-of-the-art approaches typically rely on multi-step pipelines with Graph Neural Network (GNN) encoders that compress rich…

Machine Learning · Computer Science 2026-05-12 Dario Vajda