English
Related papers

Related papers: Text2Interact: High-Fidelity and Diverse Text-to-T…

200 papers

Human motion generation has shown great advances thanks to the recent diffusion models trained on large-scale motion capture data. Most of existing works, however, currently target animation of isolated people in empty scenes. Meanwhile,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Yangsong Zhang , Abdul Ahad Butt , Gül Varol , Ivan Laptev

Tool learning empowers large language models (LLMs) as agents to use external tools and extend their utility. Existing methods employ one single LLM-based agent to iteratively select and execute tools, thereafter incorporating execution…

Computation and Language · Computer Science 2024-06-25 Zhengliang Shi , Shen Gao , Xiuyi Chen , Yue Feng , Lingyong Yan , Haibo Shi , Dawei Yin , Pengjie Ren , Suzan Verberne , Zhaochun Ren

People without a database background usually rely on file systems or tools such as Excel for data management, which often lead to redundancy and data inconsistency. Relational databases possess strong data management capabilities, but…

Machine Learning (ML) has emerged as a powerful form of data modelling with widespread applicability beyond its roots in the design of autonomous agents. However, relatively little attention has been paid to the interaction between people…

Artificial Intelligence · Computer Science 2024-10-29 A. Baskar , Ashwin Srinivasan , Michael Bain , Enrico Coiera

Recent progress in large language model (LLM)-based multi-agent collaboration highlights the power of structured communication in enabling collective intelligence. However, existing methods largely rely on static or graph-based inter-agent…

Artificial Intelligence · Computer Science 2025-11-04 Song Wang , Zhen Tan , Zihan Chen , Shuang Zhou , Tianlong Chen , Jundong Li

The growing prevalence of Large Language Models (LLMs) is reshaping online text-based communication; a transformation that is extensively studied as AI-mediated communication. However, much of the existing research remains bound by…

Human-Computer Interaction · Computer Science 2025-02-26 Shutaro Aoyama , Rintaro Chujo , Ari Hautasaari , Takeshi Naemura

Generating human motions from textual descriptions has gained growing research interest due to its wide range of applications. However, only a few works consider human-scene interactions together with text conditions, which is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Zhi Cen , Huaijin Pi , Sida Peng , Zehong Shen , Minghui Yang , Shuai Zhu , Hujun Bao , Xiaowei Zhou

Large Language Models (LLMs) have demonstrated impressive text generation capabilities, prompting us to reconsider the future of human-AI co-creation and how humans interact with LLMs. In this paper, we present a spectrum of content…

Artificial Intelligence · Computer Science 2023-03-15 Zijian Ding , Joel Chan

This work investigates a challenging task named open-domain interleaved image-text generation, which generates interleaved texts and images following an input query. We propose a new interleaved generation framework based on prompting…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Jie An , Zhengyuan Yang , Linjie Li , Jianfeng Wang , Kevin Lin , Zicheng Liu , Lijuan Wang , Jiebo Luo

Recent research has explored using Large Language Models for recommendation tasks by transforming user interaction histories and item metadata into text prompts, then having the LLM produce rankings or recommendations. A promising approach…

Information Retrieval · Computer Science 2025-10-03 Bo Ma , LuYao Liu , Simon Lau , Chandler Yuan , and XueY Cui , Rosie Zhang

The difficulty and expense of obtaining large-scale human responses make Large Language Models (LLMs) an attractive alternative and a promising proxy for human behavior. However, prior work shows that LLMs often produce homogeneous outputs…

Artificial Intelligence · Computer Science 2025-10-09 Manh Hung Nguyen , Sebastian Tschiatschek , Adish Singla

This search introduces the Multimodal Socialized Learning Framework (M-S2L), designed to foster emergent social intelligence in AI agents by integrating Multimodal Large Language Models (M-LLMs) with social learning mechanisms. The…

Multiagent Systems · Computer Science 2025-11-12 Sureyya Akin , Shruti T. Tiwari , Ram Bhattacharya , Sagar A. Raman , Kiran Mohanty , Sita Krishnan

A long-standing goal of the research community is to develop highly interactive LLM-based dialogue agents. Recent research focuses on optimizing policies based on fixed offline logs (Static Context RL) or using a prompt-based simulator…

Artificial Intelligence · Computer Science 2026-05-27 Xiaohua Wang , Jiakang Yuan , Zisu Huang , Muzhao Tian , Changze Lv , Kaitao Song , Tao Chen , Xiaoqing Zheng

Text-driven multi-human motion generation with complex interactions remains a challenging problem. Despite progress in performance, existing offline methods that generate fixed-length motions with a fixed number of agents, are inherently…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Mengge Liu , Yan Di , Gu Wang , Yun Qu , Dekai Zhu , Yanyan Li , Xiangyang Ji

Simulations, although powerful in accurately replicating real-world systems, often remain inaccessible to non-technical users due to their complexity. Conversely, large language models (LLMs) provide intuitive, language-based interactions…

Computation and Language · Computer Science 2025-05-22 Jacob Kleiman , Kevin Frank , Joseph Voyles , Sindy Campagna

Text-to-image (T2I) models have advanced creative content generation, yet their reliance on large uncurated datasets often reproduces societal biases. We present FairT2I, a training-free and interactive framework grounded in a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Jinya Sakurai , Yuki Koyama , Issei Sato

Diffusion-based generative models have significantly advanced text-to-image generation but encounter challenges when processing lengthy and intricate text prompts describing complex scenes with multiple objects. While excelling in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Hanan Gani , Shariq Farooq Bhat , Muzammal Naseer , Salman Khan , Peter Wonka

Diffusion models for Text-to-Image (T2I) conditional generation have recently achieved tremendous success. Yet, aligning these models with user's intentions still involves a laborious trial-and-error process, and this challenging alignment…

Machine Learning · Computer Science 2025-02-12 Chao Wang , Giulio Franzese , Alessandro Finamore , Massimo Gallo , Pietro Michiardi

Text-to-video (T2V) generative models have advanced significantly, yet their ability to compose different objects, attributes, actions, and motions into a video remains unexplored. Previous text-to-video benchmarks also neglect this…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Kaiyue Sun , Kaiyi Huang , Xian Liu , Yue Wu , Zihan Xu , Zhenguo Li , Xihui Liu

We present Social Agent, a novel framework for synthesizing realistic and contextually appropriate co-speech nonverbal behaviors in dyadic conversations. In this framework, we develop an agentic system driven by a Large Language Model (LLM)…

Graphics · Computer Science 2025-10-07 Zeyi Zhang , Yanju Zhou , Heyuan Yao , Tenglong Ao , Xiaohang Zhan , Libin Liu