English
Related papers

Related papers: MedViz: An Agent-based, Visual-guided Research Ass…

200 papers

Recently, Large Language Model based Autonomous system(LLMAS) has gained great popularity for its potential to simulate complicated behaviors of human societies. One of its main challenges is to present and analyze the dynamic events…

Human-Computer Interaction · Computer Science 2024-02-15 Jiaying Lu , Bo Pan , Jieyi Chen , Yingchaojie Feng , Jingyuan Hu , Yuchen Peng , Wei Chen

Recent advances in visual language models have enabled autonomous agents for complex reasoning, tool use, and document understanding. However, existing document agents mainly transform papers into static artifacts such as summaries,…

Computation and Language · Computer Science 2026-03-31 Dasen Dai , Biao Wu , Meng Fang , Wenhao Wang

As the volume of publicly available data continues to grow, researchers face the challenge of limited diversity in benchmarking machine learning tasks. Although thousands of datasets are available in public repositories, the sheer abundance…

Information Retrieval · Computer Science 2025-02-25 Mara Graziani , Malina Molnar , Irina Espejo Morales , Joris Cadow-Gossweiler , Teodoro Laino

Large Language Models (LLMs) show promise in biomedicine but lack true causal understanding, relying instead on correlations. This paper envisions causal LLM agents that integrate multimodal data (text, images, genomics, etc.) and perform…

Artificial Intelligence · Computer Science 2025-05-23 Adib Bazgir , Amir Habibdoust Lafmajani , Yuwen Zhang

An innumerable number of individual choices go into discovering a new book. There are unmistakably two groups of booklovers: those who like to search online, follow other people's latest readings, or simply react to a system's…

Human-Computer Interaction · Computer Science 2020-11-03 Zona Kostic , Jared Jessup , Jeffrey Baglioni , Nathan Weeks , Johann Philipp Dreessen , Ning Chen , Tianyu Liu

This paper presents BattleAgent, an emulation system that combines the Large Vision-Language Model and Multi-agent System. This novel system aims to simulate complex dynamic interactions among multiple agents, as well as between agents and…

Human-Computer Interaction · Computer Science 2024-04-25 Shuhang Lin , Wenyue Hua , Lingyao Li , Che-Jui Chang , Lizhou Fan , Jianchao Ji , Hang Hua , Mingyu Jin , Jiebo Luo , Yongfeng Zhang

Alzheimer's disease (AD) presents a complex, multifaceted challenge to patients, caregivers, and the healthcare system, necessitating integrated and dynamic support solutions. While artificial intelligence (AI) offers promising avenues for…

Multiagent Systems · Computer Science 2025-10-13 Adib Bazgir , Amir Habibdoust , Xing Song , Yuwen Zhang

Large language models (LLMs) have grown in their usage to provide support for question answering across numerous disciplines. The models on their own have already shown promise for answering basic questions, however fail quickly where…

Information Retrieval · Computer Science 2025-04-15 David Brett , Anniek Myatt

We introduce an open-source system called SIGMA (short for "Situated Interactive Guidance, Monitoring, and Assistance") as a platform for conducting research on task-assistive agents in mixed-reality scenarios. The system leverages the…

Human-Computer Interaction · Computer Science 2024-05-24 Dan Bohus , Sean Andrist , Nick Saw , Ann Paradiso , Ishani Chakraborty , Mahdi Rad

The proliferation of scientific literature presents an increasingly significant challenge for researchers. While Large Language Models (LLMs) offer promise, existing tools often provide verbose summaries that risk replacing, rather than…

Artificial Intelligence · Computer Science 2025-09-26 Paris Koloveas , Serafeim Chatzopoulos , Thanasis Vergoulis , Christos Tryfonopoulos

Multimodal deep search agents have shown great potential in solving complex tasks by iteratively collecting textual and visual evidence. However, managing the heterogeneous information and high token costs associated with multimodal inputs…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Yifan Du , Zikang Liu , Jinbiao Peng , Jie Wu , Junyi Li , Jinyang Li , Wayne Xin Zhao , Ji-Rong Wen

We introduce V-Agent, a novel multi-agent platform designed for advanced video search and interactive user-system conversations. By fine-tuning a vision-language model (VLM) with a small video preference dataset and enhancing it with a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 SunYoung Park , Jong-Hyeon Lee , Youngjune Kim , Daegyu Sung , Younghyun Yu , Young-rok Cha , Jeongho Ju

Automating GUI tasks remains challenging due to reliance on textual representations, platform-specific action spaces, and limited reasoning capabilities. We introduce Aguvis, a unified vision-based framework for autonomous GUI agents that…

Computation and Language · Computer Science 2025-05-06 Yiheng Xu , Zekun Wang , Junli Wang , Dunjie Lu , Tianbao Xie , Amrita Saha , Doyen Sahoo , Tao Yu , Caiming Xiong

TRIZ, the Theory of Inventive Problem Solving, is a structured, knowledge-based framework for innovation and abstracting problems to find inventive solutions. However, its application is often limited by the complexity and deep…

Artificial Intelligence · Computer Science 2025-06-24 Kamil Szczepanik , Jarosław A. Chudziak

Large language models are moving scientific research from text assistance toward agentic workflows, yet biological research requires strong object validation, methodological suitability, reproducibility, and auditability. Prompt…

Quantitative Methods · Quantitative Biology 2026-05-25 Zhenyu Ma , Yuyang Song , Chunyi Yang , Jingyi Zhu , Limei Xu , Min Xiao , Xukai Jiang

Large language models (LLMs) have revolutionized medical reasoning tasks, yet single-agent systems often falter on complex, interdisciplinary problems requiring robust handling of uncertainty and conflicting evidence. Multi-agent systems…

Artificial Intelligence · Computer Science 2026-05-29 Xiaoyang Wang , Christopher C. Yang

Pursuing artificial intelligence for biomedical science, a.k.a. AI Scientist, draws increasing attention, where one common approach is to build a copilot agent driven by Large Language Models (LLMs). However, to evaluate such systems,…

Computation and Language · Computer Science 2024-07-02 Xinna Lin , Siqi Ma , Junjie Shan , Xiaojing Zhang , Shell Xu Hu , Tiannan Guo , Stan Z. Li , Kaicheng Yu

The rapid advancement of Multimodal Large Language Models (MLLMs) has enabled browsing agents to acquire and reason over multimodal information in the real world. But existing benchmarks suffer from two limitations: insufficient evaluation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Zhengbo Zhang , Jinbo Su , Zhaowen Zhou , Changtao Miao , Yuhan Hong , Qimeng Wu , Yumeng Liu , Feier Wu , Yihe Tian , Yuhao Liang , Zitong Shan , Wanke Xia , Yi-Fan Zhang , Bo Zhang , Zhe Li , Shiming Xiang , Ying Yan

Knowledge workers face increasing challenges in synthesizing information from multiple documents into structured conceptual understanding. This process is inherently iterative: users explore content, identify relationships between concepts,…

Human-Computer Interaction · Computer Science 2026-04-28 Xiang Li , Cara Li , Emily Kuang , Can Liu , Jian Zhao

AI agents hold the potential to revolutionize scientific productivity by automating literature reviews, replicating experiments, analyzing data, and even proposing new directions of inquiry; indeed, there are now many such agents, ranging…