English
Related papers

Related papers: Biotic Browser: Applying StreamingLLM as a Persist…

200 papers

Large Language Model (LLM) -in-the-loop applications have been shown to effectively interpret the human user's commands, make plans, and operate external tools/systems accordingly. Still, the operation scope of the LLM agent is limited to…

Human-Computer Interaction · Computer Science 2024-09-24 Daniel Chin , Yuxuan Wang , Gus Xia

Large language models (LLMs) show remarkable potential in scientific hypothesis discovery. However, existing approaches face two critical limitations: they treat divergent exploratory ideation and convergent fine-grained refinement as…

Computation and Language · Computer Science 2026-05-29 Hongran An , Zonglin Yang

Conventional biomedical research is increasingly labor-intensive due to the exponential growth of scientific literature and datasets. Artificial intelligence (AI), particularly Large Language Models (LLMs), has the potential to…

Multiagent Systems · Computer Science 2025-07-08 Yi Luo , Linghang Shi , Yihao Li , Aobo Zhuang , Yeyun Gong , Ling Liu , Chen Lin

Lifelong learning in artificial intelligence (AI) aims to mimic the biological brain's ability to continuously learn and retain knowledge, yet it faces challenges such as catastrophic forgetting. Recent neuroscience research suggests that…

Artificial Intelligence · Computer Science 2024-09-24 Jin Du , Xinhe Zhang , Hao Shen , Xun Xian , Ganghua Wang , Jiawei Zhang , Yuhong Yang , Na Li , Jia Liu , Jie Ding

As the advent of artificial general intelligence (AGI) progresses at a breathtaking pace, the application of large language models (LLMs) as AI Agents in robotics remains in its nascent stage. A significant concern that hampers the seamless…

Robotics · Computer Science 2024-05-01 Shimian Zhang , Qiuhong Lu

The paper investigates using a Large Language Model (LLM) to automatically perform web software tasks using click, scroll, and text input operations. Previous approaches, such as reinforcement learning (RL) or imitation learning, are…

Computation and Language · Computer Science 2023-10-26 Heyi Tao , Sethuraman T , Michal Shlapentokh-Rothman , Derek Hoiem

A combined Short-Term Learning (STL) and Long-Term Learning (LTL) approach to solving mobile robot navigation problems is presented and tested in both real and simulated environments. The LTL consists of rapid simulations that use a Genetic…

Artificial Intelligence · Computer Science 2010-07-05 Amanda Whitbrook , Uwe Aickelin , Jonathan M Garibaldi

What if a browser agent could learn your work simply by watching you do it? We present cotomi Act, a browser-based computer-using agent that combines reliable multi-step task execution with persistent organizational knowledge learned from…

Artificial Intelligence · Computer Science 2026-05-06 Masafumi Oyamada , Kunihiro Takeoka , Kosuke Akimoto , Ryoma Obara , Masafumi Enomoto , Haochen Zhang , Daichi Haraguchi , Takuya Tamura

Mixed reality platforms allow users to create virtual environments, yet novice users struggle with both ideation and execution in spatial design. While existing AI models can automatically generate scenes based on user prompts, the lack of…

Human-Computer Interaction · Computer Science 2025-08-05 Zhuangze Hou , Jingze Tian , Nianlong Li , Farong Ren , Can Liu

Clinical decision-making is inherently complex, often influenced by cognitive biases, incomplete information, and case ambiguity. Large Language Models (LLMs) have shown promise as tools for supporting clinical decision-making, yet their…

Machine Learning · Computer Science 2025-07-10 Burcu Sayin , Ipek Baris Schlicht , Ngoc Vo Hong , Sara Allievi , Jacopo Staiano , Pasquale Minervini , Andrea Passerini

Mobile graphical user interface (GUI) agents are designed to automate everyday tasks on smartphones. Recent advances in large language models (LLMs) have significantly enhanced the capabilities of mobile GUI agents. However, most…

Human-Computer Interaction · Computer Science 2026-01-27 Mingxian Yu , Siqi Luo , Xu Chen

We present a real-time system that enables bidirectional human-AI learning and teaching in a balancing task that is a realistic analogue of disorientation during piloting and spaceflight. A human subject and autonomous AI model of choice…

Human-Computer Interaction · Computer Science 2024-12-10 Sheikh Mannan , Nikhil Krishnaswamy

Biomedical researchers face increasing challenges in navigating millions of publications in diverse domains. Traditional search engines typically return articles as ranked text lists, offering little support for global exploration or…

Information Retrieval · Computer Science 2026-01-29 Huan He , Xueqing Peng , Yutong Xie , Qijia Liu , Chia-Hsuan Chang , Lingfei Qian , Brian Ondov , Qiaozhu Mei , Hua Xu

The ability to accomplish tasks via natural language instructions is one of the most efficient forms of interaction between humans and technology. This efficiency has been translated into practical applications with generative AI tools now…

Computational Engineering, Finance, and Science · Computer Science 2025-01-27 Yared W. Bekele

Student simulation presents a transformative approach to enhance learning outcomes, advance educational research, and ultimately shape the future of effective pedagogy. We explore the feasibility of using large language models (LLMs), a…

Artificial Intelligence · Computer Science 2023-10-31 Songlin Xu , Xinyu Zhang

LLM chatbot interfaces allow students to get instant, interactive assistance with homework, but doing so carelessly may not advance educational objectives. In this study, an interactive homework help system based on DeepSeek R1 is developed…

Human-Computer Interaction · Computer Science 2025-03-13 Rajan Das Gupta , Md. Tanzib Hosain , M. F. Mridha , Salah Uddin Ahmed

Visual navigation tasks are critical for household service robots. As these tasks become increasingly complex, effective communication and collaboration among multiple robots become imperative to ensure successful completion. In recent…

Robotics · Computer Science 2024-07-02 Pengying Wu , Yao Mu , Kangjie Zhou , Ji Ma , Junting Chen , Chang Liu

With the advancement of web techniques, they have significantly revolutionized various aspects of people's lives. Despite the importance of the web, many tasks performed on it are repetitive and time-consuming, negatively impacting overall…

Artificial Intelligence · Computer Science 2025-08-06 Liangbo Ning , Ziran Liang , Zhuohang Jiang , Haohao Qu , Yujuan Ding , Wenqi Fan , Xiao-yong Wei , Shanru Lin , Hui Liu , Philip S. Yu , Qing Li

The BrowserGym ecosystem addresses the growing need for efficient evaluation and benchmarking of web agents, particularly those leveraging automation and Large Language Models (LLMs). Many existing benchmarks suffer from fragmentation and…

Image-guided surgery demands adaptive, real-time decision support, yet static AI models struggle with structured task planning and providing interactive guidance. Large language models (LLMs)-powered agents offer a promising solution by…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Jiayuan Huang , Runlong He , Danyal Zaman Khan , Evangelos B. Mazomenos , Danail Stoyanov , Hani Marcus , Linzhe Jiang , Matthew J Clarkson , Mobarak I. Hoque