English
Related papers

Related papers: DataClaw: An Autonomous Data Agent with Instant Me…

200 papers

Unstructured text has long been difficult to automatically analyze at scale. Large language models (LLMs) now offer a way forward by enabling {\em semantic data processing}, where familiar data processing operators (e.g., map, reduce,…

Human-Computer Interaction · Computer Science 2025-04-22 Shreya Shankar , Bhavya Chopra , Mawil Hasan , Stephen Lee , Björn Hartmann , Joseph M. Hellerstein , Aditya G. Parameswaran , Eugene Wu

The rapid digitization of nuclear power plant main control rooms has fundamentally reshaped operator interaction patterns, introducing complex soft-control behaviors and elevated cognitive risks that are not adequately addressed by existing…

Artificial Intelligence · Computer Science 2026-04-17 Xingyu Xiao , Jiejuan Tong , Jun Sun , Zhe Sui , Peng Chen , Jingang Liang , Haitao Wang

The recent surge in AI agents that autonomously communicate, collaborate with humans and use diverse tools has unlocked promising opportunities in various real-world settings. However, a vital aspect remains underexplored: how agents handle…

Machine Learning · Computer Science 2025-11-04 Nabeel Seedat , Jiashuo Liu , Mihaela van der Schaar

The rapid advancement of AI and computer vision has significantly increased the demand for high-quality annotated datasets, particularly for semantic segmentation. However, creating such datasets is resource-intensive, requiring substantial…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Ngoc-Do Tran , Minh-Tuan Huynh , Tam V. Nguyen , Minh-Triet Tran , Trung-Nghia Le

Proactive agents that anticipate user intentions without explicit prompts represent a significant evolution in human-AI interaction, promising to reduce cognitive load and streamline workflows. However, existing datasets suffer from two…

Human-Computer Interaction · Computer Science 2026-02-11 Yuanbo Tang , Huaze Tang , Tingyu Cao , Lam Nguyen , Anping Zhang , Xinwen Cao , Chunkang Liu , Wenbo Ding , Yang Li

Data wrangling is a time-consuming and challenging task in a data science pipeline. While many tools have been proposed to automate or facilitate data wrangling, they often misinterpret user intent, especially in complex tasks. We propose…

Human-Computer Interaction · Computer Science 2025-03-07 Wei-Hao Chen , Weixi Tong , Amanda Case , Tianyi Zhang

Many researchers have explored tools that aim to recommend data insights to users. These tools automatically communicate a rich diversity of data insights and offer such insights for many different purposes. However, there is a lack of…

Human-Computer Interaction · Computer Science 2020-09-08 Po-Ming Law , Alex Endert , John Stasko

Table Question Answering (TableQA) enables natural language interaction with structured tabular data. However, existing large language model (LLM) approaches face critical limitations: context length constraints that restrict data handling…

Artificial Intelligence · Computer Science 2026-03-11 Tong Wang , Chi Jin , Yongkang Chen , Huan Deng , Xiaohui Kuang , Gang Zhao

High-quality dialogue is crucial for e-commerce customer service, yet traditional intent-based systems struggle with dynamic, multi-turn interactions. We present MindFlow+, a self-evolving dialogue agent that learns domain-specific behavior…

Computation and Language · Computer Science 2025-07-28 Ming Gong , Xucheng Huang , Ziheng Xu , Vijayan K. Asari

Think-Aloud Computing, a method for capturing users' verbalized thoughts during software tasks, allows eliciting rich contextual insights into evolving intentions, struggles, and decision-making processes of users in real-time. However,…

Human-Computer Interaction · Computer Science 2026-02-11 Frederic Gmeiner , John Thompson , George Fitzmaurice , Justin Matejka

Making sense of unstructured text datasets is perennially difficult, yet increasingly relevant with Large Language Models. Data workers often rely on dataset summaries, especially distributions of various derived features. Some features,…

Computation and Language · Computer Science 2024-02-26 Emily Reif , Crystal Qian , James Wexler , Minsuk Kahng

Personal AI agents like OpenClaw run with elevated privileges on users' local machines, where a single successful prompt injection can leak credentials, redirect financial transactions, or destroy files. This threat goes well beyond…

Artificial Intelligence · Computer Science 2026-04-07 Bowen Wei , Yunbei Zhang , Jinhao Pan , Kai Mei , Xiao Wang , Jihun Hamm , Ziwei Zhu , Yingqiang Ge

Seamless interaction between AI agents and humans using natural language remains a key goal in AI research. This paper addresses the challenges of developing interactive agents capable of understanding and executing grounded natural…

Artificial Intelligence · Computer Science 2024-07-15 Shrestha Mohanty , Negar Arabzadeh , Andrea Tupini , Yuxuan Sun , Alexey Skrynnik , Artem Zholus , Marc-Alexandre Côté , Julia Kiseleva

Language agents have achieved considerable performance on various complex question-answering tasks by planning with external tools. Despite the incessant exploration in this field, existing language agent systems still struggle with costly,…

Computation and Language · Computer Science 2024-05-28 Shuofei Qiao , Ningyu Zhang , Runnan Fang , Yujie Luo , Wangchunshu Zhou , Yuchen Eleanor Jiang , Chengfei Lv , Huajun Chen

Large language model (LLM) agents extend generative models with reasoning, tool use, and persistent memory, thereby enabling the automation of complex tasks. In healthcare, such systems could support documentation, care coordination, and…

Artificial Intelligence · Computer Science 2026-03-24 Wenxian Yang , Hanzheng Qiu , Bangqun Zhang , Chengquan Li , Zhiyong Huang , Xiaobin Feng , Rongshan Yu , Jiahong Dong

Software robots have long been used in Robotic Process Automation (RPA) to automate mundane and repetitive computer tasks. With the advent of Large Language Models (LLMs) and their advanced reasoning capabilities, these agents are now able…

Artificial Intelligence · Computer Science 2024-12-30 Junhee Cho , Jihoon Kim , Daseul Bae , Jinho Choo , Youngjune Gwon , Yeong-Dae Kwon

Maintaining high data quality is crucial for reliable data analysis and machine learning (ML). However, existing data quality management tools often lack automation, interactivity, and integration with ML workflows. This demonstration paper…

Databases · Computer Science 2025-01-29 Mohamed Abdelaal , Samuel Lokadjaja , Arne Kreuz , Harald Schöning

Driven by the rapid ascent of artificial intelligence (AI), organizations are at the epicenter of a seismic shift, facing a crucial question: How can AI be successfully integrated into existing operations? To help answer it, manage…

Software Engineering · Computer Science 2024-02-09 Tamen Jadad-Garcia , Alejandro R. Jadad

The use of chatbots has spread, generating great interest in the industry for the possibility of automating tasks within the execution of their processes. The implementation of chatbots, however simple, is a complex endeavor that involves…

Software Engineering · Computer Science 2021-09-03 Bedilia Estrada-Torres , Adela del-Río-Ortega , Manuel Resinas

The current state of modern web interfaces, especially in regards to accessibility focused usage is extremely lacking. Traditional methods for web interaction, such as scripting languages and screen readers, often lack the flexibility to…

Artificial Intelligence · Computer Science 2025-07-08 Trisanth Srinivasan , Santosh Patapati