English
Related papers

Related papers: Beyond Syntax: Action Semantics Learning for App A…

200 papers

Contemporary approaches to agent-based modeling (ABM) of social systems have traditionally emphasized rule-based behaviors, limiting their ability to capture nuanced dynamics by moving beyond predefined rules and leveraging contextual…

Social and Information Networks · Computer Science 2025-09-30 Gaurav Koley

Sensemaking report writing often requires multiple refinements in the iterative process. While Large Language Models (LLMs) have shown promise in generating initial reports based on human visual workspace representations, they struggle to…

Human-Computer Interaction · Computer Science 2025-10-03 Xuxin Tang , Rehema Abulikemu , Eric Krokos , Kirsten Whitley , Xuan Wang , Chris North

Agent Skill framework, now widely and officially supported by major players such as GitHub Copilot, LangChain, and OpenAI, performs especially well with proprietary models by improving context engineering, reducing hallucinations, and…

Artificial Intelligence · Computer Science 2026-02-23 Yangjie Xu , Lujun Li , Lama Sleem , Niccolo Gentile , Yewei Song , Yiqun Wang , Siming Ji , Wenbo Wu , Radu State

Language models (LLMs) offer potential as a source of knowledge for agents that need to acquire new task competencies within a performance environment. We describe efforts toward a novel agent capability that can construct cues (or…

Machine Learning · Computer Science 2022-11-22 James R. Kirk , Robert E. Wray , Peter Lindes , John E. Laird

Large language models (LLMs) have revolutionized how we interact with technology, but their personalization to individual user preferences remains a significant challenge, particularly in on-device applications. Traditional methods often…

Computation and Language · Computer Science 2024-09-26 Rafael Mendoza , Isabella Cruz , Richard Liu , Aarav Deshmukh , David Williams , Jesscia Peng , Rohan Iyer

We present Large Sign Language Models (LSLM), a novel framework for translating 3D American Sign Language (ASL) by leveraging Large Language Models (LLMs) as the backbone, which can benefit hearing-impaired individuals' virtual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Sen Zhang , Xiaoxiao He , Di Liu , Zhaoyang Xia , Mingyu Zhao , Chaowei Tan , Vivian Li , Bo Liu , Dimitris N. Metaxas , Mubbasir Kapadia

Agentic systems have transformed how Large Language Models (LLMs) can be leveraged to create autonomous systems with goal-directed behaviors, consisting of multi-step planning and the ability to interact with different environments. These…

Artificial Intelligence · Computer Science 2026-01-27 Judy Zhu , Dhari Gandhi , Himanshu Joshi , Ahmad Rezaie Mianroodi , Sedef Akinli Kocak , Dhanesh Ramachandran

The acquisition of agentic capabilities has transformed LLMs from "knowledge providers" to "action executors", a trend that while expanding LLMs' capability boundaries, significantly increases their susceptibility to malicious use. Previous…

Cryptography and Security · Computer Science 2025-05-30 Jinchuan Zhang , Lu Yin , Yan Zhou , Songlin Hu

We are witnessing a bloom of AI-powered software driven by Large Language Models (LLMs). Although the applications of these LLMs are impressive and seemingly countless, their unreliability hinders adoption. In fact, the tendency of LLMs to…

Software Engineering · Computer Science 2025-10-30 Vincenzo Scotti , Jan Keim , Tobias Hey , Andreas Metzger , Anne Koziolek , Raffaela Mirandola

Reinforcement learning (RL) has become a pivotal component of large language model (LLM) post-training, and agentic RL extends this paradigm to operate as agents through multi-turn interaction and tool use. Scaling such systems exposes two…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-08 Zheyue Tan , Mustapha Abdullahi , Tuo Shi , Huining Yuan , Zelai Xu , Chao Yu , Boxun Li , Bo Zhao

Large Language Model (LLM)-based agents have recently shown impressive capabilities in complex reasoning and tool use via multi-step interactions with their environments. While these agents have the potential to tackle complicated tasks,…

Artificial Intelligence · Computer Science 2025-11-04 Jiaye Lin , Yifu Guo , Yuzhen Han , Sen Hu , Ziyi Ni , Licheng Wang , Mingguang Chen , Hongzhang Liu , Ronghao Chen , Yangfan He , Daxin Jiang , Binxing Jiao , Chen Hu , Huacan Wang

We present Semantic Interpreter, a natural language-friendly AI system for productivity software such as Microsoft Office that leverages large language models (LLMs) to execute user intent across application features. While LLMs are…

Machine Learning · Computer Science 2023-06-07 Apurva Gandhi , Thong Q. Nguyen , Huitian Jiao , Robert Steen , Ameya Bhatawdekar

Semantic Parsing aims to capture the meaning of a sentence and convert it into a logical, structured form. Previous studies show that semantic parsing enhances the performance of smaller models (e.g., BERT) on downstream tasks. However, it…

Computation and Language · Computer Science 2025-05-28 Kaikai An , Shuzheng Si , Helan Hu , Haozhe Zhao , Yuchi Wang , Qingyan Guo , Baobao Chang

Process mining is increasingly using textual information associated with events to tackle tasks such as anomaly detection and process discovery. Such semantics-aware process mining focuses on what behavior should be possible in a process…

Computation and Language · Computer Science 2025-08-25 Vira Pyrih , Adrian Rebmann , Han van der Aa

Large Language Models (LLMs) excel at capturing latent semantics and contextual relationships across diverse modalities. However, in modeling user behavior from sequential interaction data, performance often suffers when such semantic…

Computation and Language · Computer Science 2025-10-22 Mahsa Valizadeh , Xiangjue Dong , Rui Tuo , James Caverlee

The pursuit of human-level artificial intelligence (AI) has significantly advanced the development of autonomous agents and Large Language Models (LLMs). LLMs are now widely utilized as decision-making agents for their ability to interpret…

A long-standing challenge in developing accurate recommendation models is simulating user behavior, mainly due to the complex and stochastic nature of user interactions. Towards this, one promising line of work has been the use of Large…

Information Retrieval · Computer Science 2025-09-15 Himanshu Thakur , Eshani Agrawal , Smruthi Mukund

Despite the remarkable success of large language models (LLMs), they still face bottlenecks while deploying in dynamic, real-world settings with primary challenges being concept drift and the high cost of gradient-based adaptation.…

Artificial Intelligence · Computer Science 2026-05-21 Nitin Vetcha , Dianbo Liu

Large language models (LLMs) and agent techniques have brought a fundamental shift in the functionality and development paradigm of data analysis tasks (a.k.a LLM/Agent-as-Data-Analyst), demonstrating substantial impact across both academia…

Agents centered around Large Language Models (LLMs) are now capable of automating mobile device operations for users. After fine-tuning to learn a user's mobile operations, these agents can adhere to high-level user instructions online.…

Human-Computer Interaction · Computer Science 2024-01-18 Tinghe Ding