English
Related papers

Related papers: SAGE: Smart home Agent with Grounded Execution

200 papers

Large Language Models (LLMs) are increasingly used as autonomous agents for multi-step tasks. However, most existing frameworks fail to maintain a structured understanding of the task state, often relying on linear prompt concatenation or…

Artificial Intelligence · Computer Science 2025-08-26 Ye Ye

We introduce SAGE; a Generative LLM for inferring attribute values for products across world-wide e-Commerce catalogs. We introduce a novel formulation of the attribute-value prediction problem as a Seq2Seq summarization task, across…

Information Retrieval · Computer Science 2023-09-13 Athanasios N. Nikolakopoulos , Swati Kaul , Siva Karthik Gade , Bella Dubrov , Umit Batur , Suleiman Ali Khan

Large language model (LLM) agents are increasingly applied to network troubleshooting, but root-cause localization on public benchmarks remains well below practical deployment thresholds. We argue this is because existing agents do not…

Networking and Internet Architecture · Computer Science 2026-05-07 Kuan-Hao Tseng , Niruth Bogahawatta , Yasod Ginige , Kosta Dekic , Arunan Sivanathan , Suranga Seneviratne

Generating high-fidelity synthetic tabular data remains a critical challenge for enhancing data availability in privacy-sensitive and low-resource domains. Recent approaches leverage LLMs by representing table rows as sequences, yet suffer…

Machine Learning · Computer Science 2026-04-28 Shuo Yang , Zheyu Zhang , Bardh Prenkaj , Gjergji Kasneci

LLM agents with tool-calling capabilities often fail when user instructions are ambiguous or incomplete, leading to incorrect invocations and task failures. Existing approaches operate in unstructured language spaces, generating clarifying…

Computation and Language · Computer Science 2026-04-13 Manan Suri , Puneet Mathur , Nedim Lipka , Franck Dernoncourt , Ryan A. Rossi , Dinesh Manocha

Large vision-language models (VLMs) frequently suffer from hallucinations, generating content that is inconsistent with visual inputs. Existing methods typically address this problem through post-hoc filtering, additional training…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Tripti Shukla , Zsolt Kira

As large language models (LLMs) achieve strong performance on traditional benchmarks, there is an urgent need for more challenging evaluation frameworks that probe deeper aspects of semantic understanding. We introduce SAGE (Semantic…

Artificial Intelligence · Computer Science 2025-09-26 Samarth Goel , Reagan J. Lee , Kannan Ramchandran

The rapid iteration cycles of modern live-service games make regression testing indispensable for maintaining quality and stability. However, existing regression testing approaches face critical limitations, especially in common gray-box…

Software Engineering · Computer Science 2025-12-02 Jinyu Cai , Jialong Li , Nianyu Li , Zhenyu Mao , Mingyue Zhang , Kenji Tei

We introduce Synthetic Alignment data Generation for Safety Evaluation and Red Teaming (SAGE-RT or SAGE) a novel pipeline for generating synthetic alignment and red-teaming data. Existing methods fall short in creating nuanced and diverse…

Artificial Intelligence · Computer Science 2024-08-23 Anurakt Kumar , Divyanshu Kumar , Jatan Loya , Nitin Aravind Birur , Tanay Baswa , Sahil Agarwal , Prashanth Harshangi

Existing home energy management systems conceptualize occupants as passive recipients of energy information and control, which limits their ability to effectively support informed decision-making and sustained engagement. This paper…

Human-Computer Interaction · Computer Science 2026-04-10 Wooyoung Jung

Large language models (LLMs) have the potential to revolutionize smart home assistants by enhancing their ability to accurately understand user needs and respond appropriately, which is extremely beneficial for building a smarter home…

Computation and Language · Computer Science 2025-05-28 Silin Li , Yuhang Guo , Jiashu Yao , Zeming Liu , Haifeng Wang

Long-term memory is becoming a central bottleneck for language agents. Exsting RAG and GraphRAG systems largely treat memory graphs as static retrieval middleware, which limits their ability to recover complete evidence chains from partial…

Artificial Intelligence · Computer Science 2026-05-13 Juntong Wang , Haoyue Zhao , guanghui Pan , Xiyuan Wang , Yanbo Wang , Qiyan Deng , Muhan Zhang

Recent advances in large language models have demonstrated impressive capabilities in task-oriented applications, yet building emotionally intelligent chatbots that can engage in natural, strategic conversations remains a challenge. We…

Computation and Language · Computer Science 2025-07-02 Yizhe Zhang , Navdeep Jaitly

Large Language Model (LLM) agents have demonstrated remarkable proficiency in learned tasks, yet they often struggle to adapt to non-stationary environments with feedback. While In-Context Learning and external memory offer some…

Artificial Intelligence · Computer Science 2026-03-05 Lu Yang , Zelai Xu , Minyang Xie , Jiaxuan Gao , Zhao Shok , Yu Wang , Yi Wu

Intelligent agents powered by large language models (LLMs) have recently demonstrated impressive capabilities and gained increasing popularity on social media platforms. While LLM agents are reshaping the ecology of social media, there…

Social and Information Networks · Computer Science 2025-12-18 Dizhan Xue , Jing Cui , Shengsheng Qian , Chuanrui Hu , Changsheng Xu

Smart home automation systems aim to improve the comfort and convenience of users in their living environment. However, adapting automation to user needs remains a challenge. Indeed, many systems still rely on hand-crafted routines for each…

Human-Computer Interaction · Computer Science 2024-07-18 Jordan Rey-Jouanchicot , André Bottaro , Eric Campo , Jean-Léon Bouraoui , Nadine Vigouroux , Frédéric Vella

When an LLM-based embodied agent fails at a household task, the culprit could be misidentified objects, forgotten sub-goals, or poor action sequencing -- yet existing benchmarks report only a single success rate, making it impossible to…

Robotics · Computer Science 2026-05-13 Yunn Kang Lim , Pengzhan Sun , Ziyi Bai , Xun Xu , Angela Yao , Xulei Yang , Shijie Li

We introduce SwiftSage, a novel agent framework inspired by the dual-process theory of human cognition, designed to excel in action planning for complex interactive reasoning tasks. SwiftSage integrates the strengths of behavior cloning and…

Computation and Language · Computer Science 2023-12-07 Bill Yuchen Lin , Yicheng Fu , Karina Yang , Faeze Brahman , Shiyu Huang , Chandra Bhagavatula , Prithviraj Ammanabrolu , Yejin Choi , Xiang Ren

Large Language Models (LLMs) are increasingly explored as high-level reasoning engines for cyber-physical systems, yet their application to real-time UAV swarm management remains challenging due to heterogeneous interfaces, limited…

Artificial Intelligence · Computer Science 2026-05-06 Andrea Iannoli , Lorenzo Gigli , Luca Sciullo , Angelo Trotta , Marco Di Felice

How can we accurately recommend actions for users to control their devices at home? Action recommendation for smart home has attracted increasing attention due to its potential impact on the markets of virtual assistants and Internet of…

Artificial Intelligence · Computer Science 2022-08-15 Hyunsik Jeon , Jongjin Kim , Hoyoung Yoon , Jaeri Lee , U Kang