English
Related papers

Related papers: LLMER: Crafting Interactive Extended Reality World…

200 papers

Augmented reality (AR) requires the seamless integration of visual, auditory, and linguistic channels for optimized human-computer interaction. While auditory and visual inputs facilitate real-time and contextual user guidance, the…

Computation and Language · Computer Science 2023-10-19 Jing Bi , Nguyen Manh Nguyen , Ali Vosoughi , Chenliang Xu

A Conversational Recommender System (CRS) offers increased transparency and control to users by enabling them to engage with the system through a real-time multi-turn dialogue. Recently, Large Language Models (LLMs) have exhibited an…

Current methods for Video Moment Retrieval (VMR) struggle to align complex situations involving specific environmental details, character descriptions, and action narratives. To tackle this issue, we propose a Large Language Model-guided…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Weijia Liu , Bo Miao , Jiuxin Cao , Xuelin Zhu , Bo Liu , Mehwish Nasim , Ajmal Mian

Many applications demand context sensing to offer personalized and timely services. Yet, developing sensing programs can be challenging for developers and using them is privacy-concerning for end-users. In this paper, we propose to use…

Computation and Language · Computer Science 2024-12-23 Jiacheng Liu , Yuanchun Li , Liangyan Li , Yi Sun , Hao Wen , Xiangyu Li , Yao Guo , Yunxin Liu

Recent developments show that Large Language Models (LLMs) produce state-of-the-art performance on natural language (NL) to code generation for resource-rich general-purpose languages like C++, Java, and Python. However, their practical…

The effective detection and governance of Large Language Model (LLM) generated content has become increasingly critical due to the growing risk of misuse. Despite the impressive performance of existing detectors, their reliability and…

Computation and Language · Computer Science 2026-05-20 Junchao Wu , Yefeng Liu , Chenyu Zhu , Hao Zhang , Zeyu Wu , Tianqi Shi , Yichao Du , Longyue Wang , Weihua Luo , Jinsong Su , Derek F. Wong

Large Language Models (LLMs) excel at capturing latent semantics and contextual relationships across diverse modalities. However, in modeling user behavior from sequential interaction data, performance often suffers when such semantic…

Computation and Language · Computer Science 2025-10-22 Mahsa Valizadeh , Xiangjue Dong , Rui Tuo , James Caverlee

Large Language Models (LLMs) are widely used for tasks such as natural language and code generation, but their outputs often suffer from issues like hallucination, toxicity, and incorrect results. Current libraries for structured LLM…

Software Engineering · Computer Science 2025-03-04 Shubham Ugare , Rohan Gumaste , Tarun Suresh , Gagandeep Singh , Sasa Misailovic

As Large Language Models (LLMs) advance in natural language processing, there is growing interest in leveraging their capabilities to simplify software interactions. In this paper, we propose a novel system that integrates LLMs for both…

Computation and Language · Computer Science 2024-09-19 Chunliang Tao , Xiaojing Fan , Yahe Yang

This paper introduces a novel integration of Retrieval-Augmented Generation (RAG) enhanced Large Language Models (LLMs) with Extended Reality (XR) technologies to address knowledge transfer challenges in industrial environments. The…

Large language models (LLMs) have achieved remarkable success across various domains, but effectively incorporating complex and potentially noisy user timeline data into LLMs remains a challenge. Current approaches often involve translating…

Computation and Language · Computer Science 2024-09-11 Lin Ning , Luyang Liu , Jiaxing Wu , Neo Wu , Devora Berlowitz , Sushant Prakash , Bradley Green , Shawn O'Banion , Jun Xie

Large Language Models (LLMs), capable of handling multi-modal input and outputs such as text, voice, images, and video, are transforming the way we process information. Beyond just generating textual responses to prompts, they can integrate…

Human-Computer Interaction · Computer Science 2024-09-17 Shuyang Li , Talha Azfar , Ruimin Ke

Sequential Recommender Systems (SRS) have become a cornerstone of online platforms, leveraging users' historical interaction data to forecast their next potential engagement. Despite their widespread adoption, SRS often grapple with the…

Information Retrieval · Computer Science 2025-03-24 Yuqi Sun , Qidong Liu , Haiping Zhu , Feng Tian

Recent developments in computer graphics, machine learning, and sensor technologies enable numerous opportunities for extended reality (XR) setups for everyday life, from skills training to entertainment. With large corporations offering…

Human-Computer Interaction · Computer Science 2025-03-04 Kadir Burak Buldu , Süleyman Özdel , Ka Hei Carrie Lau , Mengdi Wang , Daniel Saad , Sofie Schönborn , Auxane Boch , Enkelejda Kasneci , Efe Bozkir

Large Language Model (LLM)-based copilots have shown great potential in Extended Reality (XR) applications. However, the user faces challenges when describing the 3D environments to the copilots due to the complexity of conveying…

Human-Computer Interaction · Computer Science 2025-05-09 Xiyun Hu , Dizhi Ma , Fengming He , Zhengzhe Zhu , Shao-Kang Hsia , Chenfei Zhu , Ziyi Liu , Karthik Ramani

The generation of corner cases has become increasingly crucial for efficiently testing autonomous vehicles prior to road deployment. However, existing methods struggle to accommodate diverse testing requirements and often lack the ability…

Robotics · Computer Science 2024-09-11 Qiujing Lu , Xuanhan Wang , Yiwei Jiang , Guangming Zhao , Mingyue Ma , Shuo Feng

Driving in safety-critical scenarios requires quick, context-aware decision-making grounded in both situational understanding and experiential reasoning. Large Language Models (LLMs), with their powerful general-purpose reasoning…

Artificial Intelligence · Computer Science 2025-06-26 Wenbin Gan , Minh-Son Dao , Koji Zettsu

This study investigates the structured generation capabilities of large language models (LLMs), focusing on producing valid JSON outputs against a given schema. Despite the widespread use of JSON in integrating language models with…

Computation and Language · Computer Science 2025-03-07 Yaxi Lu , Haolun Li , Xin Cong , Zhong Zhang , Yesai Wu , Yankai Lin , Zhiyuan Liu , Fangming Liu , Maosong Sun

This paper explores the integration of Large Language Models (LLMs) into Automatic Speech Recognition (ASR) systems to improve transcription accuracy. The increasing sophistication of LLMs, with their in-context learning capabilities and…

Computation and Language · Computer Science 2025-06-03 Zeping Min , Jinbo Wang

We present a novel architecture for safely integrating Large Language Models (LLMs) into interactive game engines, allowing players to "program" new behaviors using natural language. Our framework mitigates risks by using an LLM to…

Human-Computer Interaction · Computer Science 2025-10-21 Austin Drake , Hang Dong