English
Related papers

Related papers: Conversation Regression Testing: A Design Techniqu…

200 papers

Prompt engineering reduces reasoning mistakes in Large Language Models (LLMs). However, its effectiveness in mitigating vulnerabilities in LLM-generated code remains underexplored. To address this gap, we implemented a benchmark to…

Software Engineering · Computer Science 2025-02-11 Marc Bruni , Fabio Gabrielli , Mohammad Ghafari , Martin Kropp

We introduce SimulBench, a benchmark designed to evaluate large language models (LLMs) across a diverse collection of creative simulation scenarios, such as acting as a Linux terminal or playing text games with users. While these simulation…

Computation and Language · Computer Science 2024-09-13 Qi Jia , Xiang Yue , Tianyu Zheng , Jie Huang , Bill Yuchen Lin

Large language model (LLM) evaluations typically rely on aggregated metrics like accuracy or human preference, averaging across users and prompts. This averaging obscures user- and prompt-specific variations in model performance. To address…

Machine Learning · Computer Science 2025-03-11 Evan Frick , Connor Chen , Joseph Tennyson , Tianle Li , Wei-Lin Chiang , Anastasios N. Angelopoulos , Ion Stoica

Standardized surveys scale efficiently but sacrifice depth, while conversational interviews improve response quality at the cost of scalability and consistency. This study bridges the gap between these methods by introducing a framework for…

Human-Computer Interaction · Computer Science 2025-12-02 Soubhik Barari , Jarret Angbazo , Natalie Wang , Leah M. Christian , Elizabeth Dean , Zoe Slowinski , Brandon Sepulvado

Conversational agents are increasingly used to address emotional needs on top of information needs. One use case of increasing interest are counselling-style mental health and behaviour change interventions, with large language model…

Human-Computer Interaction · Computer Science 2026-04-22 Selina Meyer , David Elsweiler

Gestures perform a variety of communicative functions that powerfully influence human face-to-face interaction. How this communicative function is achieved varies greatly between individuals and depends on the role of the speaker and the…

Human-Computer Interaction · Computer Science 2023-10-24 Laura B. Hensel , Nutchanon Yongsatianchot , Parisa Torshizi , Elena Minucci , Stacy Marsella

Since the launch of ChatGPT, a powerful AI Chatbot developed by OpenAI, large language models (LLMs) have made significant advancements in both academia and industry, bringing about a fundamental engineering paradigm shift in many areas.…

Software Engineering · Computer Science 2023-11-22 Xiaoxia Liu , Jingyi Wang , Jun Sun , Xiaohan Yuan , Guoliang Dong , Peng Di , Wenhai Wang , Dongxia Wang

The rapid evolution of e-commerce has exposed the limitations of traditional product retrieval systems in managing complex, multi-turn user interactions. Recent advances in multimodal generative retrieval -- particularly those leveraging…

Generative artificial intelligence (AI) and large language models (LLMs) have gained rapid popularity through publicly available tools such as ChatGPT. The adoption of LLMs for personal and professional use is fueled by the natural…

Computation and Language · Computer Science 2024-07-25 Sinan Abdulhak , Wayne Hubbard , Karthik Gopalakrishnan , Max Z. Li

Click-through rate (CTR) prediction has become increasingly indispensable for various Internet applications. Traditional CTR models convert the multi-field categorical data into ID features via one-hot encoding, and extract the…

Information Retrieval · Computer Science 2024-06-27 Jianghao Lin , Bo Chen , Hangyu Wang , Yunjia Xi , Yanru Qu , Xinyi Dai , Kangning Zhang , Ruiming Tang , Yong Yu , Weinan Zhang

Conversational AI chatbots have become increasingly common within the customer service industry. Despite improvements in their emotional development, they often lack the authenticity of real customer service interactions or the competence…

Human-Computer Interaction · Computer Science 2025-02-14 Antonin Brun , Ruying Liu , Aryan Shukla , Frances Watson , Jonathan Gratch

Large language models offer new ways of empowering people to program robot applications-namely, code generation via prompting. However, the code generated by LLMs is susceptible to errors. This work reports a preliminary exploration that…

Robotics · Computer Science 2023-10-11 Juo-Tung Chen , Chien-Ming Huang

The widespread availability of Large Language Models (LLMs) within Integrated Development Environments (IDEs) has led to their speedy adoption. Conversational interactions with LLMs enable programmers to obtain natural language explanations…

Human-Computer Interaction · Computer Science 2024-02-12 Bhavya Chopra , Yasharth Bajpai , Param Biyani , Gustavo Soares , Arjun Radhakrishna , Chris Parnin , Sumit Gulwani

Large Language Models (LLMs) are becoming integral to modern software development workflows, assisting developers with code generation, API explanation, and iterative problem-solving through natural language conversations. Despite…

Software Engineering · Computer Science 2025-09-15 Suzhen Zhong , Ying Zou , Bram Adams

This study introduces Conversation Routines (CR), a structured prompt engineering framework for developing task-oriented dialog systems using Large Language Models (LLMs). While LLMs demonstrate remarkable natural language understanding…

Computation and Language · Computer Science 2025-02-25 Giorgio Robino

Language is essentially a complex, intricate system of human expressions governed by grammatical rules. It poses a significant challenge to develop capable AI algorithms for comprehending and grasping a language. As a major approach,…

To combat climate change, individuals are encouraged to adopt sustainable habits, in particular, with their household, optimizing their electrical consumption. Conversational agents, such as Smart Home Assistants, hold promise as effective…

Human-Computer Interaction · Computer Science 2025-05-06 Mathyas Giudici , Alessandro Sironi , Ismaele Villa , Samuele Scherini , Franca Garzotto

System-prompting is a standard tool for customizing language-model chatbots, enabling them to follow a specific instruction. An implicit assumption in the use of system prompts is that they will be stable, so the chatbot will continue to…

Computation and Language · Computer Science 2024-07-29 Kenneth Li , Tianle Liu , Naomi Bashkansky , David Bau , Fernanda Viégas , Hanspeter Pfister , Martin Wattenberg

The advancement of Large Language Models (LLMs), including GPT-4, provides exciting new opportunities for generative design. We investigate the application of this tool across the entire design and manufacturing workflow. Specifically, we…