English
Related papers

Related papers: End-to-End Chatbot Evaluation with Adaptive Reason…

200 papers

Advances towards more faithful and traceable answers of Large Language Models (LLMs) are crucial for various research and practical endeavors. One avenue in reaching this goal is basing the answers on reliable sources. However, this…

Computation and Language · Computer Science 2024-06-04 Tobias Schimanski , Jingwei Ni , Mathias Kraus , Elliott Ash , Markus Leippold

As machine learning models evolve, maintaining transparency demands more human-centric explainable AI techniques. Counterfactual explanations, with roots in human reasoning, identify the minimal input changes needed to obtain a given output…

Artificial Intelligence · Computer Science 2025-04-23 Marharyta Domnich , Julius Välja , Rasmus Moorits Veski , Giacomo Magnifico , Kadi Tulver , Eduard Barbu , Raul Vicente

Developing Large Language Model (LLM) agents that exhibit human-like behavior, encompassing not only individual heterogeneity rooted in unique user profiles but also adaptive response to socially connected neighbors, is a significant…

Social and Information Networks · Computer Science 2025-09-17 Fanqi Kong , Xiaoyuan Zhang , Xinyu Chen , Yaodong Yang , Song-Chun Zhu , Xue Feng

The introduction of Large Language Models (LLMs) has significantly transformed Natural Language Processing (NLP) applications by enabling more advanced analysis of customer personas. At Volvo Construction Equipment (VCE), customer personas…

Computation and Language · Computer Science 2025-05-26 Muhammed Rizwan , Lars Carlsson , Mohammad Loni

Large language models (LLMs) provide detailed and impressive responses to queries in English. However, are they really consistent at responding to the same query in other languages? The popular way of evaluating for multilingual performance…

Computation and Language · Computer Science 2025-05-29 Ashim Gupta , Maitrey Mehta , Zhichao Xu , Vivek Srikumar

Large language models (LLMs) excel at general question-answering (Q&A) but often fall short in specialized domains due to a lack of domain-specific knowledge. Commercial companies face the dual challenges of privacy protection and resource…

Artificial Intelligence · Computer Science 2024-08-26 Shenglin Zhang , Pengtian Zhu , Minghua Ma , Jiagang Wang , Yongqian Sun , Dongwen Li , Jingyu Wang , Qianying Guo , Xiaolei Hua , Lin Zhu , Dan Pei

The ability to provide trustworthy maternal health information using phone-based chatbots can have a significant impact, particularly in low-resource settings where users have low health literacy and limited access to care. However,…

LGBTQ+ community face disproportionate mental health challenges, including higher rates of depression, anxiety, and suicidal ideation. Research has shown that LGBTQ+ people have been using large language model-based chatbots, such as…

Human-Computer Interaction · Computer Science 2024-05-09 Yinru Long , Zilin Ma , Yiyang Mei , Zhaoyuan Su

The past few decades have witnessed an upsurge in data, forming the foundation for data-hungry, learning-based AI technology. Conversational agents, often referred to as AI chatbots, rely heavily on such data to train large language models…

Computation and Language · Computer Science 2024-11-19 Sumit Kumar Dam , Choong Seon Hong , Yu Qiao , Chaoning Zhang

Large Language Models (LLMs) as chatbots have drawn remarkable attention thanks to their versatile capability in natural language processing as well as in a wide range of tasks. While there has been great enthusiasm towards adopting such…

Systems and Control · Electrical Eng. & Systems 2024-06-24 Subir Majumder , Lin Dong , Fatemeh Doudi , Yuting Cai , Chao Tian , Dileep Kalathi , Kevin Ding , Anupam A. Thatte , Na Li , Le Xie

Evolutionary agentic systems intensify the trade-off between computational efficiency and reasoning capability by repeatedly invoking large language models (LLMs) during inference. This setting raises a central question: how can an agent…

Computation and Language · Computer Science 2026-04-27 Pretam Ray , Pratik Prabhanjan Brahma , Zicheng Liu , Emad Barsoum

Recent advancements in large language models (LLMs) on language modeling and emergent capabilities make them a promising reference-free evaluator of natural language generation quality, and a competent alternative to human evaluation.…

Computation and Language · Computer Science 2023-09-26 Yuxuan Liu , Tianchi Yang , Shaohan Huang , Zihan Zhang , Haizhen Huang , Furu Wei , Weiwei Deng , Feng Sun , Qi Zhang

Recent advances in Large Language Models (LLMs) demonstrate that chain-of-thought prompting and deep reasoning substantially enhance performance on complex tasks, and multi-agent systems can further improve accuracy by enabling model…

Artificial Intelligence · Computer Science 2025-10-16 Zehui Ling , Deshu Chen , Yichi Zhang , Yuchen Liu , Xigui Li , Xin Guo , Yuan Cheng

Large Language Models (LLMs) process millions of queries daily, making efficient response caching a compelling optimization for reducing cost and latency. However, preserving relevance to user queries using this approach proves difficult…

Using large language models (LLMs) to evaluate text quality has recently gained popularity. Some prior works explore the idea of using LLMs for evaluation, while they differ in some details of the evaluation process. In this paper, we…

Computation and Language · Computer Science 2023-10-10 Cheng-Han Chiang , Hung-yi Lee

Large Language Models (LLMs) have significantly enhanced conversational Artificial Intelligence(AI) chatbots; however, domain-specific accuracy and the avoidance of factual inconsistencies remain pressing challenges, particularly for large…

Information Retrieval · Computer Science 2025-09-24 Olalekan K. Akindele , Bhupesh Kumar Mishra , Kenneth Y. Wertheim

Open-ended survey responses provide valuable insights in marketing research, but low-quality responses not only burden researchers with manual filtering but also risk leading to misleading conclusions, underscoring the need for effective…

Computation and Language · Computer Science 2025-10-09 Subin An , Yugyeong Ji , Junyoung Kim , Heejin Kook , Yang Lu , Josh Seltzer

Large Language Models (LLMs) have demonstrated remarkable success in conversational systems by generating human-like responses. However, they can fall short, especially when required to account for personalization or specific knowledge. In…

Computation and Language · Computer Science 2025-11-12 Soyeong Jeong , Aparna Elangovan , Emine Yilmaz , Oleg Rokhlenko

Large Language Models (LLMs) are shifting how scientific research is done. It is imperative to understand how researchers interact with these models and how scientific sub-communities like astronomy might benefit from them. However, there…

Large Language Models (LLMs), which simulate human users, are frequently employed to evaluate chatbots in applications such as tutoring and customer service. Effective evaluation necessitates a high degree of human-like diversity within…

Computation and Language · Computer Science 2024-09-04 Xiaoyu Lin , Xinkai Yu , Ankit Aich , Salvatore Giorgi , Lyle Ungar