English
Related papers

Related papers: PricingLogic: Evaluating LLMs Reasoning on Complex…

200 papers

As large language models (LLMs) become increasingly integral to the hospitality and tourism industry, concerns about their fairness in serving diverse identity groups persist. Grounded in social identity theory and sociotechnical systems…

Artificial Intelligence · Computer Science 2025-10-21 Ruiping Ren , Yingwei , Xu , Xing Yao , Shu Cole , Haining Wang

Large Language Models (LLMs) are widely used for writing economic analysis reports or providing financial advice, but their ability to understand economic knowledge and reason about potential results of specific economic events lacks…

Computation and Language · Computer Science 2024-07-02 Yue Guo , Yi Yang

A language can have different varieties. These varieties can affect the performance of natural language processing (NLP) models, including large language models (LLMs), which are often trained on data from widely spoken varieties. This…

Computation and Language · Computer Science 2025-03-21 Zixin Tang , Chieh-Yang Huang , Tsung-Che Li , Ho Yin Sam Ng , Hen-Hsen Huang , Ting-Hao 'Kenneth' Huang

Travel planning is a natural real-world task to test large language models' (LLMs) planning and tool-use abilities. Although prior work has studied LLM performance on travel planning, existing settings still differ from real-world needs,…

Artificial Intelligence · Computer Science 2026-04-22 Xiang Cheng , Yulan Hu , Xiangwen Zhang , Lu Xu , Lide Tan , Zheng Pan , Xin Li , Yong Liu

This paper presents a comprehensive framework for testing and evaluating quality characteristics of Large Language Model (LLM) systems enhanced with Retrieval-Augmented Generation (RAG) in tourism applications. Through systematic empirical…

Software Engineering · Computer Science 2025-02-11 Bestoun S. Ahmed , Ludwig Otto Baader , Firas Bayram , Siri Jagstedt , Peter Magnusson

Existing benchmarks for evaluating mathematical reasoning in large language models (LLMs) rely primarily on competition problems, formal proofs, or artificially challenging questions -- failing to capture the nature of mathematics…

Artificial Intelligence · Computer Science 2025-10-21 Jie Zhang , Cezara Petrui , Kristina Nikolić , Florian Tramèr

Recently, large language models (LLMs) have demonstrated their effectiveness in various natural language processing (NLP) tasks. However, the lack of tourism knowledge limits the performance of LLMs in tourist attraction presentations and…

Computation and Language · Computer Science 2025-09-10 Qikai Wei , Mingzhi Yang , Jinqiang Wang , Wenwei Mao , Jiabo Xu , Huansheng Ning

Detecting product price outliers is important for retail and e-commerce stores as erroneous or unexpectedly high prices adversely affect competitiveness, revenue, and consumer trust. Classical techniques offer simple thresholds while…

Computation and Language · Computer Science 2026-03-24 Shadi Sartipi , John Wu , Sina Ghotbi , Nikhita Vedula , Shervin Malmasi

Recent efforts like TripCraft and TravelPlanner have advanced the use of Large Language Models ( LLMs) for personalized, constraint aware travel itinerary generation. Yet, real travel often faces disruptions. To address this, we present…

Computation and Language · Computer Science 2025-10-27 Priyanshu Karmakar , Soumyabrata Chaudhuri , Shubhojit Mallick , Manish Gupta , Abhik Jana , Shreya Ghosh

Agentic search has emerged as a promising paradigm for adaptive retrieval systems powered by large language models (LLMs). However, existing benchmarks primarily focus on quality, overlooking efficiency factors that are critical for…

Information Retrieval · Computer Science 2026-03-02 Guy Hadad , Shadi Iskander , Oren Kalinsky , Sofia Tolmach , Ran Levy , Haggai Roitman

Large language models LLMs like ChatGPT have reached the 100 Mio user barrier in record time and might increasingly enter all areas of our life leading to a diverse set of interactions between those Artificial Intelligence models and…

Computation and Language · Computer Science 2024-11-25 Johannes Schneider , Steffi Haag , Leona Chandra Kruse

Travel choice analysis is crucial for understanding individual travel behavior to develop appropriate transport policies and recommendation systems in Intelligent Transportation Systems (ITS). Despite extensive research, this domain faces…

Artificial Intelligence · Computer Science 2024-06-25 Xuehao Zhai , Hanlin Tian , Lintong Li , Tianyu Zhao

The planning ability of Large Language Models (LLMs) has garnered increasing attention in recent years due to their remarkable capacity for multi-step reasoning and their ability to generalize across a wide range of domains. While some…

Artificial Intelligence · Computer Science 2025-02-19 Mohamed Aghzal , Erion Plaku , Gregory J. Stein , Ziyu Yao

Large Language Models (LLMs) have the potential to semi-automate some process mining (PM) analyses. While commercial models are already adequate for many analytics tasks, the competitive level of open-source LLMs in PM tasks is unknown. In…

Computation and Language · Computer Science 2024-07-19 Alessandro Berti , Humam Kourani , Wil M. P. van der Aalst

Large Language Models (LLMs) ) have demonstrated promise in boosting productivity across AI-powered tools, yet existing benchmarks like Massive Multitask Language Understanding (MMLU) inadequately assess enterprise-specific task…

Artificial Intelligence · Computer Science 2025-06-26 Liya Wang , David Yi , Damien Jose , John Passarelli , James Gao , Jordan Leventis , Kang Li

Large Language Models (LLMs) are increasingly proposed as near-autonomous artificial intelligence (AI) agents capable of making everyday decisions on behalf of humans. Although LLMs perform well on many technical tasks, their behaviour in…

Computation and Language · Computer Science 2025-06-24 Mateusz Cedro , Timour Ichmoukhamedov , Sofie Goethals , Yifan He , James Hinns , David Martens

Large language models (LLMs), a recent advance in deep learning and machine intelligence, have manifested astonishing capacities, now considered among the most promising for artificial general intelligence. With human-like capabilities,…

Artificial Intelligence · Computer Science 2025-09-19 Zhilun Zhou , Jing Yi Wang , Nicholas Sukiennik , Chen Gao , Fengli Xu , Yong Li , James Evans

Large Language Models (LLMs) have demonstrated potential as effective search relevance evaluators. However, there is a lack of comprehensive guidance on which models consistently perform optimally across various contexts or within specific…

Machine Learning · Computer Science 2024-10-29 Silvia Terragni , Hoang Cuong , Joachim Daiber , Pallavi Gudipati , Pablo N. Mendes

Users increasingly rely on Large Language Models (LLMs) for Deep Research, using them to synthesize diverse sources into structured reports that support understanding and action. In this context, the practical reliability of such reports…

Computation and Language · Computer Science 2026-02-24 Jujia Zhao , Zhaoxin Huan , Zihan Wang , Xiaolu Zhang , Jun Zhou , Suzan Verberne , Zhaochun Ren

Planning trips is a cognitively intensive task involving conflicting user preferences, dynamic external information, and multi-step temporal-spatial optimization. Traditional platforms often fall short - they provide static results, lack…

Multiagent Systems · Computer Science 2025-05-19 Binwen Liu , Jiexi Ge , Jiamin Wang