English
Related papers

Related papers: Beyond Words: Evaluating Large Language Models in …

200 papers

In this study, we investigate the capabilities and inherent biases of advanced large language models (LLMs) such as GPT-3.5 and GPT-4 in the context of debate evaluation. We discover that LLM's performance exceeds humans and surpasses the…

Computation and Language · Computer Science 2024-06-05 Xinyi Liu , Pinxin Liu , Hangfeng He

With the promotion of chatgpt to the public, Large language models indeed showcase remarkable common sense, reasoning, and planning skills, frequently providing insightful guidance. These capabilities hold significant promise for their…

Artificial Intelligence · Computer Science 2023-09-14 Siyao Zhang , Daocheng Fu , Zhao Zhang , Bin Yu , Pinlong Cai

Large Language Models (LLMs) evaluation is a patchy and inconsistent landscape, and it is becoming clear that the quality of automatic evaluation metrics is not keeping up with the pace of development of generative models. We aim to improve…

Computation and Language · Computer Science 2023-10-24 Andrea Sottana , Bin Liang , Kai Zou , Zheng Yuan

This study investigates the efficacy of large language models (LLMs) as tools for grading master-level student essays. Utilizing a sample of 60 essays in political science, the study compares the accuracy of grades suggested by the GPT-4…

General Economics · Economics 2024-06-25 Magnus Lundgren

The ChatGPT, a lite and conversational variant of Generative Pretrained Transformer 4 (GPT-4) developed by OpenAI, is one of the milestone Large Language Models (LLMs) with billions of parameters. LLMs have stirred up much interest among…

Computation and Language · Computer Science 2023-08-01 Hanyao Huang , Ou Zheng , Dongdong Wang , Jiayi Yin , Zijin Wang , Shengxuan Ding , Heng Yin , Chuan Xu , Renjie Yang , Qian Zheng , Bing Shi

Recent developments in multimodal large language models (MLLMs) have spurred significant interest in their potential applications across various medical imaging domains. On the one hand, there is a temptation to use these generative models…

Image and Video Processing · Electrical Eng. & Systems 2024-06-05 Sulaiman Khan , Md. Rafiul Biswas , Alina Murad , Hazrat Ali , Zubair Shah

The global crisis of language endangerment meets a technological turning point as Generative AI (GenAI) and Large Language Models (LLMs) unlock new frontiers in automating corpus creation, transcription, translation, and tutoring. However,…

Computation and Language · Computer Science 2025-05-20 Vincent Koc

The emergence of Large Language Models (LLMs) has transformed information access, with current LLMs also powering deep research systems that can generate comprehensive report-style answers, through planned iterative search, retrieval, and…

Computation and Language · Computer Science 2025-06-18 Bruno Martins , Piotr Szymański , Piotr Gramacki

Travel behavior prediction is a core problem in transportation demand management and is traditionally addressed using numerical models calibrated on observed data. With recent advances in large language models (LLMs), new opportunities have…

Machine Learning · Computer Science 2026-03-12 Baichuan Mo , Hanyong Xu , Ruoyun Ma , Jung-Hoon Cho , Dingyi Zhuang , Xiaotong Guo , Jinhua Zhao

Generative Artificial Intelligence (GenAI) models such as LLMs, GPTs, and Diffusion Models have recently gained widespread attention from both the research and the industrial communities. This survey explores their application in network…

Networking and Internet Architecture · Computer Science 2025-04-14 Giampaolo Bovenzi , Francesco Cerasuolo , Domenico Ciuonzo , Davide Di Monda , Idio Guarino , Antonio Montieri , Valerio Persico , Antonio Pescapè

Recent advances in large language models (LLMs) have stepped forward the development of multilingual speech and machine translation by its reduced representation errors and incorporated external knowledge. However, both translation tasks…

Computation and Language · Computer Science 2024-05-17 Yuchen Hu , Chen Chen , Chao-Han Huck Yang , Ruizhe Li , Dong Zhang , Zhehuai Chen , Eng Siong Chng

Location-based services play an critical role in improving the quality of our daily lives. Despite the proliferation of numerous specialized AI models within spatio-temporal context of location-based services, these models struggle to…

Machine Learning · Computer Science 2024-06-19 Yue Jiang , Qin Chao , Yile Chen , Xiucheng Li , Shuai Liu , Gao Cong

Human mobility prediction is essential for applications like urban planning and transportation management, yet it remains challenging due to the complex, often implicit, intentions behind human behavior. Existing models predominantly focus…

Computation and Language · Computer Science 2024-08-26 Songwei Li , Jie Feng , Jiawei Chi , Xinyuan Hu , Xiaomeng Zhao , Fengli Xu

Large language models (LLMs) have recently demonstrated great success in generating and understanding natural language. While they have also shown potential beyond the domain of natural language, it remains an open question as to what…

Computation and Language · Computer Science 2024-10-11 Muhammad Umair Nasir , Steven James , Julian Togelius

Transformer architectures contribute to managing long-term dependencies for Natural Language Processing, representing one of the most recent changes in the field. These architectures are the basis of the innovative, cutting-edge Large…

Computation and Language · Computer Science 2024-09-06 Silvia García-Méndez , Francisco de Arriba-Pérez , María del Carmen Somoza-López

Generative artificial intelligence (AI), and in particular Large Language Models (LLMs), have exploded in popularity and attention since the release to the public of ChatGPT's Generative Pre-trained Transformer (GPT)-3.5 model in November…

Computers and Society · Computer Science 2024-07-25 Daniel Hopp

Generative artificial intelligence (GenAI) can reshape education and learning. While large language models (LLMs) like ChatGPT dominate current educational research, multimodal capabilities, such as text-to-speech and text-to-image, are…

Artificial Intelligence · Computer Science 2025-04-03 Ville Heilala , Roberto Araya , Raija Hämäläinen

The exponential growth of text-based data in domains such as healthcare, education, and social sciences has outpaced the capacity of traditional qualitative analysis methods, which are time-intensive and prone to subjectivity. Large…

Large Language Models (LLMs) have demonstrated remarkable zero-shot generalization across various language-related tasks, including search engines. However, existing work utilizes the generative ability of LLMs for Information Retrieval…

Computation and Language · Computer Science 2024-12-31 Weiwei Sun , Lingyong Yan , Xinyu Ma , Shuaiqiang Wang , Pengjie Ren , Zhumin Chen , Dawei Yin , Zhaochun Ren

Large language models (LLMs) are renowned for their extensive linguistic knowledge and strong generalization capabilities, but their high computational demands make them unsuitable for resource-constrained environments. In contrast, small…

Computation and Language · Computer Science 2025-06-10 Kyeonghyun Kim , Jinhee Jang , Juhwan Choi , Yoonji Lee , Kyohoon Jin , YoungBin Kim