English
Related papers

Related papers: Evaluating the Performance of Large Language Model…

200 papers

Unlocking the potential of Large Language Models (LLMs) in data classification represents a promising frontier in natural language processing. In this work, we evaluate the performance of different LLMs in comparison with state-of-the-art…

Computation and Language · Computer Science 2025-01-16 Arina Kostina , Marios D. Dikaiakos , Dimosthenis Stefanidis , George Pallis

Large language models (LLMs) are increasingly being used for complex research tasks such as literature review, idea generation, and scientific paper analysis, yet their ability to truly understand and process the intricate relationships…

Computation and Language · Computer Science 2025-06-11 Shashidhar Reddy Javaji , Yupeng Cao , Haohang Li , Yangyang Yu , Nikhil Muralidhar , Zining Zhu

Large Language Models (LLMs) have transformed artificial intelligence by excelling in complex natural language processing tasks. Their ability to generate human-like text has opened new possibilities for market research, particularly in…

Artificial Intelligence · Computer Science 2026-04-20 Mengxin Wang , Dennis J. Zhang , Heng Zhang

Large Language Models (LLMs) and AI assistants driven by these models are experiencing exponential growth in usage among both expert and amateur users. In this work, we focus on evaluating the reliability of current LLMs as science…

Computation and Language · Computer Science 2024-09-24 Prasoon Bajpai , Niladri Chatterjee , Subhabrata Dutta , Tanmoy Chakraborty

Political misinformation poses significant challenges to democratic processes, shaping public opinion and trust in media. Manual fact-checking methods face issues of scalability and annotator bias, while machine learning models require…

Computation and Language · Computer Science 2024-11-11 Veronica Chatrath , Marcelo Lotif , Shaina Raza

We investigate and observe the behaviour and performance of Large Language Model (LLM)-backed chatbots in addressing misinformed prompts and questions with demographic information within the domains of Climate Change and Mental Health.…

Large Language Models (LLMs) have demonstrated remarkable capabilities in important tasks such as natural language understanding and language generation, and thus have the potential to make a substantial impact on our society. Such…

Computation and Language · Computer Science 2024-05-24 Zhongwei Wan , Xin Wang , Che Liu , Samiul Alam , Yu Zheng , Jiachen Liu , Zhongnan Qu , Shen Yan , Yi Zhu , Quanlu Zhang , Mosharaf Chowdhury , Mi Zhang

Recently, Large Language Models (LLMs) have drawn significant attention due to their outstanding reasoning capabilities and extensive knowledge repository, positioning them as superior in handling various natural language processing tasks…

Computation and Language · Computer Science 2023-11-30 Han Cao , Lingwei Wei , Mengyang Chen , Wei Zhou , Songlin Hu

Background: Large Language Models (LLMs) are transforming artificial intelligence applications in healthcare due to their ability to understand, generate, and summarize complex medical text. They offer valuable support to clinicians,…

Computation and Language · Computer Science 2026-04-14 Subin Santhosh , Farwa Abbas , Hussain Ahmad , Claudia Szabo

Large Language Models (LLMs) are promising analytical tools. They can augment human epistemic, cognitive and reasoning abilities, and support 'sensemaking', making sense of a complex environment or subject by analysing large volumes of data…

Computers and Society · Computer Science 2024-09-19 Awais Hameed Khan , Hiruni Kegalle , Rhea D'Silva , Ned Watt , Daniel Whelan-Shamy , Lida Ghahremanlou , Liam Magee

This paper examines the efficacy of utilizing large language models (LLMs) to detect public threats posted online. Amid rising concerns over the spread of threatening rhetoric and advance notices of violence, automated content analysis…

Computation and Language · Computer Science 2025-01-07 Taeksoo Kwon , Connor Kim

Large Language Models (LLMs) like ChatGPT, DeepSeek and Gemini seem to be increasingly used for knowledge discovery, information retrieval, and knowledge summaries, including for academic topics. This can result in users being misled, such…

Information Retrieval · Computer Science 2026-05-28 Mike Thelwall

Large language models (LLMs) such as those embedded in 'chatbots' are accelerating and democratizing research by providing comprehensible information and expertise from many different fields. However, these models may also confer easy…

Computers and Society · Computer Science 2023-06-07 Emily H. Soice , Rafael Rocha , Kimberlee Cordova , Michael Specter , Kevin M. Esvelt

Modern AI technology like Large language models (LLMs) has the potential to pollute the public information sphere with made-up content, which poses a significant threat to the cohesion of societies at large. A wide range of research has…

Computation and Language · Computer Science 2024-07-19 Steffen Herbold , Alexander Trautsch , Zlata Kikteva , Annette Hautli-Janisz

Nowadays, Information spreads at an unprecedented pace in social media and discerning truth from misinformation and fake news has become an acute societal challenge. Machine learning (ML) models have been employed to identify fake news but…

Computation and Language · Computer Science 2024-05-08 Jasraj Singh , Fang Liu , Hong Xu , Bee Chin Ng , Wei Zhang

By training deep neural networks on massive archives of digitized text, large language models (LLMs) learn the complex linguistic patterns that constitute historic and contemporary discourses. We argue that LLMs can serve as a valuable tool…

Computers and Society · Computer Science 2024-07-17 Austin C. Kozlowski , Hyunku Kwon , James A. Evans

The spread of media bias is a significant concern as political discourse shapes beliefs and opinions. Addressing this challenge computationally requires improved methods for interpreting news. While large language models (LLMs) can scale…

Human-Computer Interaction · Computer Science 2026-02-24 Qile Wang , Prerana Khatiwada , Avinash Chouhan , Ashrey Mahesh , Joy Mwaria , Duy Duc Tran , Kenneth E. Barner , Matthew Louis Mauriello

The proliferation of Large Language Models (LLMs) in high-stakes applications such as medical (self-)diagnosis and preliminary triage raises significant ethical and practical concerns about the effectiveness, appropriateness, and possible…

Computers and Society · Computer Science 2025-06-18 Bonam Mingole , Aditya Majumdar , Firdaus Ahmed Choudhury , Jennifer L. Kraschnewski , Shyam S. Sundar , Amulya Yadav

The rapid dissemination of information through social media and the Internet has posed a significant challenge for fact-checking, among others in identifying check-worthy claims that fact-checkers should pay attention to, i.e. filtering…

Computation and Language · Computer Science 2024-06-27 Yufeng Li , Rrubaa Panchendrarajan , Arkaitz Zubiaga

A drastic rise in potentially life-threatening misinformation has been a by-product of the COVID-19 pandemic. Computational support to identify false information within the massive body of data on the topic is crucial to prevent harm.…

Computation and Language · Computer Science 2024-02-09 Jan Philip Wahle , Nischal Ashok , Terry Ruas , Norman Meuschke , Tirthankar Ghosal , Bela Gipp