English
Related papers

Related papers: Evaluating LLMs Capabilities Towards Understanding…

200 papers

In this study, we present the first comprehensive evaluation of modern LLMs - including GPT-4, GPT-4o, GPT-3.5-Turbo, Gemini 1.5 Pro, DeepSeek-V3, Llama 3.2, and BERT - across three core social media analytics tasks on a Twitter (X)…

Computation and Language · Computer Science 2026-04-22 Ramtin Davoudi , Kartik Thakkar , Nazanin Donyapour , Tyler Derr , Hamid Karimi

Language is essentially a complex, intricate system of human expressions governed by grammatical rules. It poses a significant challenge to develop capable AI algorithms for comprehending and grasping a language. As a major approach,…

Conversational agents have made significant progress since ELIZA, expanding their role across various domains, including healthcare, education, and customer service. As these agents become increasingly integrated into daily human…

Human-Computer Interaction · Computer Science 2025-07-04 Paulo Ricardo Knob , Leonardo Scholler , Juliano Rigatti , Soraia Raupp Musse

Large language models (LLMs) have rapidly become indispensable tools for acquiring information and supporting human decision-making. However, ensuring that these models uphold fairness across varied contexts is critical to their safe and…

Computers and Society · Computer Science 2026-03-05 Xulang Zhang , Rui Mao , Erik Cambria

Understanding the conversation abilities of Large Language Models (LLMs) can help lead to its more cautious and appropriate deployment. This is especially important for safety-critical domains like mental health, where someone's life may…

Computation and Language · Computer Science 2024-03-18 Alexander Marrapese , Basem Suleiman , Imdad Ullah , Juno Kim

Large language models (LLMs) show increasingly advanced emergent capabilities and are being incorporated across various societal domains. Understanding their behavior and reasoning abilities therefore holds significant importance. We argue…

Computation and Language · Computer Science 2024-08-09 Thilo Hagendorff , Ishita Dasgupta , Marcel Binz , Stephanie C. Y. Chan , Andrew Lampinen , Jane X. Wang , Zeynep Akata , Eric Schulz

Users interacting with Large Language Models (LLMs) in a multi-turn conversation routinely refine their requests or pivot to new topics. LLMs, however, often miss these topic shifts and carry over irrelevant context from previous turns,…

Computation and Language · Computer Science 2026-05-12 Aditya Sinha , Harald Steck , Vito Ostuni , Matteo Rinaldi

Large Language Models (LLMs) have recently displayed their extraordinary capabilities in language understanding. However, how to comprehensively assess the sentiment capabilities of LLMs continues to be a challenge. This paper investigates…

Computation and Language · Computer Science 2025-02-17 Yang Liu , Xichou Zhu , Zhou Shen , Yi Liu , Min Li , Yujun Chen , Benzi John , Zhenzhen Ma , Tao Hu , Zhi Li , Zhiyang Xu , Wei Luo , Junhui Wang

Digital technologies have long been explored as a complement to standard procedure in mental health research and practice, ranging from the management of electronic health records to app-based interventions. The recent emergence of large…

Large Language Models (LLMs) such as ChatGPT have become increasingly integrated into critical activities of daily life, raising concerns about equitable access and utilization across diverse demographics. This study investigates the usage…

Computers and Society · Computer Science 2023-10-11 Fiona Draxler , Daniel Buschek , Mikke Tavast , Perttu Hämäläinen , Albrecht Schmidt , Juhi Kulshrestha , Robin Welsch

A lively ongoing debate is taking place, since the extraordinary emergence of Large Language Models (LLMs) with regards to their capability to understand the world and capture the meaning of the dialogues in which they are involved.…

Computation and Language · Computer Science 2025-05-09 Daniel N. Nissani

Effective engagement by large language models (LLMs) requires adapting responses to users' sociodemographic characteristics, such as age, occupation, and education level. While many real-world applications leverage dialogue history for…

Computation and Language · Computer Science 2025-05-28 Qishuai Zhong , Zongmin Li , Siqi Fan , Aixin Sun

Social media user profiling through content analysis is crucial for tasks like misinformation detection, engagement prediction, hate speech monitoring, and user behavior modeling. However, existing profiling techniques, including tweet…

Social and Information Networks · Computer Science 2025-05-12 Vahid Rahimzadeh , Ali Hamzehpour , Azadeh Shakery , Masoud Asadpour

Large language models (LLMs) are increasingly being utilised across a range of tasks and domains, with a burgeoning interest in their application within the field of journalism. This trend raises concerns due to our limited understanding of…

Computation and Language · Computer Science 2024-06-18 Filip Trhlik , Pontus Stenetorp

Large Language Models (LLMs) have recently showcased their remarkable capacities, not only in natural language processing tasks but also across diverse domains such as clinical medicine, legal consultation, and education. LLMs become more…

Computation and Language · Computer Science 2024-01-23 Jen-tse Huang , Wenxuan Wang , Eric John Li , Man Ho Lam , Shujie Ren , Youliang Yuan , Wenxiang Jiao , Zhaopeng Tu , Michael R. Lyu

Developing high-performing dialogue systems benefits from the automatic identification of undesirable behaviors in system responses. However, detecting such behaviors remains challenging, as it draws on a breadth of general knowledge and…

Computation and Language · Computer Science 2023-09-14 Sarah E. Finch , Ellie S. Paek , Jinho D. Choi

This article proposes a new integration of linguistic anthropology and machine learning (ML) around convergent interests in both the underpinnings of language and making language technologies more socially responsible. While linguistic…

Computers and Society · Computer Science 2024-11-11 Graham M. Jones , Shai Satran , Arvind Satyanarayan

The rise of echo chambers on social media platforms has heightened concerns about polarization and the reinforcement of existing beliefs. Traditional approaches for simulating echo chamber formation have often relied on predefined rules and…

Social and Information Networks · Computer Science 2025-02-26 Chenhao Gu , Ling Luo , Zainab Razia Zaidi , Shanika Karunasekera

Interest in Large Language Models (LLMs) has increased drastically since the emergence of ChatGPT and the outstanding positive societal response to the ease with which it performs tasks in Natural Language Processing (NLP). The triumph of…

Computation and Language · Computer Science 2023-04-06 Oluwatosin Ogundare , Gustavo Quiros Araya

Large language models (LLMs) have shown impressive capabilities across tasks such as mathematics, coding, and reasoning, yet their learning ability, which is crucial for adapting to dynamic environments and acquiring new knowledge, remains…

Computation and Language · Computer Science 2025-12-29 Zhengyu Hu , Jianxun Lian , Zheyuan Xiao , Seraphina Zhang , Tianfu Wang , Nicholas Jing Yuan , Xing Xie , Hui Xiong