English
Related papers

Related papers: Critical Thinking for Language Models

200 papers

Large language models (LLMs) such as GPT-3 have demonstrated a strong capability to generate coherent and contextually relevant text. However, amidst their successes, a crucial issue persists: their generated outputs still lack commonsense…

Computation and Language · Computer Science 2023-10-27 Yufei Tian , Felix Zhang , Nanyun Peng

As an effective approach to tune pre-trained language models (PLMs) for specific tasks, prompt-learning has recently attracted much attention from researchers. By using \textit{cloze}-style language prompts to stimulate the versatile…

Computation and Language · Computer Science 2021-08-25 Ning Ding , Yulin Chen , Xu Han , Guangwei Xu , Pengjun Xie , Hai-Tao Zheng , Zhiyuan Liu , Juanzi Li , Hong-Gee Kim

Current work in language models (LMs) helps us speed up or even skip thinking by accelerating and automating cognitive work. But can LMs help us with critical thinking -- thinking in deeper, more reflective ways which challenge assumptions,…

Human-Computer Interaction · Computer Science 2024-08-09 Andre Ye , Jared Moore , Rose Novick , Amy X. Zhang

Pre-trained language models (PTLM) have achieved impressive results in a range of natural language understanding (NLU) and generation (NLG) tasks. However, current pre-training objectives such as masked token prediction (for BERT-style…

Computation and Language · Computer Science 2020-11-26 Wangchunshu Zhou , Dong-Ho Lee , Ravi Kiran Selvam , Seyeon Lee , Bill Yuchen Lin , Xiang Ren

Zero-shot cross-lingual knowledge transfer enables a multilingual pretrained language model, finetuned on a task in one language, make predictions for this task in other languages. While being broadly studied for natural language…

Computation and Language · Computer Science 2024-04-23 Nadezhda Chirkova , Vassilina Nikoulina

While Pre-trained Language Models (PLMs) internalize a great amount of world knowledge, they have been shown incapable of recalling these knowledge to solve tasks requiring complex & multi-step reasoning. Similar to how humans develop a…

Computation and Language · Computer Science 2022-10-25 Boshi Wang , Xiang Deng , Huan Sun

Computational argumentation has become an essential tool in various domains, including law, public policy, and artificial intelligence. It is an emerging research field in natural language processing that attracts increasing attention.…

Computation and Language · Computer Science 2024-07-02 Guizhen Chen , Liying Cheng , Luu Anh Tuan , Lidong Bing

Evaluating large language models (LLMs) on their linguistic reasoning capabilities is an important task to understand the gaps in their skills that may surface during large-scale adoption. In this work, we investigate the abilities of such…

Computation and Language · Computer Science 2024-12-25 Raghav Ramji , Keshav Ramji

Question generation is a conditioned language generation task that consists in generating a context-aware question given a context and the targeted answer. Train language modelling with a mere likelihood maximization has been widely used…

Computation and Language · Computer Science 2021-10-14 Loïc , Kwate Dassi

Large-scale, transformer-based language models such as GPT-2 are pretrained on diverse corpora scraped from the internet. Consequently, they are prone to generating non-normative text (i.e. in violation of social norms). We introduce a…

Computation and Language · Computer Science 2020-11-02 Xiangyu Peng , Siyan Li , Spencer Frazier , Mark Riedl

In recent years, large language models (LLMs) have demonstrated significant potential in complex reasoning tasks like mathematical problem-solving. However, existing research predominantly relies on reinforcement learning (RL) frameworks…

Machine Learning · Computer Science 2026-01-12 ShaoZhen Liu , Xinting Huang , Houwen Peng , Xin Chen , Xinyang Song , Qi Li , Zhenan Sun

Retrained large language models (LLMs) have become extensively used across various sub-disciplines of natural language processing (NLP). In NLP, text classification problems have garnered considerable focus, but still faced with some…

Computation and Language · Computer Science 2023-12-05 Zhiqiang Wang , Yiran Pang , Yanbin Lin

Recent studies show evidence for emergent cognitive abilities in Large Pre-trained Language Models (PLMs). The increasing cognitive alignment of these models has made them candidates for cognitive science theories. Prior research into the…

Computation and Language · Computer Science 2024-07-15 Raj Sanjay Shah , Khushi Bhardwaj , Sashank Varma

Code language models have emerged as useful tools for various programming tasks, yet they often struggle when it comes to complex ones. In this paper, we explore the potential of curriculum learning in enhancing the performance of these…

Machine Learning · Computer Science 2024-07-16 Marwa Naïr , Kamel Yamani , Lynda Said Lhadj , Riyadh Baghdadi

Pre-trained Language Models (PLMs) have shown impressive results in various Natural Language Generation (NLG) tasks, such as powering chatbots and generating stories. However, an ethical concern arises due to their potential to produce…

Computation and Language · Computer Science 2024-06-04 Kaixin Lan , Tao Fang , Derek F. Wong , Yabo Xu , Lidia S. Chao , Cecilia G. Zhao

Language models often achieve higher accuracy when reasoning step-by-step in complex tasks. However, even when arriving at a correct final answer, their rationales are often logically unsound or inconsistent. This is a major issue when…

Artificial Intelligence · Computer Science 2023-11-09 Gabriel Poesia , Kanishk Gandhi , Eric Zelikman , Noah D. Goodman

Chain-of-thought (CoT) is capable of eliciting models to explicitly generate reasoning paths, thus promoting reasoning accuracy and attracting increasing attention. Specifically, zero-shot CoT achieves remarkable improvements in a wide…

Computation and Language · Computer Science 2023-10-24 Libo Qin , Qiguang Chen , Fuxuan Wei , Shijue Huang , Wanxiang Che

The advancement of Large Language Models (LLMs) has greatly improved our ability to process complex language. However, accurately detecting logical fallacies remains a significant challenge. This study presents a novel and effective prompt…

Artificial Intelligence · Computer Science 2025-04-01 Jiwon Jeong , Hyeju Jang , Hogun Park

Recently, large language models such as GPT-2 have shown themselves to be extremely adept at text generation and have also been able to achieve high-quality results in many downstream NLP tasks such as text classification, sentiment…

Computation and Language · Computer Science 2019-11-22 Sam Witteveen , Martin Andrews

We examine the pre-training dynamics of language models, focusing on their ability to copy text from preceding context--a fundamental skill for various LLM applications, including in-context learning (ICL) and retrieval-augmented generation…

Computation and Language · Computer Science 2025-02-07 Ang Lv , Ruobing Xie , Xingwu Sun , Zhanhui Kang , Rui Yan