English
Related papers

Related papers: Text Classification via Large Language Models

200 papers

Recent advancements in reasoning have significantly enhanced the capabilities of Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) across diverse tasks. However, excessive reliance on chain-of-thought (CoT) reasoning…

Computation and Language · Computer Science 2025-05-22 Jinghui Lu , Haiyang Yu , Siliang Xu , Shiwei Ran , Guozhi Tang , Siqi Wang , Bin Shan , Teng Fu , Hao Feng , Jingqun Tang , Han Wang , Can Huang

Both encoder-only models (e.g., BERT, RoBERTa) and large language models (LLMs, e.g., Llama3) have been widely used for text classification tasks. However, there is a lack of systematic studies comparing the performance of encoder-based…

Computation and Language · Computer Science 2025-05-13 Hang Zhao , Qile P. Chen , Yijing Barry Zhang , Gang Yang

While large language models (LLMs) such as ChatGPT and PaLM have demonstrated remarkable performance in various language understanding and generation tasks, their capabilities in complex reasoning and intricate knowledge utilization still…

Computation and Language · Computer Science 2023-10-11 Haodi Zhang , Min Cai , Xinhe Zhang , Chen Jason Zhang , Rui Mao , Kaishun Wu

Finding preferences expressed in natural language is an important but challenging task. State-of-the-art(SotA) methods leverage transformer-based models such as BERT, RoBERTa, etc. and graph neural architectures such as graph attention…

Computation and Language · Computer Science 2023-10-13 Inwon Kang , Sikai Ruan , Tyler Ho , Jui-Chien Lin , Farhad Mohsin , Oshani Seneviratne , Lirong Xia

Stance classification, the task of predicting the viewpoint of an author on a subject of interest, has long been a focal point of research in domains ranging from social science to machine learning. Current stance detection methods rely…

Computation and Language · Computer Science 2024-03-07 Iain J. Cruickshank , Lynnette Hui Xian Ng

Large Language Models (LLMs) have demonstrated impressive reasoning capabilities, but their substantial size often demands significant computational resources. To reduce resource consumption and accelerate inference, it is essential to…

Machine Learning · Computer Science 2026-02-06 Yiran Zhao , Shengyang Zhou , Zijian Wu , Tongyan Hu , Yuhui Xu , Rengan Dou , Kenji Kawaguchi , Shafiq Joty , Junnan Li , Michael Qizhe Shieh

Large-scale language models such as GPT-3 are excellent few-shot learners, allowing them to be controlled via natural text prompts. Recent studies report that prompt-based direct classification eliminates the need for fine-tuning but lacks…

Computation and Language · Computer Science 2021-11-19 Kang Min Yoo , Dongju Park , Jaewook Kang , Sang-Woo Lee , Woomyeong Park

Current large language models (LLMs), even those explicitly trained for reasoning, often struggle with ambiguous content moderation cases due to misleading "decision shortcuts" embedded in context. Inspired by cognitive psychology insights…

Artificial Intelligence · Computer Science 2026-04-14 Bingzhe Wu , Haotian Lu , Yuchen Mou

Pre-trained language models (LMs) obtain state-of-the-art performance when adapted to text classification tasks. However, when using such models in real-world applications, efficiency considerations are paramount. In this paper, we study…

Computation and Language · Computer Science 2022-10-24 Laura Aina , Nikos Voskarides , Roi Blanco

Until recently, fine-tuned BERT-like models provided state-of-the-art performance on text classification tasks. With the rise of instruction-tuned decoder-only models, commonly known as large language models (LLMs), the field has…

Computation and Language · Computer Science 2026-02-20 Taja Kuzman Pungeršek , Peter Rupnik , Ivan Porupski , Vuk Dinić , Nikola Ljubešić

Large language models (LLMs) have led to a series of breakthroughs in natural language processing (NLP), owing to their excellent understanding and generation abilities. Remarkably, what further sets these models apart is the massive…

Computation and Language · Computer Science 2022-11-10 Daliang Li , Ankit Singh Rawat , Manzil Zaheer , Xin Wang , Michal Lukasik , Andreas Veit , Felix Yu , Sanjiv Kumar

Recent studies emphasize that manually ensuring a consistent response style and maintaining high data quality in training sets can significantly improve the performance of fine-tuned Large Language Models (LLMs) while reducing the number of…

Computation and Language · Computer Science 2025-06-03 Zhuang Li , Yuncheng Hua , Thuy-Trang Vu , Haolan Zhan , Lizhen Qu , Gholamreza Haffari

Enhancement reports (ERs) serve as a critical communication channel between users and developers, capturing valuable suggestions for software improvement. However, manually processing these reports is resource-intensive, leading to delays…

Software Engineering · Computer Science 2025-06-19 Haosheng Zuo , Feifei Niu , Chuanyi Li

Large Language Models (LLMs) like GPT-4o can help automate text classification tasks at low cost and scale. However, there are major concerns about the validity and reliability of LLM outputs. By contrast, human coding is generally more…

Computation and Language · Computer Science 2025-01-17 Conrad Borchers , Danielle R. Thomas , Jionghao Lin , Ralph Abboud , Kenneth R. Koedinger

Ever since the development of GPT-3 in the natural language processing (NLP) field, in-context learning (ICL) has played an essential role in utilizing large language models (LLMs). By presenting the LM utterance-label demonstrations at the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-18 Ming-Hao Hsu , Kai-Wei Chang , Shang-Wen Li , Hung-yi Lee

Multi-turn intent classification is notably challenging due to the complexity and evolving nature of conversational contexts. This paper introduces LARA, a Linguistic-Adaptive Retrieval-Augmentation framework to enhance accuracy in…

Computation and Language · Computer Science 2024-10-15 Junhua Liu , Yong Keat Tan , Bin Fu , Kwan Hui Lim

Despite their impressive generalization capabilities, instruction-tuned Large Language Models often underperform on text classification benchmarks. We introduce SALSA, a coherent pipeline that combines structured prompting, class-to-token…

Computation and Language · Computer Science 2025-10-28 Ruslan Berdichevsky , Shai Nahum-Gefen , Elad Ben Zaken

Generative AI offers a simple, prompt-based alternative to fine-tuning smaller BERT-style LLMs for text classification tasks. This promises to eliminate the need for manually labeled training data and task-specific model training. However,…

Computation and Language · Computer Science 2024-08-19 Martin Juan José Bucher , Marco Martini

Involving collaborative information in Large Language Models (LLMs) is a promising technique for adapting LLMs for recommendation. Existing methods achieve this by concatenating collaborative features with text tokens into a unified…

Information Retrieval · Computer Science 2024-10-28 Yuting Liu , Jinghao Zhang , Yizhou Dang , Yuliang Liang , Qiang Liu , Guibing Guo , Jianzhe Zhao , Xingwei Wang

In this paper, we explore the potential of Large Language Models (LLMs) with assertions to mitigate imbalances in educational datasets. Traditional models often fall short in such contexts, particularly due to the complexity and nuanced…

Computers and Society · Computer Science 2024-07-03 Jeanne McClure , Machi Shimmei , Noboru Matsuda , Shiyan Jiang