English
Related papers

Related papers: CT-Eval: Benchmarking Chinese Text-to-Table Perfor…

200 papers

The ability of large language models (LLMs) to interpret visual representations of data is crucial for advancing their application in data analysis and decision-making processes. This paper presents a novel synthetic dataset designed to…

Computation and Language · Computer Science 2024-09-05 Aneta Pawelec , Victoria Sara Wesołowska , Zuzanna Bączek , Piotr Sankowski

We introduce TableLLM, a robust large language model (LLM) with 8 billion parameters, purpose-built for proficiently handling tabular data manipulation tasks, whether they are embedded within documents or spreadsheets, catering to…

Computation and Language · Computer Science 2025-02-18 Xiaokang Zhang , Sijia Luo , Bohan Zhang , Zeyao Ma , Jing Zhang , Yang Li , Guanlin Li , Zijun Yao , Kangli Xu , Jinchang Zhou , Daniel Zhang-Li , Jifan Yu , Shu Zhao , Juanzi Li , Jie Tang

Large Language Models (LLMs) have gained significant attention in the field of natural language processing (NLP) due to their wide range of applications. However, training LLMs for languages other than English poses significant challenges,…

Computation and Language · Computer Science 2024-05-20 Yudong Li , Yuhao Feng , Wen Zhou , Zhe Zhao , Linlin Shen , Cheng Hou , Xianxu Hou

With the continuous emergence of Chinese Large Language Models (LLMs), how to evaluate a model's capabilities has become an increasingly significant issue. The absence of a comprehensive Chinese benchmark that thoroughly assesses a model's…

Computation and Language · Computer Science 2023-10-17 Yanyang Li , Jianqiao Zhao , Duo Zheng , Zi-Yuan Hu , Zhi Chen , Xiaohui Su , Yongfeng Huang , Shijia Huang , Dahua Lin , Michael R. Lyu , Liwei Wang

Analyzing Open Source Intelligence (OSINT) from large volumes of data is critical for drafting and publishing comprehensive CTI reports. This process usually follows a three-stage workflow -- triage, deep search and TI drafting. While Large…

Cryptography and Security · Computer Science 2026-03-11 Xiangsen Chen , Xuan Feng , Shuo Chen , Matthieu Maitre , Sudipto Rakshit , Diana Duvieilh , Ashley Picone , Nan Tang

The quality and size of a pretraining dataset significantly influence the performance of large language models (LLMs). While there have been numerous efforts in the curation of such a dataset for English users, there is a relative lack of…

Computation and Language · Computer Science 2024-11-26 Cheng-Wei Lin , Wan-Hsuan Hsieh , Kai-Xin Guan , Chan-Jan Hsu , Chia-Chen Kuo , Chuan-Lin Lai , Chung-Wei Chung , Ming-Jen Wang , Da-Shan Shiu

With the development of the Large Language Models (LLMs), a large range of LLM-based Text-to-SQL(Text2SQL) methods have emerged. This survey provides a comprehensive review of LLM-based Text2SQL studies. We first enumerate classic…

Computation and Language · Computer Science 2025-06-04 Liang Shi , Zhengju Tang , Nan Zhang , Xiaotong Zhang , Zhi Yang

Large language models (LLMs) have achieved significant success in interacting with human. However, recent studies have revealed that these models often suffer from hallucinations, leading to overly confident but incorrect judgments. This…

Computation and Language · Computer Science 2023-09-06 Yusheng Liao , Yutong Meng , Hongcheng Liu , Yanfeng Wang , Yu Wang

The success of ChatGPT validates the potential of large language models (LLMs) in artificial general intelligence (AGI). Subsequently, the release of LLMs has sparked the open-source community's interest in instruction-tuning, which is…

Computation and Language · Computer Science 2023-10-23 Qingyi Si , Tong Wang , Zheng Lin , Xu Zhang , Yanan Cao , Weiping Wang

Large Language Models (LLMs) have garnered considerable interest within both academic and industrial. Yet, the application of LLMs to graph data remains under-explored. In this study, we evaluate the capabilities of four LLMs in addressing…

Artificial Intelligence · Computer Science 2023-09-12 Chang Liu , Bo Wu

Text style transfer plays a vital role in online entertainment and social media. However, existing models struggle to handle the complexity of Chinese long texts, such as rhetoric, structure, and culture, which restricts their broader…

Computation and Language · Computer Science 2025-06-09 Zhen Tao , Dinghao Xi , Zhiyu Li , Liumin Tang , Wei Xu

As large language models (LLMs) are employed worldwide, existing evaluation paradigms for their multilingual capabilities primarily focus on factual task performance, neglecting the ability to judge content's deep-level values across…

Computation and Language · Computer Science 2026-05-12 Yukun Chen , Xinyu Zhang , Boyi Deng , Jialong Tang , Yu Wan , Fei Huang , Yuxi Zhou , Baosong Yang , Yiming Li

The escalating volume of collected healthcare textual data presents a unique challenge for automated Multi-Label Text Classification (MLTC), which is primarily due to the scarcity of annotated texts for training and their nuanced nature.…

Computation and Language · Computer Science 2025-03-04 Hajar Sakai , Sarah S. Lam

Recent large language models (LLMs) have advanced table understanding capabilities but rely on converting tables into text sequences. While multimodal large language models (MLLMs) enable direct visual processing, they face limitations in…

Computation and Language · Computer Science 2025-02-26 Bohao Yang , Yingji Zhang , Dong Liu , André Freitas , Chenghua Lin

Large Language Models (LLMs) have shown remarkable capabilities in language understanding and generation. Nonetheless, it was also witnessed that LLMs tend to produce inaccurate responses to specific queries. This deficiency can be traced…

Computation and Language · Computer Science 2025-05-16 Dixuan Wang , Yanda Li , Junyuan Jiang , Zepeng Ding , Ziqin Luo , Guochao Jiang , Jiaqing Liang , Deqing Yang

Large Language Models (LLMs) have been achieving competent performance on a wide range of downstream tasks, yet existing work shows that inference on structured data is challenging for LLMs. This is because LLMs need to either understand…

Computation and Language · Computer Science 2024-07-04 Younghun Lee , Sungchul Kim , Ryan A. Rossi , Tong Yu , Xiang Chen

There are three problems existing in the popular data-to-text datasets. First, the large-scale datasets either contain noise or lack real application scenarios. Second, the datasets close to real applications are relatively small in size.…

Computation and Language · Computer Science 2023-06-21 Liang Li , Ruiying Geng , Chengyang Fang , Bing Li , Can Ma , Rongyu Cao , Binhua Li , Fei Huang , Yongbin Li

The in-context learning capabilities of large language models (LLMs) show great potential in mental health support. However, the lack of counseling datasets, particularly in Chinese corpora, restricts their application in this field. To…

Computation and Language · Computer Science 2025-03-06 Keqi Chen , Zekai Sun , Yuhua Wen , Huijun Lian , Yingming Gao , Ya Li

Recently an influx of studies claim emergent cognitive abilities in large language models (LLMs). Yet, most rely on anecdotes, overlook contamination of training sets, or lack systematic Evaluation involving multiple tasks, control…

Artificial Intelligence · Computer Science 2023-09-28 Ida Momennejad , Hosein Hasanbeig , Felipe Vieira , Hiteshi Sharma , Robert Osazuwa Ness , Nebojsa Jojic , Hamid Palangi , Jonathan Larson

Large Language Models (LLMs) have remarkable capabilities across NLP tasks. However, their performance in multilingual contexts, especially within the mental health domain, has not been thoroughly explored. In this paper, we evaluate…

Computation and Language · Computer Science 2026-02-03 Nishat Raihan , Sadiya Sayara Chowdhury Puspo , Ana-Maria Bucur , Stevie Chancellor , Marcos Zampieri