English
Related papers

Related papers: Specializing Small Language Models towards Complex…

200 papers

The performance of existing text style transfer models is severely limited by the non-parallel datasets on which the models are trained. In non-parallel datasets, no direct mapping exists between sentences of the source and target style;…

Computation and Language · Computer Science 2022-04-19 Ruibo Liu , Chongyang Gao , Chenyan Jia , Guangxuan Xu , Soroush Vosoughi

Mitigating explicit and implicit biases in Large Language Models (LLMs) has become a critical focus in the field of natural language processing. However, many current methodologies evaluate scenarios in isolation, without considering the…

Computation and Language · Computer Science 2025-02-04 Robert Morabito , Sangmitra Madhusudan , Tyler McDonald , Ali Emami

In this paper, we leverage large language models (LMs) to perform zero-shot text style transfer. We present a prompting method that we call augmented zero-shot learning, which frames style transfer as a sentence rewriting task and requires…

Computation and Language · Computer Science 2022-04-01 Emily Reif , Daphne Ippolito , Ann Yuan , Andy Coenen , Chris Callison-Burch , Jason Wei

Large language models (LLMs) are competitive with the state of the art on a wide range of sentence-level translation datasets. However, their ability to translate paragraphs and documents remains unexplored because evaluation in these…

Computation and Language · Computer Science 2023-05-24 Marzena Karpinska , Mohit Iyyer

In support of open and reproducible research, there has been a rapidly increasing number of datasets made available for research. As the availability of datasets increases, it becomes more important to have quality metadata for discovering…

Computation and Language · Computer Science 2023-10-18 Shiwei Zhang , Mingfang Wu , Xiuzhen Zhang

The rapid advancement of Large Language Models (LLMs) has significantly influenced various domains, leveraging their exceptional few-shot and zero-shot learning capabilities. In this work, we aim to explore and understand the LLMs-based…

Artificial Intelligence · Computer Science 2024-10-24 Dawei Li , Zhen Tan , Huan Liu

Text classification is fundamental in Natural Language Processing (NLP), and the advent of Large Language Models (LLMs) has revolutionized the field. This paper introduces an adaptable and reliable text classification paradigm, which…

Computation and Language · Computer Science 2024-12-10 Zhiqiang Wang , Yiran Pang , Yanbin Lin , Xingquan Zhu

Large Language Models (LLMs) are increasingly being used in educational and learning applications. Research has demonstrated that controlling for style, to fit the needs of the learner, fosters increased understanding, promotes inclusion,…

Computation and Language · Computer Science 2024-06-19 Ankit Aich , Tingting Liu , Salvatore Giorgi , Kelsey Isman , Lyle Ungar , Brenda Curtis

Language models pre-trained on web-scale corpora demonstrate impressive capabilities on diverse downstream tasks. However, there is increasing concern whether such capabilities might arise from evaluation datasets being included in the…

Computation and Language · Computer Science 2024-01-12 Minhao Jiang , Ken Ziyu Liu , Ming Zhong , Rylan Schaeffer , Siru Ouyang , Jiawei Han , Sanmi Koyejo

Large Language Models (LLMs) rely on massive training datasets, often including proprietary data, which raises concerns about unauthorized usage and copyright infringement. Existing dataset inference methods typically require access to log…

Computation and Language · Computer Science 2026-05-05 Chen Xiong , Zihao Wang , Rui Zhu , Tsung-Yi Ho , Pin-Yu Chen , Jingwei Xiong , Haixu Tang

Large language models (LLMs) exhibit a strong capacity for in-context learning: Given labeled examples, they can generate good predictions without parameter updates. However, many interactive settings go beyond static prediction to online…

Machine Learning · Computer Science 2026-05-12 Emile Anand , Abdullah Ateyeh , Xinyuan Cao , Max Dabagia

In 2022, with the release of ChatGPT, large-scale language models gained widespread attention. ChatGPT not only surpassed previous models in terms of parameters and the scale of its pretraining corpus but also achieved revolutionary…

Artificial Intelligence · Computer Science 2024-11-13 Yiming Ju , Huanhuan Ma

Large Language Models (LLM) have made significant advances in the recent past becoming more mainstream in Artificial Intelligence (AI) enabled human-facing applications. However, LLMs often generate stereotypical output inherited from…

Computation and Language · Computer Science 2023-11-27 Wu Zekun , Sahan Bulathwela , Adriano Soares Koshiyama

Diffusion probabilistic models have shown great success in generating high-quality images controllably, and researchers have tried to utilize this controllability into text generation domain. Previous works on diffusion-based language…

Computation and Language · Computer Science 2023-06-13 Yiwei Lyu , Tiange Luo , Jiacheng Shi , Todd C. Hollon , Honglak Lee

In this paper, we propose an efficient transfer leaning methods for training a personalized language model using a recurrent neural network with long short-term memory architecture. With our proposed fast transfer learning schemes, a…

Computation and Language · Computer Science 2017-10-11 Seunghyun Yoon , Hyeongu Yun , Yuna Kim , Gyu-tae Park , Kyomin Jung

We study the problem of controlling the difficulty level of text generated by Large Language Models (LLMs) for contexts where end-users are not fully proficient, such as language learners. Using a novel framework, we evaluate the…

Computation and Language · Computer Science 2024-06-06 Ali Malik , Stephen Mayhew , Chris Piech , Klinton Bicknell

In recent years, Large Language Models (LLMs) have made significant strides towards Artificial General Intelligence. However, training these models from scratch requires substantial computational resources and vast amounts of text data. In…

Computation and Language · Computer Science 2024-10-03 Wenzhen Zheng , Wenbo Pan , Xu Xu , Libo Qin , Li Yue , Ming Zhou

Synthetic data offers a promising solution for mitigating data scarcity and demographic bias in mental health analysis, yet existing approaches largely rely on pretrained large language models (LLMs), which may suffer from limited output…

Computation and Language · Computer Science 2026-01-21 Saad Mankarious , Aya Zirikly

Pretraining large language models (LLMs) on vast and heterogeneous datasets is crucial for achieving state-of-the-art performance across diverse downstream tasks. However, current training paradigms treat all samples equally, overlooking…

Machine Learning · Computer Science 2025-02-11 Daouda Sow , Herbert Woisetschläger , Saikiran Bulusu , Shiqiang Wang , Hans-Arno Jacobsen , Yingbin Liang

Text-based safety classifiers are widely used for content moderation and increasingly to tune generative language model behavior - a topic of growing concern for the safety of digital assistants and chatbots. However, different policies…

Computation and Language · Computer Science 2023-10-24 Maximilian Mozes , Jessica Hoffmann , Katrin Tomanek , Muhamed Kouate , Nithum Thain , Ann Yuan , Tolga Bolukbasi , Lucas Dixon