English
Related papers

Related papers: BLADE: Enhancing Black-box Large Language Models w…

200 papers

The landscape for building conversational interfaces (chatbots) has witnessed a paradigm shift with recent developments in generative Artificial Intelligence (AI) based Large Language Models (LLMs), such as ChatGPT by OpenAI (GPT3.5 and…

Human-Computer Interaction · Computer Science 2024-07-23 Sumit Soman , Ranjani H G

Large Language Models (LLMs) have demonstrated some significant capabilities across various domains; however, their effectiveness in spreadsheet related tasks remains underexplored. This study introduces a foundation for a comprehensive…

Software Engineering · Computer Science 2025-06-24 Simon Thorne

Large language models (LLMs) such as GPT-3 and GPT-4 are powerful but their weights are often publicly unavailable and their immense sizes make the models difficult to be tuned with common hardware. As a result, effectively tuning these…

Computation and Language · Computer Science 2023-05-16 Canwen Xu , Yichong Xu , Shuohang Wang , Yang Liu , Chenguang Zhu , Julian McAuley

Large Transformer models are capable of implementing a plethora of so-called in-context learning algorithms. These include gradient descent, classification, sequence completion, transformation, and improvement. In this work, we investigate…

Artificial Intelligence · Computer Science 2024-02-29 Robert Tjarko Lange , Yingtao Tian , Yujin Tang

Large Language Models (LLMs) have been widely applied in various professional fields. By fine-tuning the models using domain specific question and answer datasets, the professional domain knowledge and Q\&A abilities of these models have…

Computation and Language · Computer Science 2024-07-17 Qimin Yang , Rongsheng Wang , Jiexin Chen , Runqi Su , Tao Tan

Black-box Large Language Models (LLMs) have shown great power in solving various tasks and are considered general problem solvers. However, LLMs still fail in many specific tasks although understand the task instruction. In this paper, we…

Computation and Language · Computer Science 2024-08-13 Wangtao Sun , Xuanqing Yu , Shizhu He , Jun Zhao , Kang Liu

The integration of large language models (LLMs) into automated algorithm design has shown promising potential. A prevalent approach embeds LLMs within search routines to iteratively generate and refine candidate algorithms. However, most…

Machine Learning · Computer Science 2026-05-20 Fei Liu , Rui Zhang , Xi Lin , Zhichao Lu , Qingfu Zhang

The latest advancements in AI and deep learning have led to a breakthrough in large language model (LLM)-based agents such as GPT-4. However, many commercial conversational agent development tools are pipeline-based and have limitations in…

Computation and Language · Computer Science 2023-09-08 Mina Foosherian , Hendrik Purwins , Purna Rathnayake , Touhidul Alam , Rui Teimao , Klaus-Dieter Thoben

Large language models (LLMs) have shown excellent mastering of human language, but still struggle in real-world applications that require mathematical problem-solving. While many strategies and datasets to enhance LLMs' mathematics are…

Computation and Language · Computer Science 2024-04-04 Yifan Xu , Xiao Liu , Xinghan Liu , Zhenyu Hou , Yueyan Li , Xiaohan Zhang , Zihan Wang , Aohan Zeng , Zhengxiao Du , Wenyi Zhao , Jie Tang , Yuxiao Dong

The significant progress of large language models (LLMs) provides a promising opportunity to build human-like systems for various practical applications. However, when applied to specific task domains, an LLM pre-trained on a…

Information Retrieval · Computer Science 2023-11-21 Jing Yao , Wei Xu , Jianxun Lian , Xiting Wang , Xiaoyuan Yi , Xing Xie

Large-scale language models (LLMs) have emerged as a groundbreaking innovation in the realm of question-answering and conversational agents. These models, leveraging different deep learning architectures such as Transformers, are trained on…

Software Engineering · Computer Science 2023-07-18 Fardin Ahsan Sakib , Saadat Hasan Khan , A. H. M. Rezaul Karim

Large language models (LLMs) such as ChatGPT have shown remarkable capabilities in code generation. Despite significant achievements, they rely on enormous training data to acquire a broad spectrum of open-domain knowledge. Besides, their…

Software Engineering · Computer Science 2025-02-18 Xiaodong Gu , Meng Chen , Yalan Lin , Yuhan Hu , Hongyu Zhang , Chengcheng Wan , Zhao Wei , Yong Xu , Juhong Wang

Scaling language models with more data, compute and parameters has driven significant progress in natural language processing. For example, thanks to scaling, GPT-3 was able to achieve strong results on in-context learning tasks. However,…

There is a significant gap between patient needs and available mental health support today. In this paper, we aim to thoroughly examine the potential of using Large Language Models (LLMs) to assist professional psychotherapy. To this end,…

Computation and Language · Computer Science 2025-01-28 Mian Zhang , Xianjun Yang , Xinlu Zhang , Travis Labrum , Jamie C. Chiu , Shaun M. Eack , Fei Fang , William Yang Wang , Zhiyu Zoey Chen

The progress of Large Language Models (LLMs) like ChatGPT raises the question of how they can be integrated into education. One hope is that they can support mathematics learning, including word-problem solving. Since LLMs can handle…

Computation and Language · Computer Science 2025-08-12 Anselm R. Strohmaier , Wim Van Dooren , Kathrin Seßler , Brian Greer , Lieven Verschaffel

The adoption of Large Language Models (LLMs) for code generation in data science offers substantial potential for enhancing tasks such as data manipulation, statistical analysis, and visualization. However, the effectiveness of these models…

Software Engineering · Computer Science 2024-11-20 Nathalia Nascimento , Everton Guimaraes , Sai Sanjna Chintakunta , Santhosh Anitha Boominathan

Recent advances in large language models (LLMs) have led to substantial progress in domain-specific applications, particularly within the legal domain. However, general-purpose models such as GPT-4 often struggle with specialized subdomains…

Artificial Intelligence · Computer Science 2026-01-16 Zixun Lan , Maochun Xu , Yifan Ren , Rui Wu , Jianghui Zhou , Xueyang Cheng , Jianan Ding Ding , Xinheng Wang , Mingmin Chi , Fei Ma

Large Language Models (LLMs) as chatbots have drawn remarkable attention thanks to their versatile capability in natural language processing as well as in a wide range of tasks. While there has been great enthusiasm towards adopting such…

Systems and Control · Electrical Eng. & Systems 2024-06-24 Subir Majumder , Lin Dong , Fatemeh Doudi , Yuting Cai , Chao Tian , Dileep Kalathi , Kevin Ding , Anupam A. Thatte , Na Li , Le Xie

Achieving consistent high-quality machine translation (MT) across diverse domains remains a significant challenge, primarily due to the limited and imbalanced parallel training data available in various domains. While large language models…

Computation and Language · Computer Science 2024-10-04 Tianxiang Hu , Pei Zhang , Baosong Yang , Jun Xie , Derek F. Wong , Rui Wang

Model-Driven Engineering (MDE) has seen significant advancements with the integration of Machine Learning (ML) and Deep Learning (DL) techniques. Building upon the groundwork of previous investigations, our study provides a concise overview…

Software Engineering · Computer Science 2024-10-24 Juri Di Rocco , Davide Di Ruscio , Claudio Di Sipio , Phuong T. Nguyen , Riccardo Rubei