中文
相关论文

相关论文: Cappy: Outperforming and Boosting Large Multi-Task…

200 篇论文

Large language models (LLMs) have achieved great success across diverse tasks, and fine-tuning is sometimes needed to further enhance generation quality. Most existing methods rely on human supervision or parameter retraining, both of which…

计算与语言 · 计算机科学 2025-05-27 Zhen-Yu Zhang , Jiandong Zhang , Huaxiu Yao , Gang Niu , Masashi Sugiyama

Current evaluations of large language models (LLMs) rely on benchmark scores, but it is difficult to interpret what these individual scores reveal about a model's overall skills. Specifically, as a community we lack understanding of how…

计算与语言 · 计算机科学 2025-07-29 Aviya Maimon , Amir DN Cohen , Gal Vishne , Shauli Ravfogel , Reut Tsarfaty

In the realm of large language models (LLMs), enhancing instruction-following capability often involves curating expansive training data. This is achieved through two primary schemes: i) Scaling-Inputs: Amplifying (input, output) pairs per…

计算与语言 · 计算机科学 2024-03-18 Renze Lou , Kai Zhang , Jian Xie , Yuxuan Sun , Janice Ahn , Hanzi Xu , Yu Su , Wenpeng Yin

Test-Time Scaling (TTS) is an important method for improving the performance of Large Language Models (LLMs) by using additional computation during the inference phase. However, current studies do not systematically analyze how policy…

计算与语言 · 计算机科学 2025-02-11 Runze Liu , Junqi Gao , Jian Zhao , Kaiyan Zhang , Xiu Li , Biqing Qi , Wanli Ouyang , Bowen Zhou

Large Multimodal Models (LMMs) have demonstrated impressive performance across numerous academic benchmarks. However, fine-tuning still remains essential to achieve satisfactory performance on downstream tasks, while the task-specific…

计算与语言 · 计算机科学 2024-12-23 Barry Menglong Yao , Qifan Wang , Lifu Huang

Instruction tuning aims to align large language models (LLMs) with open-domain instructions and human-preferred responses. While several studies have explored autonomous approaches to distilling and annotating instructions from powerful…

计算与语言 · 计算机科学 2024-10-04 Yuanhao Yue , Chengyu Wang , Jun Huang , Peng Wang

Recent advancements in large language models (LLMs) have driven a revolutionary paradigm shift in process automation from Robotic Process Automation to Agentic Process Automation by automating the workflow orchestration procedure based on…

软件工程 · 计算机科学 2024-11-11 Shengda Fan , Xin Cong , Yuepeng Fu , Zhong Zhang , Shuyan Zhang , Yuanwei Liu , Yesai Wu , Yankai Lin , Zhiyuan Liu , Maosong Sun

Large language models (LLMs) frequently achieve impressive scores on standardized benchmarks, yet accuracy alone offers a limited view of their capabilities. Evaluating open-source LLMs through leaderboards faces persistent issues like data…

Large Language Models (LLMs), typified by OpenAI's GPT, have marked a significant advancement in artificial intelligence. Trained on vast amounts of text data, LLMs are capable of understanding and generating human-like text across a…

人工智能 · 计算机科学 2024-10-29 Haochen Zhang , Yuyang Dong , Chuan Xiao , Masafumi Oyamada

While large language models (LLMs) have exhibited impressive instruction-following capabilities, it is still unclear whether and to what extent they can respond to explicit constraints that might be entailed in various instructions. As a…

计算与语言 · 计算机科学 2024-01-02 Yihan Chen , Benfeng Xu , Quan Wang , Yi Liu , Zhendong Mao

Recently, there has been a surge in the development of advanced intelligent generative content (AIGC), especially large language models (LLMs). However, for many downstream tasks, it is necessary to fine-tune LLMs using private data. While…

机器学习 · 计算机科学 2024-12-09 Zihan Fang , Zheng Lin , Zhe Chen , Xianhao Chen , Yue Gao , Yuguang Fang

Large language models (LLMs) have been widely adopted due to their remarkable performance across various applications, driving the accelerated development of a large number of diverse models. However, these individual LLMs show limitations…

计算与语言 · 计算机科学 2025-06-13 Kaushal Kumar Maurya , KV Aditya Srivatsa , Ekaterina Kochmar

Large Language Models (LLMs) prompted to generate chain-of-thought (CoT) exhibit impressive reasoning capabilities. Recent attempts at prompt decomposition toward solving complex, multi-step reasoning problems depend on the ability of the…

计算与语言 · 计算机科学 2024-02-28 Gurusha Juneja , Subhabrata Dutta , Soumen Chakrabarti , Sunny Manchanda , Tanmoy Chakraborty

Large Language Models (LLMs), originally developed for natural language processing (NLP), have demonstrated the potential to generalize across modalities and domains. With their in-context learning (ICL) capabilities, LLMs can perform…

人工智能 · 计算机科学 2025-08-26 Nikolaos Pavlidis , Vasilis Perifanis , Symeon Symeonidis , Pavlos S. Efraimidis

Fueled by their remarkable ability to tackle diverse tasks across multiple domains, large language models (LLMs) have grown at an unprecedented rate, with some recent models containing trillions of parameters. This growth is accompanied by…

机器学习 · 计算机科学 2025-05-30 Athanasios Glentis , Jiaxiang Li , Qiulin Shang , Andi Han , Ioannis Tsaknakis , Quan Wei , Mingyi Hong

Large language models (LLMs) have been a disruptive innovation in recent years, and they play a crucial role in our daily lives due to their ability to understand and generate human-like text. Their capabilities include natural language…

分布式、并行与集群计算 · 计算机科学 2024-10-17 Akrit Mudvari , Yuang Jiang , Leandros Tassiulas

Existing large language models (LLMs) for machine translation are typically fine-tuned on sentence-level translation instructions and achieve satisfactory performance at the sentence level. However, when applied to document-level…

计算与语言 · 计算机科学 2024-01-17 Yachao Li , Junhui Li , Jing Jiang , Min Zhang

Recently, Large Language Models (LLMs) have garnered increasing attention in the field of natural language processing, revolutionizing numerous downstream tasks with powerful reasoning and generation abilities. For example, In-Context…

计算与语言 · 计算机科学 2024-12-04 Changzhi Zhou , Dandan Song , Yuhang Tian , Zhijing Wu , Hao Wang , Xinyu Zhang , Jun Yang , Ziyi Yang , Shuhao Zhang

Large Language Models (LLMs) have achieved state-of-the-art accuracies in a variety of natural language processing (NLP) tasks. However, this success comes at the cost of increased model sizes which leads to additional computational burden.…

机器学习 · 计算机科学 2025-12-01 Shrihari Sridharan , Sourjya Roy , Anand Raghunathan , Kaushik Roy

Using large language models (LLMs) to solve complex robotics problems requires understanding their planning capabilities. Yet while we know that LLMs can plan on some problems, the extent to which these planning capabilities cover the space…

机器人学 · 计算机科学 2025-10-02 Jorge Mendez-Mendez