English
Related papers

Related papers: Undergrads Are All You Have

200 papers

Large Language Models (LLMs) like GPT and LLaMA are revolutionizing the AI industry with their sophisticated capabilities. Training these models requires vast GPU clusters and significant computing time, posing major challenges in terms of…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-30 Jiangfei Duan , Shuo Zhang , Zerui Wang , Lijuan Jiang , Wenwen Qu , Qinghao Hu , Guoteng Wang , Qizhen Weng , Hang Yan , Xingcheng Zhang , Xipeng Qiu , Dahua Lin , Yonggang Wen , Xin Jin , Tianwei Zhang , Peng Sun

Large language models (LLMs) have the potential to revolutionize various fields, including code development, robotics, finance, and education, due to their extensive prior knowledge and rapid advancements. This paper investigates how LLMs…

Computers and Society · Computer Science 2025-06-10 Liangliang Chen , Zhihao Qin , Yiming Guo , Jacqueline Rohde , Ying Zhang

Large Language Models (LLMs) like GPT and Bard are capable of producing code based on textual descriptions, with remarkable efficacy. Such technology will have profound implications for computing education, raising concerns about cheating,…

Emerging Technologies · Computer Science 2024-04-29 Bruno Pereira Cipriano , Pedro Alves

Large Language Models (LLMs) have emerged as promising agents for web navigation tasks, interpreting objectives and interacting with web pages. However, the efficiency of spliced prompts for such tasks remains underexplored. We introduces…

Computation and Language · Computer Science 2023-11-01 Jiarun Liu , Wentao Hu , Chunhong Zhang

Large language models (LLMs) have garnered significant interest in natural language processing (NLP), particularly their remarkable performance in various downstream tasks in resource-rich languages. Recent studies have highlighted the…

Computation and Language · Computer Science 2024-08-06 Md. Arid Hasan , Prerona Tarannum , Krishno Dey , Imran Razzak , Usman Naseem

LoRA achieves remarkable resource efficiency and comparable performance when adapting LLMs for specific tasks. Since ChatGPT demonstrated superior performance on various tasks, there has been a growing desire to adapt one model for all…

Machine Learning · Computer Science 2023-11-21 Yiming Wang , Yu Lin , Xiaodong Zeng , Guannan Zhang

Transformer architectures contribute to managing long-term dependencies for Natural Language Processing, representing one of the most recent changes in the field. These architectures are the basis of the innovative, cutting-edge Large…

Computation and Language · Computer Science 2024-09-06 Silvia García-Méndez , Francisco de Arriba-Pérez , María del Carmen Somoza-López

Unequal access to costly datasets essential for empirical research has long hindered researchers from disadvantaged institutions, limiting their ability to contribute to their fields and advance their careers. Recent breakthroughs in Large…

General Finance · Quantitative Finance 2025-09-16 Julian Junyan Wang , Victor Xiaoqi Wang

Recently, significant public efforts have been directed towards developing low-cost models with capabilities akin to ChatGPT, thereby fostering the growth of open-source conversational models. However, there remains a scarcity of…

Computation and Language · Computer Science 2023-04-18 Yunjie Ji , Yan Gong , Yong Deng , Yiping Peng , Qiang Niu , Baochang Ma , Xiangang Li

Currently, over a thousand LLMs exist that are multi-purpose and are capable of performing real world tasks, including Q&A, text summarization, content generation, etc. However, accessibility, scale and reliability of free models prevents…

Artificial Intelligence · Computer Science 2024-09-24 Surya Narayanan Hari , Rex Liu , Matt Thomson

Climate change is one of the most significant challenges we face together as a society. Creating awareness and educating policy makers the wide-ranging impact of climate change is an essential step towards a sustainable future. Recently,…

Large language models (LLMs) such as ChatGPT have received immense interest for their general-purpose language understanding and, in particular, their ability to generate high-quality text or computer code. For many professions, LLMs…

Computation and Language · Computer Science 2024-04-03 Simon Frieder , Julius Berner , Philipp Petersen , Thomas Lukasiewicz

Open large language models (LLMs) have demonstrated improving multilingual capabilities in recent years. In this paper, we present a study of open LLMs for multilingual machine translation (MT) across a range of languages, and investigate…

Computation and Language · Computer Science 2026-02-26 Yuzhe Shang , Pengzhi Gao , Wei Liu , Jian Luan , Jinsong Su

Although large language models (LLMs) have demonstrated adeptness in a range of tasks, they still lag behind human learning efficiency. This disparity is often linked to the inherent human capacity to learn from basic examples, gradually…

Computation and Language · Computer Science 2024-01-30 Jianqiao Lu , Wanjun Zhong , Yufei Wang , Zhijiang Guo , Qi Zhu , Wenyong Huang , Yanlin Wang , Fei Mi , Baojun Wang , Yasheng Wang , Lifeng Shang , Xin Jiang , Qun Liu

The rapid advancement of large language models (LLMs) such as GPT-3, PaLM, and Llama has significantly transformed natural language processing, showcasing remarkable capabilities in understanding and generating language. However, a…

Computation and Language · Computer Science 2026-05-15 Yifan Zhang

We release and introduce the TigerBot family of large language models (LLMs), consisting of base and chat models, sized from 7, 13, 70 and 180 billion parameters. We develop our models embarking from Llama-2 and BLOOM, and push the boundary…

Computation and Language · Computer Science 2023-12-18 Ye Chen , Wei Cai , Liangmin Wu , Xiaowei Li , Zhanxuan Xin , Cong Fu

The search for a general model that can operate seamlessly across multiple domains remains a key goal in machine learning research. The prevailing methodology in Reinforcement Learning (RL) typically limits models to a single task within a…

Artificial Intelligence · Computer Science 2024-07-11 Quentin Gallouédec , Edward Beeching , Clément Romac , Emmanuel Dellandréa

Multi-task robot learning holds significant importance in tackling diverse and complex scenarios. However, current approaches are hindered by performance issues and difficulties in collecting training datasets. In this paper, we propose…

Robotics · Computer Science 2024-04-10 Wenxuan Song , Han Zhao , Pengxiang Ding , Can Cui , Shangke Lyu , Yaning Fan , Donglin Wang

Large language models (LLMs), such as GPT-4, PaLM, and LLaMa, have been shown to achieve remarkable performance across a variety of natural language tasks. Recent advancements in instruction tuning bring LLMs with ability in following…

Computation and Language · Computer Science 2023-09-12 Vu-Thuan Doan , Quoc-Truong Truong , Duc-Vu Nguyen , Vinh-Tiep Nguyen , Thuy-Ngan Nguyen Luu

Large language models (LLMs) have recently become a popular topic in the field of Artificial Intelligence (AI) research, with companies such as Google, Amazon, Facebook, Amazon, Tesla, and Apple (GAFA) investing heavily in their…

Artificial Intelligence · Computer Science 2023-05-11 Frank Joublin , Antonello Ceravola , Joerg Deigmoeller , Michael Gienger , Mathias Franzius , Julian Eggert