English
Related papers

Related papers: Thus Spake Long-Context Large Language Model

200 papers

The planning ability of Large Language Models (LLMs) has garnered increasing attention in recent years due to their remarkable capacity for multi-step reasoning and their ability to generalize across a wide range of domains. While some…

Artificial Intelligence · Computer Science 2025-02-19 Mohamed Aghzal , Erion Plaku , Gregory J. Stein , Ziyu Yao

With the advent of large language models (LLMs), there is a growing interest in applying LLMs to scientific tasks. In this work, we conduct an experimental study to explore applicability of LLMs for configuring, annotating, translating,…

Human-Computer Interaction · Computer Science 2025-10-13 Orcun Yildiz , Tom Peterka

Enlarging the context window of large language models (LLMs) has become a crucial research area, particularly for applications involving extremely long texts. In this work, we propose a novel training-free framework for processing long…

Computation and Language · Computer Science 2024-10-15 Zihan Zhou , Chong Li , Xinyi Chen , Shuo Wang , Yu Chao , Zhili Li , Haoyu Wang , Rongqiao An , Qi Shi , Zhixing Tan , Xu Han , Xiaodong Shi , Zhiyuan Liu , Maosong Sun

Conversational search enables multi-turn interactions between users and systems to fulfill users' complex information needs. During this interaction, the system should understand the users' search intent within the conversational context…

Information Retrieval · Computer Science 2025-06-13 Fengran Mo , Chuan Meng , Mohammad Aliannejadi , Jian-Yun Nie

Large language models (LLMs) have demonstrated impressive capabilities in general scenarios, exhibiting a level of aptitude that approaches, in some aspects even surpasses, human-level intelligence. Among their numerous skills, the…

Computation and Language · Computer Science 2023-11-30 Zhiwei He , Tian Liang , Wenxiang Jiao , Zhuosheng Zhang , Yujiu Yang , Rui Wang , Zhaopeng Tu , Shuming Shi , Xing Wang

The rapid advancement of large language models (LLMs) has revolutionized artificial intelligence, introducing unprecedented capabilities in natural language processing and multimodal content generation. However, the increasing complexity…

Software Engineering · Computer Science 2024-11-27 Shenao Wang , Yanjie Zhao , Xinyi Hou , Haoyu Wang

Large language models (LLMs) excel at solving problems with clear and complete statements, but often struggle with nuanced environments or interactive tasks which are common in most real-world scenarios. This highlights the critical need…

Large language models (LLMs) process and predict sequences containing text to answer questions, and address tasks including document summarization, providing recommendations, writing software and solving quantitative problems. We provide a…

Numerical Analysis · Mathematics 2026-02-02 Ricardo Baptista , Andrew Stuart , Son Tran

Large Language Models (LLMs) have demonstrated remarkable capabilities in important tasks such as natural language understanding and language generation, and thus have the potential to make a substantial impact on our society. Such…

Computation and Language · Computer Science 2024-05-24 Zhongwei Wan , Xin Wang , Che Liu , Samiul Alam , Yu Zheng , Jiachen Liu , Zhongnan Qu , Shen Yan , Yi Zhu , Quanlu Zhang , Mosharaf Chowdhury , Mi Zhang

Large language models (LLMs), especially when instruction-tuned for chat, have become part of our daily lives, freeing people from the process of searching, extracting, and integrating information from multiple sources by offering a…

Computation and Language · Computer Science 2024-11-01 Yuxia Wang , Minghan Wang , Muhammad Arslan Manzoor , Fei Liu , Georgi Georgiev , Rocktim Jyoti Das , Preslav Nakov

Given the great success of large language models (LLMs) across various tasks, in this paper, we introduce LLM-ST, a novel and effective speech translation model constructed upon a pre-trained LLM. By integrating the large language model…

Computation and Language · Computer Science 2023-12-22 Zhichao Huang , Rong Ye , Tom Ko , Qianqian Dong , Shanbo Cheng , Mingxuan Wang , Hang Li

Large Language Models (LLMs) have delivered impressive results in language understanding, generation, reasoning, and pushes the ability boundary of multimodal models. Transformer models, as the foundation of modern LLMs, offer a strong…

Computation and Language · Computer Science 2025-08-14 Weigao Sun , Jiaxi Hu , Yucheng Zhou , Jusen Du , Disen Lan , Kexin Wang , Tong Zhu , Xiaoye Qu , Yu Zhang , Xiaoyu Mo , Daizong Liu , Yuxuan Liang , Wenliang Chen , Guoqi Li , Yu Cheng

The recent advent of powerful Large-Language Models (LLM) provides a new conversational form of inquiry into historical memory (or, training data, in this case). We show that by augmenting such LLMs with vector embeddings from highly…

Information Retrieval · Computer Science 2023-10-18 Giselle Gonzalez Garcia , Christian Weilbach

Large Language Models (LLMs) have demonstrated exceptional natural language understanding abilities and have excelled in a variety of natural language processing (NLP)tasks in recent years. Despite the fact that most LLMs are trained…

Computation and Language · Computer Science 2023-10-25 Xiang Zhang , Senyu Li , Bradley Hauer , Ning Shi , Grzegorz Kondrak

The rapid evolution of large language models (LLMs) and their capacity to simulate human cognition and behavior has given rise to LLM-based frameworks and tools that are evaluated and applied based on their ability to perform tasks…

Computation and Language · Computer Science 2024-12-03 Jing Yi Wang , Nicholas Sukiennik , Tong Li , Weikang Su , Qianyue Hao , Jingbo Xu , Zihan Huang , Fengli Xu , Yong Li

Recent advances in large language models (LLMs) have unlocked novel opportunities for machine learning applications in the financial domain. These models have demonstrated remarkable capabilities in understanding context, processing vast…

General Finance · Quantitative Finance 2024-06-19 Yuqi Nie , Yaxuan Kong , Xiaowen Dong , John M. Mulvey , H. Vincent Poor , Qingsong Wen , Stefan Zohren

The rapid advancement of Large Language Models (LLMs) has spurred significant progress in Large Speech-Language Models (LSLMs), enhancing their capabilities in both speech understanding and generation. While existing LSLMs often concentrate…

Computation and Language · Computer Science 2025-11-03 Shoutao Guo , Shaolei Zhang , Qingkai Fang , Zhengrui Ma , Min Zhang , Yang Feng

Cross-lingual context retrieval (extracting contextual information in one language based on requests in another) is a fundamental aspect of cross-lingual alignment, but the performance and mechanism of it for large language models (LLMs)…

Computation and Language · Computer Science 2025-10-21 Changjiang Gao , Hankun Lin , Xin Huang , Xue Han , Junlan Feng , Chao Deng , Jiajun Chen , Shujian Huang

Large Language Models (LLMs) have shown exciting performance in listwise passage ranking. Due to the limited input length, existing methods often adopt the sliding window strategy. Such a strategy, though effective, is inefficient as it…

Information Retrieval · Computer Science 2024-12-20 Wenhan Liu , Xinyu Ma , Yutao Zhu , Ziliang Zhao , Shuaiqiang Wang , Dawei Yin , Zhicheng Dou

Recently, there has been growing interest in extending the context length of large language models (LLMs), aiming to effectively process long inputs of one turn or conversations with more extensive histories. While proprietary models such…

Computation and Language · Computer Science 2023-10-05 Chenxin An , Shansan Gong , Ming Zhong , Xingjian Zhao , Mukai Li , Jun Zhang , Lingpeng Kong , Xipeng Qiu
‹ Prev 1 4 5 6 7 8 10 Next ›