English
Related papers

Related papers: Discourse-Aware In-Context Learning for Temporal E…

200 papers

The emergence of Large Language Models (LLMs) has achieved tremendous success in the field of Natural Language Processing owing to diverse training paradigms that empower LLMs to effectively capture intricate linguistic patterns and…

Information Retrieval · Computer Science 2024-07-04 Lemei Zhang , Peng Liu , Yashar Deldjoo , Yong Zheng , Jon Atle Gulla

Machine learning practitioners often face significant challenges in formally integrating their prior knowledge and beliefs into predictive models, limiting the potential for nuanced and context-aware analyses. Moreover, the expertise needed…

Machine Learning · Statistics 2024-12-23 James Requeima , John Bronskill , Dami Choi , Richard E. Turner , David Duvenaud

Text normalization - the conversion of text from written to spoken form - is traditionally assumed to be an ill-formed task for language models. In this work, we argue otherwise. We empirically show the capacity of Large-Language Models…

Computation and Language · Computer Science 2024-01-18 Yang Zhang , Travis M. Bartley , Mariana Graterol-Fuenmayor , Vitaly Lavrukhin , Evelina Bakhturina , Boris Ginsburg

In-context learning, the ability to adapt based on a few examples in the input prompt, is a ubiquitous feature of large language models (LLMs). However, as LLMs' in-context learning abilities continue to improve, understanding this…

Machine Learning · Computer Science 2024-10-03 Can Demircan , Tankred Saanum , Akshay K. Jagadish , Marcel Binz , Eric Schulz

Transformer-based Large Language Models (LLMs) have been applied in diverse areas such as knowledge bases, human interfaces, and dynamic agents, and marking a stride towards achieving Artificial General Intelligence (AGI). However, current…

Computation and Language · Computer Science 2024-02-27 Yunpeng Huang , Jingwei Xu , Junyu Lai , Zixu Jiang , Taolue Chen , Zenan Li , Yuan Yao , Xiaoxing Ma , Lijuan Yang , Hao Chen , Shupeng Li , Penghao Zhao

Most existing large language models (LLMs) are expensive to adapt after deployment, especially when a task requires newly produced information or niche domain knowledge. Recent work has shown that, by manipulating and optimizing their…

Computation and Language · Computer Science 2026-05-15 Zeyu Huang , Adhiguna Kuncoro , Qixuan Feng , Jiajun Shen , Lucio Dery , Arthur Szlam , Marc'Aurelio Ranzato

This study addresses the challenges of analyzing temporal discrepancies in large language models (LLMs) trained on data from different time periods. To facilitate the automatic exploration of these differences, we propose a novel system…

Information Retrieval · Computer Science 2024-10-08 Reinhard Friedrich Fritsch , Adam Jatowt

Dense video captioning aims to interpret and describe all temporally localized events throughout an input video. Recent state-of-the-art methods leverage large language models (LLMs) to provide detailed moment descriptions for video data.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Wei-Yuan Cheng , Kai-Po Chang , Chi-Pin Huang , Fu-En Yang , Yu-Chiang Frank Wang

Large-scale models trained on broad data have recently become the mainstream architecture in computer vision due to their strong generalization performance. In this paper, the main focus is on an emergent ability in large vision models,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Yuanhan Zhang , Kaiyang Zhou , Ziwei Liu

Large language models (LLMs) have achieved substantial progress in processing long contexts but still struggle with long-context reasoning. Existing approaches typically involve fine-tuning LLMs with synthetic data, which depends on…

Computation and Language · Computer Science 2024-11-14 Siheng Li , Cheng Yang , Zesen Cheng , Lemao Liu , Mo Yu , Yujiu Yang , Wai Lam

This study introduces an ensemble framework for unstructured text categorization using large language models (LLMs). By integrating multiple models, the ensemble large language model (eLLM) framework addresses common weaknesses of…

Artificial Intelligence · Computer Science 2025-11-21 Ariel Kamen , Yakov Kamen

We describe a system for building task-oriented dialogue systems combining the in-context learning abilities of large language models (LLMs) with the deterministic execution of business logic. LLMs are used to translate between the surface…

Computation and Language · Computer Science 2024-02-20 Tom Bocklisch , Thomas Werkmeister , Daksh Varshneya , Alan Nichol

Large Language Models (LLMs) are important tools for reasoning and problem-solving, while they often operate passively, answering questions without actively discovering new ones. This limitation reduces their ability to simulate human-like…

Computational Engineering, Finance, and Science · Computer Science 2025-09-26 Hong Su

Text classification is crucial for applications such as sentiment analysis and toxic text filtering, but it still faces challenges due to the complexity and ambiguity of natural language. Recent advancements in deep learning, particularly…

Computation and Language · Computer Science 2024-08-29 Lingyu Gao

In recent years, large-scale language models (LLMs) have gained attention for their impressive text generation capabilities. However, these models often face the challenge of "hallucination," which undermines their reliability. In this…

Computation and Language · Computer Science 2023-10-10 Yuchen Yang , Houqiang Li , Yanfeng Wang , Yu Wang

Large language models (LLMs) have had a huge impact on society due to their impressive capabilities and vast knowledge of the world. Various applications and tools have been created that allow users to interact with these models in a…

Artificial Intelligence · Computer Science 2023-09-25 Eric Nuertey Coleman , Julio Hurtado , Vincenzo Lomonaco

Large language models (LLMs) have achieved remarkable success across natural language processing tasks, yet their widespread deployment raises pressing concerns around privacy, copyright, security, and bias. Machine unlearning has emerged…

Computation and Language · Computer Science 2026-01-21 Tyler Lizzo , Larry Heck

Transformer-based large language models (LLMs) typically have a limited context window, resulting in significant performance degradation when processing text beyond the length of the context window. Extensive studies have been proposed to…

Computation and Language · Computer Science 2024-11-19 Zican Dong , Junyi Li , Xin Men , Wayne Xin Zhao , Bingbing Wang , Zhen Tian , Weipeng Chen , Ji-Rong Wen

Despite the promising results of current cross-lingual models for spoken language understanding systems, they still suffer from imperfect cross-lingual representation alignments between the source and target languages, which makes the…

Computation and Language · Computer Science 2020-10-01 Zihan Liu , Genta Indra Winata , Peng Xu , Zhaojiang Lin , Pascale Fung

Large Transformer models are capable of implementing a plethora of so-called in-context learning algorithms. These include gradient descent, classification, sequence completion, transformation, and improvement. In this work, we investigate…

Artificial Intelligence · Computer Science 2024-02-29 Robert Tjarko Lange , Yingtao Tian , Yujin Tang