中文
相关论文

相关论文: TS-Haystack: A Multi-Task Retrieval Benchmark for …

200 篇论文

Automatic Speech Recognition (ASR) aims to convert human speech content into corresponding text. In conversational scenarios, effectively utilizing context can enhance its accuracy. Large Language Models' (LLMs) exceptional long-context…

声音 · 计算机科学 2026-01-19 Bingshen Mu , Hexin Liu , Hongfei Xue , Kun Wei , Lei Xie

LLMs and RAG systems are now capable of handling millions of input tokens or more. However, evaluating the output quality of such systems on long-context tasks remains challenging, as tasks like Needle-in-a-Haystack lack complexity. In this…

计算与语言 · 计算机科学 2024-07-02 Philippe Laban , Alexander R. Fabbri , Caiming Xiong , Chien-Sheng Wu

Test-time scaling (TTS) enhances the performance of large language models (LLMs) by allocating additional compute resources during inference. However, existing research primarily investigates TTS in single-stage tasks; while many real-world…

人工智能 · 计算机科学 2025-10-23 Fali Wang , Hui Liu , Zhenwei Dai , Jingying Zeng , Zhiwei Zhang , Zongyu Wu , Chen Luo , Zhen Li , Xianfeng Tang , Qi He , Suhang Wang

Computational models for sarcasm detection have often relied on the content of utterances in isolation. However, the speaker's sarcastic intent is not always apparent without additional context. Focusing on social media discussions, we…

计算与语言 · 计算机科学 2018-08-29 Debanjan Ghosh , Alexander R. Fabbri , Smaranda Muresan

Conversational assistants powered by large language models (LLMs) excel at tool-use tasks but struggle with adhering to complex, business-specific rules. While models can reason over business rules provided in context, including all…

计算与语言 · 计算机科学 2026-03-24 Shubhashis Roy Dipta , Daniel Bis , Kun Zhou , Lichao Wang , Benjamin Z. Yao , Chenlei Guo , Ruhi Sarikaya

Time series classification (TSC) spans diverse application scenarios, yet labeled data are often scarce, making task-specific training costly and inflexible. Recent reasoning-oriented large language models (LLMs) show promise in…

人工智能 · 计算机科学 2026-05-04 Songyuan Sui , Zihang Xu , Xia Hu

Test-time scaling (TTS) -- the dynamic allocation of compute during inference -- is a promising direction for improving reasoning in large language models (LLMs). However, a systematic comparison of well-known TTS strategies under identical…

计算与语言 · 计算机科学 2025-12-02 Aradhye Agarwal , Ayan Sengupta , Tanmoy Chakraborty

Who is the US President? The answer changes depending on when the question is asked. While large language models (LLMs) are evaluated on various reasoning tasks, they often miss a crucial dimension: time. In real-world scenarios, the…

计算与语言 · 计算机科学 2025-05-16 David Herel , Vojtech Bartek , Jiri Jirak , Tomas Mikolov

To break the context limits of large language models (LLMs) that bottleneck reasoning accuracy and efficiency, we propose the Thread Inference Model (TIM), a family of LLMs trained for recursive and decompositional problem solving, and…

The automatic generation of representative natural language descriptions for observable patterns in time series data enhances interpretability, simplifies analysis and increases cross-domain utility of temporal data. While pre-trained…

计算与语言 · 计算机科学 2025-01-06 Mohamed Trabelsi , Aidan Boyd , Jin Cao , Huseyin Uzunalioglu

The proliferation of online news poses a challenge to extracting structured timelines from unstructured content. While recent studies have shown that Large Language Models (LLMs) can assist Timeline Summarization (TLS), these approaches…

计算与语言 · 计算机科学 2026-05-14 Liancheng Zhang , Xiaoxi Li , Zhicheng Dou

Multimodal Large Language Models (MLLMs) have shown strong performance in video understanding tasks. However, they continue to struggle with long-form videos because of an inefficient perception of temporal intervals. Unlike humans, who can…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Chenglin Li , Qianglong Chen , fengtao , Yin Zhang

We introduce a dynamic benchmarking system for conversational agents that evaluates their performance through a single, simulated, and lengthy user$\leftrightarrow$agent interaction. The interaction is a conversation between the user and…

计算与语言 · 计算机科学 2024-10-14 David Castillo-Bolado , Joseph Davidson , Finlay Gray , Marek Rosa

As large language models (LLMs) show impressive performance on complex tasks, they still struggle with longer contextual understanding and high computational costs. To balance efficiency and quality, we introduce LLMSteer, a…

机器学习 · 计算机科学 2024-11-22 Zhuohan Gu , Jiayi Yao , Kuntai Du , Junchen Jiang

Retrieval-Augmented Generation (RAG) has become an essential approach for extending the reasoning and knowledge capacity of large language models (LLMs). While prior research has primarily focused on retrieval quality and prompting…

计算与语言 · 计算机科学 2025-12-09 Jiamin Chen , Yuchen Li , Xinyu Ma , Xinran Chen , Xiaokun Zhang , Shuaiqiang Wang , Chen Ma , Dawei Yin

Long short-term memory(LSTM) units on sequence-based models are being used in translation, question-answering systems, classification tasks due to their capability of learning long-term dependencies. In Natural language generation, LSTM…

计算与语言 · 计算机科学 2020-05-04 Sivasurya Santhanam

Long-context reasoning is essential for complex real-world applications, yet remains a significant challenge for Large Language Models (LLMs). Despite the rapid evolution in long-context reasoning, current research often overlooks the…

Reasoning about time is essential for Large Language Models (LLMs) to understand the world. Previous works focus on solving specific tasks, primarily on time-sensitive question answering. While these methods have proven effective, they…

计算与语言 · 计算机科学 2024-08-20 Zhaochen Su , Jun Zhang , Tong Zhu , Xiaoye Qu , Juntao Li , Min Zhang , Yu Cheng

Current large language models (LLMs) often perform poorly on simple fact retrieval tasks. Here we investigate if coupling a dynamically adaptable external memory to a LLM can alleviate this problem. For this purpose, we test Larimar, a…

计算与语言 · 计算机科学 2024-07-15 Elliot Nelson , Georgios Kollias , Payel Das , Subhajit Chaudhury , Soham Dan

Recent deep research agents primarily improve performance by scaling reasoning depth, but this leads to high inference cost and latency in search-intensive scenarios. Moreover, generalization across heterogeneous research settings remains…