English
Related papers

Related papers: Scalable Prompt Routing via Fine-Grained Latent Ta…

200 papers

Prompt Learning has recently gained great popularity in bridging the gap between pretraining tasks and various downstream tasks. It freezes Pretrained Language Models (PLMs) and only tunes a few task-related parameters (prompts) for…

Computation and Language · Computer Science 2022-06-07 Yuezihan Jiang , Hao Yang , Junyang Lin , Hanyu Zhao , An Yang , Chang Zhou , Hongxia Yang , Zhi Yang , Bin Cui

Prompt engineering is a challenging yet crucial task for optimizing the performance of large language models on customized tasks. It requires complex reasoning to examine the model's errors, hypothesize what is missing or misleading in the…

Computation and Language · Computer Science 2024-07-04 Qinyuan Ye , Maxamed Axmed , Reid Pryzant , Fereshte Khani

Learning effective region embeddings from heterogeneous urban data underpins key urban computing tasks (e.g., crime prediction, resource allocation). However, prevailing two-stage methods yield task-agnostic representations, decoupling them…

Artificial Intelligence · Computer Science 2026-02-03 Zitao Guo , Changyang Jiang , Tianhong Zhao , Jinzhou Cao , Genan Dai , Bowen Zhang

Multi-step reasoning tasks like mathematical problem solving are vulnerable to cascading failures, where a single incorrect step leads to complete solution breakdown. Current LLM routing methods assign entire queries to one model, treating…

Artificial Intelligence · Computer Science 2026-04-16 Vansh Kapoor , Aman Gupta , Hao Chen , Anurag Beniwal , Jing Huang , Aviral Kumar

Prompt tuning, which only tunes continuous prompts with a frozen language model, substantially reduces per-task storage and memory usage at training. However, in the context of NLU, prior work reveals that prompt tuning does not perform…

Computation and Language · Computer Science 2022-03-22 Xiao Liu , Kaixuan Ji , Yicheng Fu , Weng Lam Tam , Zhengxiao Du , Zhilin Yang , Jie Tang

Large-scale neural networks have demonstrated remarkable performance in different domains like vision and language processing, although at the cost of massive computation resources. As illustrated by compression literature, structural model…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Tianjin Huang , Fang Meng , Li Shen , Fan Liu , Yulong Pei , Mykola Pechenizkiy , Shiwei Liu , Tianlong Chen

Information-seeking is a core capability for AI agents, requiring them to gather and reason over tool-generated information across long trajectories. However, such multi-step information-seeking tasks remain challenging for agents backed by…

Artificial Intelligence · Computer Science 2025-11-25 Jaewoo Lee , Archiki Prasad , Justin Chih-Yao Chen , Zaid Khan , Elias Stengel-Eskin , Mohit Bansal

Single large language models (LLMs) often fall short when faced with the ever-growing range of tasks, making a single-model approach insufficient. We address this challenge by proposing ORI (O Routing Intelligence), a dynamic framework that…

Computation and Language · Computer Science 2025-02-18 Ahmad Shadid , Rahul Kumar , Mohit Mayank

We introduce Meta-Reasoning Prompting (MRP), a novel and efficient system prompting method for large language models (LLMs) inspired by human meta-reasoning. Traditional in-context learning-based reasoning techniques, such as…

Computation and Language · Computer Science 2024-06-18 Peizhong Gao , Ao Xie , Shaoguang Mao , Wenshan Wu , Yan Xia , Haipeng Mi , Furu Wei

This technical report presents our solution for the RoboSense Challenge at IROS 2025, which evaluates Vision-Language Models (VLMs) on autonomous driving scene understanding across perception, prediction, planning, and corruption detection…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Aodi Wu , Xubo Luo

In language tasks that require extensive human--model interaction, deploying a single "best" model for every query can be expensive. To reduce inference cost while preserving the quality of the responses, a large language model (LLM) router…

Machine Learning · Computer Science 2025-12-24 Yichi Zhang , Fangzheng Xie , Shu Yang , Chong Wu

Graph-based Multi-Agent Systems (MAS) enable complex cyclic workflows but suffer from inefficient static model allocation, where deploying strong models uniformly wastes computation on trivial sub-tasks. We propose CASTER (Context-Aware…

Artificial Intelligence · Computer Science 2026-01-28 Shanyv Liu , Xuyang Yuan , Tao Chen , Zijun Zhan , Zhu Han , Danyang Zheng , Weishan Zhang , Shaohua Cao

Modern wireless networks must adapt to dynamic conditions while efficiently managing diverse service demands. Traditional deep reinforcement learning (DRL) struggles in these environments, as scattered and evolving feedback makes optimal…

Machine Learning · Computer Science 2025-06-03 Fatemeh Lotfi , Hossein Rajoli , Fatemeh Afghah

With the advancement in generative language models, the selection of prompts has gained significant attention in recent years. A prompt is an instruction or description provided by the user, serving as a guide for the generative language…

Machine Learning · Statistics 2024-05-21 Haoting Zhang , Jinghai He , Rhonda Righter , Zeyu Zheng

The main requisite for fine-grained recognition task is to focus on subtle discriminative details that make the subordinate classes different from each other. We note that existing methods implicitly address this requirement and leave it to…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Guolei Sun , Hisham Cholakkal , Salman Khan , Fahad Shahbaz Khan , Ling Shao

Efficient retrieval of information is of key importance when using Big Data systems. In large scale-out data architectures, data are distributed and replicated across several machines. Queries/tasks to such data architectures, are sent to a…

The deployment of deep neural networks in real-world applications is mostly restricted by their high inference costs. Extensive efforts have been made to improve the accuracy with expert-designed or algorithm-searched architectures.…

Machine Learning · Computer Science 2020-11-10 Shaofeng Cai , Yao Shu , Wei Wang , Beng Chin Ooi

Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse domains, but developing high-performing models for specialized applications often requires substantial human annotation -- a process that is…

Computation and Language · Computer Science 2025-07-30 Abhinav Arabelly , Jagrut Nemade , Robert D Nowak , Jifan Zhang

Prompt engineering, as an efficient and effective way to leverage Large Language Models (LLM), has drawn a lot of attention from the research community. The existing research primarily emphasizes the importance of adapting prompts to…

Computation and Language · Computer Science 2024-07-08 Yuyan Chen , Zhihao Wen , Ge Fan , Zhengyu Chen , Wei Wu , Dayiheng Liu , Zhixu Li , Bang Liu , Yanghua Xiao

Emerging reconfigurable optical communication technologies allow to enhance datacenter topologies with demand-aware links optimized towards traffic patterns. This paper studies the algorithmic problem of jointly optimizing topology and…

Performance · Computer Science 2024-01-10 Wenkai Dai , Michael Dinitz , Klaus-Tycho Foerster , Long Luo , Stefan Schmid