English
Related papers

Related papers: Unlocking Decoding-time Controllability: Gradient-…

200 papers

Annotating large-scale point clouds is highly time-consuming and often infeasible for many complex real-world tasks. Point cloud pre-training has therefore become a promising strategy for learning discriminative representations without…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Guofeng Mei , Xiaoshui Huang , Juan Liu , Jian Zhang , Qiang Wu

Momentum-Aided Prompt Optimization (MAPO) enhances the efficiency and efficacy of prompt optimization for Large Language Models (LLMs). Building on ProTeGi, MAPO uses positive natural language "gradients" and a momentum-based extension to…

Computation and Language · Computer Science 2025-06-30 Anthony Cui , Pranav Nandyalam , Andrew Rufail , Ethan Cheung , Aiden Lei , Kevin Zhu , Sean O'Brien

Performance of large language models (LLMs) may vary with different prompts or instructions of even the same task. One commonly recognized factor for this phenomenon is the model's familiarity with the given prompt or instruction, which is…

Computation and Language · Computer Science 2024-11-05 Qin Liu , Fei Wang , Nan Xu , Tianyi Yan , Tao Meng , Muhao Chen

Existing multilingual machine translation approaches mainly focus on English-centric directions, while the non-English directions still lag behind. In this work, we aim to build a many-to-many translation system with an emphasis on the…

Computation and Language · Computer Science 2021-07-23 Xiao Pan , Mingxuan Wang , Liwei Wu , Lei Li

Several automatic approaches for objective music performance assessment (MPA) have been proposed in the past, however, existing systems are not yet capable of reliably predicting ratings with the same accuracy as professional judges. This…

Sound · Computer Science 2021-08-16 Pavan Seshadri , Alexander Lerch

Through prompting, large-scale pre-trained models have become more expressive and powerful, gaining significant attention in recent years. Though these big models have zero-shot capabilities, in general, labeled data are still required to…

Machine Learning · Computer Science 2023-05-02 Korawat Tanwisuth , Shujian Zhang , Huangjie Zheng , Pengcheng He , Mingyuan Zhou

Word alignment, which aims to align translationally equivalent words between source and target sentences, plays an important role in many natural language processing tasks. Current unsupervised neural alignment methods focus on inducing…

Computation and Language · Computer Science 2021-05-18 Chi Chen , Maosong Sun , Yang Liu

Contrastive decoding strategies are widely used to reduce object hallucinations in multimodal large language models (MLLMs). These methods work by constructing contrastive samples to induce hallucinations and then suppressing them in the…

Computation and Language · Computer Science 2025-10-08 Hao Yin , Guangzong Si , Zilei Wang

Large Language Model (LLM) alignment conventionally relies on supervised fine-tuning or reinforcement learning based alignment frameworks. These methods typically require labeled or preference datasets and involve updating model weights to…

Computation and Language · Computer Science 2025-03-21 Reem I. Masoud , Martin Ferianc , Philip Treleaven , Miguel Rodrigues

Machine unlearning is a complex process that necessitates the model to diminish the influence of the training data while keeping the loss of accuracy to a minimum. Despite the numerous studies on machine unlearning in recent years, the…

Machine Learning · Computer Science 2024-05-14 Zixin Wang , Kongyang Chen

Gradient-free prompt optimization methods have made significant strides in enhancing the performance of closed-source Large Language Models (LLMs) across a wide range of tasks. However, existing approaches make light of the importance of…

Computation and Language · Computer Science 2024-10-03 Muchen Yang , Moxin Li , Yongle Li , Zijun Chen , Chongming Gao , Junqi Zhang , Yangyang Li , Fuli Feng

Continual Visual Question Answering (CVQA) based on pre-trained models(PTMs) has achieved promising progress by leveraging prompt tuning to enable continual multi-modal learning. However, most existing methods adopt cross-modal prompt…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Xu Li , Fan Lyu

Recent Pre-trained Language Models (PLMs) usually only provide users with the inference APIs, namely the emerging Model-as-a-Service (MaaS) setting. To adapt MaaS PLMs to downstream tasks without accessing their parameters and gradients,…

Computation and Language · Computer Science 2025-06-03 Zifeng Cheng , Zhaoling Chen , Zhiwei Jiang , Yafeng Yin , Cong Wang , Shiping Ge , Qing Gu

Multimodal intent recognition aims to leverage diverse modalities such as expressions, body movements and tone of speech to comprehend user's intent, constituting a critical task for understanding human language and behavior in real-world…

Multimedia · Computer Science 2024-06-07 Qianrui Zhou , Hua Xu , Hao Li , Hanlei Zhang , Xiaohan Zhang , Yifan Wang , Kai Gao

Multi-objective test-time alignment aims to adapt large language models (LLMs) to diverse multi-dimensional user preferences during inference while keeping LLMs frozen. Recently, GenARM (Xu et al., 2025) first independently trains…

Machine Learning · Computer Science 2025-05-13 Baijiong Lin , Weisen Jiang , Yuancheng Xu , Hao Chen , Ying-Cong Chen

Fine-tuning large-scale pretrained models has led to tremendous progress in well-studied modalities such as vision and NLP. However, similar gains have not been observed in many other modalities due to a lack of relevant pretrained models.…

Machine Learning · Computer Science 2023-03-21 Junhong Shen , Liam Li , Lucio M. Dery , Corey Staten , Mikhail Khodak , Graham Neubig , Ameet Talwalkar

We introduce a Model Predictive Control (MPC) framework for training deep neural networks, systematically unifying the Back-Propagation (BP) and Forward-Forward (FF) algorithms. At the same time, it gives rise to a range of intermediate…

Machine Learning · Computer Science 2024-10-01 Lianhai Ren , Qianxiao Li

The effectiveness of Multimodal Chain-of-Thought (MCoT) prompting is often limited by the use of randomly or manually selected examples. These examples fail to account for both model-specific knowledge distributions and the intrinsic…

Computation and Language · Computer Science 2025-10-14 Xinglong Yang , Quan Feng , Zhongying Pan , Xiang Chen , Yu Tian , Wentong Li , Shuofei Qiao , Yuxia Geng , Xingyu Zhao , Sheng-Jun Huang

Multimodal sarcasm detection, which aims to precisely identify pragmatic incongruities between literal text and nonverbal cues, has gained substantial attention in multimodal understanding. Recent advancements have predominantly relied on…

Computation and Language · Computer Science 2026-05-05 Maoheng Li , Ling Zhou , Xiaohua Huang , Rubing Huang , Wenming Zheng , Guoying Zhao

Multimodal aspect-based sentiment analysis(MABSA) seeks to identify aspect terms within paired image-text data and determine their fine grained sentiment polarities, representing a fundamental task for improving the effectiveness of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Xiaoqiang He