English
Related papers

Related papers: IMLI: An Incremental Framework for MaxSAT-Based Le…

200 papers

In-context learning (ICL) allows large models to adapt to tasks using a few examples, yet its extension to vision-language models (VLMs) remains fragile. Our analysis reveals that the fundamental limitation lies in an inductive gap, models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Haoyu Wang , Haonan Wang , Yuyan Chen , Jun Chen , Gang Liu , Qian Wang , Jiahong Yan , Yanghua Xiao

We consider the problem of synthesizing interpretable models that recognize the behaviour of an agent compared to other agents, on a whole set of similar planning tasks expressed in PDDL. Our approach consists in learning logical formulas,…

Artificial Intelligence · Computer Science 2024-10-15 Arnaud Lequen

In-context learning (ICL) adapts LLMs by providing demonstrations without fine-tuning the model parameters; however, it does not differentiate between demonstrations and quadratically increases the complexity of Transformer LLMs, exhausting…

Computation and Language · Computer Science 2024-11-06 Giwon Hong , Emile van Krieken , Edoardo Ponti , Nikolay Malkin , Pasquale Minervini

In-context learning (ICL) has emerged as a powerful capability of large language models (LLMs), enabling them to perform new tasks based on a few provided examples without explicit fine-tuning. Despite their impressive adaptability, these…

Software Engineering · Computer Science 2025-09-09 Teeradaj Racharak , Chaiyong Ragkhitwetsagul , Chommakorn Sontesadisai , Thanwadee Sunetnanta

Recent advances demonstrate that multimodal large language models (MLLMs) exhibit strong multimodal in-context learning (ICL) capabilities, enabling them to adapt to novel vision-language tasks from a few contextual examples. However,…

Artificial Intelligence · Computer Science 2025-10-07 Honghao Fu , Yuan Ouyang , Kai-Wei Chang , Yiwei Wang , Zi Huang , Yujun Cai

Vision-language models such as CLIP achieve strong visual-textual alignment, but often suffer from overfitting and limited interpretability when adapted through continuous prompt learning. While discrete prompt optimization improves…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Yating Wang , Yaqi Zhao , Yongshun Gong , Yilong Yin , Haoliang Sun

In recent years, In-context Learning (ICL) has gained increasing attention and emerged as the new paradigm for large language model (LLM) evaluation. Unlike traditional fine-tuning methods, ICL instead adapts the pre-trained models to…

Computation and Language · Computer Science 2023-03-07 Zhenyu Wu , YaoXiang Wang , Jiacheng Ye , Jiangtao Feng , Jingjing Xu , Yu Qiao , Zhiyong Wu

In-Context Learning (ICL) is an emergent capability of Large Language Models (LLMs). Only a few demonstrations enable LLMs to be used as blackbox for new tasks. Previous studies have shown that using LLMs' outputs as labels is effective in…

Computation and Language · Computer Science 2024-04-04 Kazuma Hashimoto , Karthik Raman , Michael Bendersky

Although Large language Model (LLM)-powered information extraction (IE) systems have shown impressive capabilities, current fine-tuning paradigms face two major limitations: high training costs and difficulties in aligning with LLM…

Computation and Language · Computer Science 2025-12-16 Yushen Fang , Jianjun Li , Mingqian Ding , Chang Liu , Xinchi Zou , Wenqi Yang

Training speech separation models in the supervised setting raises a permutation problem: finding the best assignation between the model predictions and the ground truth separated signals. This inherently ambiguous task is customarily…

Sound · Computer Science 2024-11-28 David Perera , François Derrida , Théo Mariotte , Gaël Richard , Slim Essid

Enhancing the adaptive capabilities of large language models is a critical pursuit in both research and application. Traditional fine-tuning methods require substantial data and computational resources, especially for enhancing specific…

Computation and Language · Computer Science 2025-02-27 Futing Wang , Jianhao Yan , Yue Zhang , Tao Lin

Although In-Context Learning (ICL) brings remarkable performance gains to Large Language Models (LLMs), the improvements remain lower than fine-tuning on downstream tasks. This paper introduces Multi-Modal In-Context Tuning (MMICT), a novel…

Artificial Intelligence · Computer Science 2024-08-13 Tao Chen , Enwei Zhang , Yuting Gao , Ke Li , Xing Sun , Yan Zhang , Hui Li , Rongrong Ji

Large Language Models (LLMs) have shown remarkable capabilities in natural language processing but exhibit significant performance gaps among different languages. Most existing approaches to address these disparities rely on pretraining or…

Computation and Language · Computer Science 2024-10-17 Weixuan Wang , Minghao Wu , Barry Haddow , Alexandra Birch

Continual learning enables incremental learning of new tasks without forgetting those previously learned, resulting in positive knowledge transfer that can enhance performance on both new and old tasks. However, continual learning poses new…

Machine Learning · Computer Science 2023-08-01 Dawid Rymarczyk , Joost van de Weijer , Bartosz Zieliński , Bartłomiej Twardowski

We develop a system for solving logical deduction one-dimensional ordering problems by transforming natural language premises and candidate statements into first-order logic. Building on Heim and Kratzer's syntax-based compositional…

Computation and Language · Computer Science 2025-09-22 Maha Alkhairy , Vincent Homer , Brendan O'Connor

In-context learning (ICL) allows a language model to improve its problem-solving capability when provided with suitable information in context. Since the choice of in-context information can be determined based on the problem itself,…

Computation and Language · Computer Science 2025-09-12 Yinghui He , Abhishek Panigrahi , Yong Lin , Sanjeev Arora

Machine Learning models are increasingly used for decision making, in particular in high-stakes applications such as credit scoring, medicine or recidivism prediction. However, there are growing concerns about these models with respect to…

Machine Learning · Computer Science 2023-04-12 Julien Rouzot , Julien Ferry , Marie-José Huguet

We present an approach to improve the accuracy-interpretability trade-off of Machine Learning (ML) Decision Trees (DTs). In particular, we apply Maximum Satisfiability technology to compute Minimum Pure DTs (MPDTs). We improve the runtime…

Artificial Intelligence · Computer Science 2022-07-15 Josep Alos , Carlos Ansotegui , Eduard Torres

In-context learning (ICL) unfolds as large language models become capable of inferring test labels conditioned on a few labeled samples without any gradient update. ICL-enabled large language models provide a promising step forward toward…

Computation and Language · Computer Science 2023-06-27 Eshaan Tanwar , Subhabrata Dutta , Manish Borthakur , Tanmoy Chakraborty

Weighted Max-SAT is the optimization version of SAT and many important problems can be naturally encoded as such. Solving weighted Max-SAT is an important problem from both a theoretical and a practical point of view. In recent years, there…

Artificial Intelligence · Computer Science 2007-05-23 Javier Larrosa , Federico Heras , Simon de Givry