English
Related papers

Related papers: Architectural Fusion Through Contextual Partitioni…

200 papers

Current parameter-efficient fine-tuning (PEFT) methods build adapters widely agnostic of the context of downstream task to learn, or the context of important knowledge to maintain. As a result, there is often a performance gap compared to…

Machine Learning · Computer Science 2025-03-11 Yibo Yang , Xiaojie Li , Zhongzhu Zhou , Shuaiwen Leon Song , Jianlong Wu , Liqiang Nie , Bernard Ghanem

Inspired by the inductive transfer learning on computer vision, many efforts have been made to train contextualized language models that boost the performance of natural language processing tasks. These models are mostly trained on large…

Computation and Language · Computer Science 2021-02-12 Shohreh Shaghaghian , Luna , Feng , Borna Jafarpour , Nicolai Pogrebnyakov

Understanding human instructions to identify the target objects is vital for perception systems. In recent years, the advancements of Large Language Models (LLMs) have introduced new possibilities for image segmentation. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Junchi Wang , Lei Ke

Large Language Models (LLMs) are highly sensitive to their input contexts, motivating the development of automated context engineering. However, existing methods predominantly treat this as a global search problem, seeking a single context…

Computation and Language · Computer Science 2026-05-18 Jiachen Zhu , Zhuoying Ou , Congmin Zheng , Yuxiang Chen , Zeyu Zheng , Rong Shan , Lingyu Yang , Lionel Z. Wang , Weiwen Liu , Yong Yu , Weinan Zhang , Jianghao Lin

Purpose - This paper presents a methodology for defining and modeling context-awareness and describing efficiently the interactions between systems, applications and their context. Also the relation of modern context-aware systems with…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-12 Panteleimon Rodis

Fine-tuning is a promising technique for leveraging Transformer-based language models in downstream tasks. As model sizes continue to grow, updating all model parameters becomes increasingly costly. Parameter-efficient fine-tuning methods…

Computation and Language · Computer Science 2025-06-27 Xiaoshuang Ji , Zhendong Zhao , Xiaojun Chen , Xin Zhao , Zeyao Liu

State-of-the-art semantic image segmentation methods are mostly based on training deep convolutional neural networks (CNNs). In this work, we proffer to improve semantic segmentation with the use of contextual information. In particular, we…

Computer Vision and Pattern Recognition · Computer Science 2017-05-03 Guosheng Lin , Chunhua Shen , Anton van den Hengel , Ian Reid

In recent years, Large Language Models (LLMs) have demonstrated significant improvements across a variety of tasks, one of which is the long-context capability. The key to improving long-context performance lies in effective data…

Computation and Language · Computer Science 2024-10-03 Keer Lu , Xiaonan Nie , Zheng Liang , Da Pan , Shusen Zhang , Keshi Zhao , Weipeng Chen , Zenan Zhou , Guosheng Dong , Bin Cui , Wentao Zhang

Comprehensive semantic segmentation is one of the key components for robust scene understanding and a requirement to enable autonomous driving. Driven by large scale datasets, convolutional neural networks show impressive results on this…

Computer Vision and Pattern Recognition · Computer Science 2019-08-30 Jan-Nico Zaech , Dengxin Dai , Martin Hahner , Luc Van Gool

We propose a new and, arguably, a very simple reduction of instance segmentation to semantic segmentation. This reduction allows to train feed-forward non-recurrent deep instance segmentation systems in an end-to-end fashion using…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Victor Kulikov , Victor Yurchenko , Victor Lempitsky

Handling long-range dependencies in neural architectures has remained a persistent challenge due to computational limitations and inefficient contextual retention mechanisms. Tensorial operations have provided a foundation for restructuring…

Computation and Language · Computer Science 2025-08-11 Larin Tonix , Morgana Baskerville , Nathaniel Stourton , Ophelia Tattershall

Accurate semantic segmentation models typically require significant computational resources, inhibiting their use in practical applications. Recent works rely on well-crafted lightweight models to achieve fast inference. However, these…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Danna Xue , Fei Yang , Pei Wang , Luis Herranz , Jinqiu Sun , Yu Zhu , Yanning Zhang

This paper studies chance-constrained stochastic optimization problems with finite support. It presents an iterative method that solves reduced-size chance-constrained models obtained by partitioning the scenario set. Each reduced problem…

Optimization and Control · Mathematics 2024-11-26 Marius Roland , Alexandre Forel , Thibaut Vidal

This study tackles the challenge of image matching in difficult scenarios, such as scenes with significant variations or limited texture, with a strong emphasis on computational efficiency. Previous studies have attempted to address this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Khang Truong Giang , Soohwan Song , Sungho Jo

Predictive maintenance in complex systems is often complicated by the heterogeneity and redundancy of monitored variables,which can obscure fault-relevant information and reduce model interpretability. This work proposes a semantic feature…

Artificial Intelligence · Computer Science 2026-05-15 Emilio Mastriani , Alessandro Costa , Federico Incardona , Kevin Munari , Sebastiano Spinello

Ultra-high resolution image segmentation has raised increasing interests in recent years due to its realistic applications. In this paper, we innovate the widely used high-resolution image segmentation pipeline, in which an ultra-high…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Wenxi Liu , Qi Li , Xindai Lin , Weixiang Yang , Shengfeng He , Yuanlong Yu

In the growing domain of scientific machine learning, in-context operator learning has shown notable potential in building foundation models, as in this framework the model is trained to learn operators and solve differential equations…

Machine Learning · Computer Science 2024-02-02 Liu Yang , Siting Liu , Stanley J. Osher

Parameter-efficient fine-tuning (PEFT) is an effective methodology to unleash the potential of large foundation models in novel scenarios with limited training data. In the computer vision community, PEFT has shown effectiveness in image…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Zelin Peng , Zhengqin Xu , Zhilin Zeng , Lingxi Xie , Qi Tian , Wei Shen

While deep neural networks have achieved remarkable performance, data augmentation has emerged as a crucial strategy to mitigate overfitting and enhance network performance. These techniques hold particular significance in industrial…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Hyungmin Kim , Donghun Kim , Pyunghwan Ahn , Sungho Suh , Hansang Cho , Junmo Kim

Existing semantic segmentation approaches either aim to improve the object's inner consistency by modeling the global context, or refine objects detail along their boundaries by multi-scale feature fusion. In this paper, a new paradigm for…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Xiangtai Li , Xia Li , Li Zhang , Guangliang Cheng , Jianping Shi , Zhouchen Lin , Shaohua Tan , Yunhai Tong