English
Related papers

Related papers: Expand and Compress: Exploring Tuning Principles f…

200 papers

It has been demonstrated that the art of prompt tuning is highly effective in efficiently extracting knowledge from pretrained foundation models, encompassing pretrained language models (PLMs), vision pretrained models, and vision-language…

Computation and Language · Computer Science 2023-05-30 Xianjun Yang , Wei Cheng , Xujiang Zhao , Wenchao Yu , Linda Petzold , Haifeng Chen

This work addresses the challenge of using a deep learning model to prune graphs and the ability of this method to integrate explainability into spatio-temporal problems through a new approach. Instead of applying explainability to the…

Machine Learning · Computer Science 2025-10-14 Javier García-Sigüenza , Mirco Nanni , Faraón Llorens-Largo , José F. Vicent

Recent progress in deep learning has been driven by increasingly larger models. However, their computational and energy demands have grown proportionally, creating significant barriers to their deployment and to a wider adoption of deep…

Machine Learning · Computer Science 2025-09-16 Pedro Savarese

Machine learning traditionally assumes that the training and testing data are distributed independently and identically. However, in many real-world settings, the data distribution can shift over time, leading to poor generalization of…

Machine Learning · Computer Science 2024-02-19 Sepidehsadat Hosseini , Mengyao Zhai , Hossein Hajimirsadegh , Frederick Tung

Spatial-temporal graphs are widely used in a variety of real-world applications. Spatial-Temporal Graph Neural Networks (STGNNs) have emerged as a powerful tool to extract meaningful insights from this data. However, in real-world…

Machine Learning · Computer Science 2024-12-18 Zhenyu Lei , Yushun Dong , Jundong Li , Chen Chen

Recommender systems are frequently challenged by the data sparsity problem. One approach to mitigate this issue is through cross-domain recommendation techniques. In a cross-domain context, sharing knowledge between domains can enhance the…

Information Retrieval · Computer Science 2023-11-06 Zixuan Yi , Iadh Ounis , Craig Macdonald

Prompt-tuning has emerged as a promising method for adapting pre-trained models to downstream tasks or aligning with human preferences. Prompt learning is widely used in NLP but has limited applicability to RL due to the complex physical…

Machine Learning · Computer Science 2023-05-17 Shengchao Hu , Li Shen , Ya Zhang , Dacheng Tao

The deployment of modern network applications is increasing the network size and traffic volumes at an unprecedented pace. Storing network-related information (e.g., traffic traces) is key to enable efficient network management. However,…

Networking and Internet Architecture · Computer Science 2023-01-24 Paul Almasan , Krzysztof Rusek , Shihan Xiao , Xiang Shi , Xiangle Cheng , Albert Cabellos-Aparicio , Pere Barlet-Ros

Spatio-temporal problems exist in many areas of knowledge and disciplines ranging from biology to engineering and physics. However, solution strategies based on classical statistical techniques often fall short due to the large number of…

Applications · Statistics 2017-06-15 Emil B. Iversen , Rune Juhl , Jan K. Møller , Jan Kleissl , Henrik Madsen , Juan M. Morales

Spatio-temporal forecasting is crucial in many domains, such as transportation, meteorology, and energy. However, real-world scenarios frequently present challenges such as signal anomalies, noise, and distributional shifts. Existing…

Machine Learning · Computer Science 2025-10-30 Wei Chen , Yuxuan Liang

With the advancement of GPS and remote sensing technologies, large amounts of geospatial and spatiotemporal data are being collected from various domains, driving the need for effective and efficient prediction methods. Given spatial data…

Machine Learning · Computer Science 2020-12-25 Zhe Jiang

Temporal Interaction Graphs (TIGs) are widely utilized to represent real-world systems. To facilitate representation learning on TIGs, researchers have proposed a series of TIG models. However, these models are still facing two tough gaps…

Artificial Intelligence · Computer Science 2024-03-07 Xi Chen , Siwei Zhang , Yun Xiong , Xixi Wu , Jiawei Zhang , Xiangguo Sun , Yao Zhang , Feng Zhao , Yulin Kang

Spatial time series forecasting problems arise in a broad range of applications, such as environmental and transportation problems. These problems are challenging because of the existence of specific spatial, short-term and long-term…

Machine Learning · Computer Science 2019-02-05 Reza Asadi , Amelia Regan

Graphs have emerged as a natural choice to represent and analyze the intricate patterns and rich information of the Web, enabling applications such as online page classification and social recommendation. The prevailing "pre-train,…

Machine Learning · Computer Science 2025-02-06 Yihong Ma , Ning Yan , Jiayu Li , Masood Mortazavi , Nitesh V. Chawla

Test-time prompt tuning enhances zero-shot generalization of vision-language models but tends to ignore the relatedness among test samples during inference. Online test-time prompt tuning provides a simple way to leverage the information in…

Machine Learning · Computer Science 2025-01-29 Zehao Xiao , Shilin Yan , Jack Hong , Jiayin Cai , Xiaolong Jiang , Yao Hu , Jiayi Shen , Qi Wang , Cees G. M. Snoek

Graph deep learning methods have become popular tools to process collections of correlated time series. Unlike traditional multivariate forecasting methods, graph-based predictors leverage pairwise relationships by conditioning forecasts on…

Machine Learning · Computer Science 2025-06-09 Andrea Cini , Ivan Marisca , Daniele Zambon , Cesare Alippi

Mining massive spatio-temporal data can help a variety of real-world applications such as city capacity planning, event management, and social network analysis. The tensor representation can be used to capture the correlation between space…

Machine Learning · Computer Science 2020-06-23 Jing Ma , Qiuchen Zhang , Joyce C. Ho , Li Xiong

Ensemble forecasts from numerical weather prediction models show systematic errors that require correction via post-processing. While there has been substantial progress in flexible neural network-based post-processing methods over the past…

Machine Learning · Computer Science 2024-07-17 Moritz Feik , Sebastian Lerch , Jan Stühmer

This study investigates how conditional normalizing flows can be applied to remote sensing data products in climate science for spatio-temporal prediction. The method is chosen due to its desired properties such as exact likelihood…

Machine Learning · Computer Science 2024-06-03 Christina Winkler , David Rolnick

Prompt tuning, a recently emerging paradigm, enables the powerful vision-language pre-training models to adapt to downstream tasks in a parameter -- and data -- efficient way, by learning the ``soft prompts'' to condition frozen…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Juncheng Li , Minghe Gao , Longhui Wei , Siliang Tang , Wenqiao Zhang , Mengze Li , Wei Ji , Qi Tian , Tat-Seng Chua , Yueting Zhuang