English
Related papers

Related papers: Inductive Gradient Adjustment For Spectral Bias In…

200 papers

The perturbation test remains the go-to evaluation approach for explanation methods in computer vision. This evaluation method has a major drawback of test-time distribution shift due to pixel-masking that is not present in the training…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Lokesh Badisa , Sumohana S. Channappayya

Recent pre-trained vision-language models (PT-VLMs) often face a Multi-Domain Task Incremental Learning (MTIL) scenario in practice, where several classes and domains of multi-modal tasks are incrementally arrived. Without access to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Hao Fu , Hanbin Zhao , Jiahua Dong , Henghui Ding , Chao Zhang , Hui Qian

Implicit Neural Representations (INRs) have recently gained attention as a powerful approach for continuously representing signals such as images, videos, and 3D shapes using multilayer perceptrons (MLPs). However, MLPs are known to exhibit…

Machine Learning · Computer Science 2024-10-10 Adam Kania , Marko Mihajlovic , Sergey Prokudin , Jacek Tabor , Przemysław Spurek

Preference alignment has emerged as an effective strategy to enhance the performance of Multimodal Large Language Models (MLLMs) following supervised fine-tuning. While existing preference alignment methods predominantly target…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Zitian Wang , Yue Liao , Kang Rong , Fengyun Rao , Yibo Yang , Si Liu

The integration of contextual embeddings into the optimization processes of large language models is an advancement in natural language processing. The Context-Aware Neural Gradient Mapping framework introduces a dynamic gradient adjustment…

Computation and Language · Computer Science 2025-04-25 David Boldo , Lily Pemberton , Gabriel Thistledown , Jacob Fairchild , Felix Kowalski

The empirical success of derivative-free methods in reinforcement learning for planning through contact seems at odds with the perceived fragility of classical gradient-based optimization methods in these domains. What is causing this gap,…

Robotics · Computer Science 2022-01-25 H. J. Terry Suh , Tao Pang , Russ Tedrake

Motivated by applications arising from sensor networks and machine learning, we consider the problem of minimizing a finite sum of nondifferentiable convex functions where each component function is associated with an agent and a…

Optimization and Control · Mathematics 2021-03-22 Harshal D. Kaushik , Farzad Yousefian

This paper studies an acceleration technique for incremental aggregated gradient ({\sf IAG}) method through the use of \emph{curvature} information for solving strongly convex finite sum optimization problems. These optimization problems of…

Optimization and Control · Mathematics 2020-03-02 Hoi-To Wai , Wei Shi , Cesar A. Uribe , Angelia Nedich , Anna Scaglione

Sinusoidal neural networks have been shown effective as implicit neural representations (INRs) of low-dimensional signals, due to their smoothness and high representation capacity. However, initializing and training them remain empirical…

Machine Learning · Computer Science 2025-04-07 Tiago Novello , Diana Aldana , Andre Araujo , Luiz Velho

Brain-Computer Interfaces (BCIs) rely on accurately decoding electroencephalography (EEG) motor imagery (MI) signals for effective device control. Graph Neural Networks (GNNs) outperform Convolutional Neural Networks (CNNs) in this regard,…

Signal Processing · Electrical Eng. & Systems 2024-05-03 Htoo Wai Aung , Jiao Jiao Li , Yang An , Steven W. Su

Neural operators serve as fast, data-driven surrogates for scientific modeling but typically rely on a monolithic, single-pass inference procedure that struggles to resolve high-frequency details, a limitation known as spectral bias. We…

Machine Learning · Computer Science 2026-05-27 Xiaotian Liu , Shuyuan Shang , Xiaopeng Wang , Pu Ren , Yaoqing Yang

In this paper, we study Interaction-Grounded Learning (IGL) [Xie et al., 2021], a paradigm designed for realistic scenarios where the learner receives indirect feedback generated by an unknown mechanism, rather than explicit numerical…

Machine Learning · Computer Science 2026-02-10 Mengxiao Zhang , Yuheng Zhang , Haipeng Luo , Paul Mineiro

Existing graph contrastive learning methods rely on augmentation techniques based on random perturbations (e.g., randomly adding or dropping edges and nodes). Nevertheless, altering certain edges or nodes can unexpectedly change the graph…

Machine Learning · Computer Science 2022-11-08 Huidong Liang , Xingjian Du , Bilei Zhu , Zejun Ma , Ke Chen , Junbin Gao

The mainstream CNN-based remote sensing (RS) image semantic segmentation approaches typically rely on massive labeled training data. Such a paradigm struggles with the problem of RS multi-view scene segmentation with limited labeled views…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Zipeng Qi , Hao Chen , Chenyang Liu , Zhenwei Shi , Zhengxia Zou

Like humans, deep networks have been shown to learn better when samples are organized and introduced in a meaningful order or curriculum. Conventional curriculum learning schemes introduce samples in their order of difficulty. This forces…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Madan Ravi Ganesh , Jason J. Corso

Supervised Deep-Learning (DL)-based reconstruction algorithms have shown state-of-the-art results for highly-undersampled dynamic Magnetic Resonance Imaging (MRI) reconstruction. However, the requirement of excessive high-quality…

Image and Video Processing · Electrical Eng. & Systems 2025-11-11 Jie Feng , Ruimin Feng , Qing Wu , Zhiyong Zhang , Yuyao Zhang , Hongjiang Wei

Neural integral equations are deep learning models based on the theory of integral equations, where the model consists of an integral operator and the corresponding equation (of the second kind) which is learned through an optimization…

Numerical Analysis · Mathematics 2025-11-14 Emanuele Zappala

Whether Large Language Models (LLMs) develop coherent internal world models remains a core debate. While conventional Next-Token Prediction (NTP) focuses on one-step-ahead supervision, Multi-Token Prediction (MTP) has shown promise in…

Machine Learning · Computer Science 2026-04-21 Qimin Zhong , Hao Liao , Haiming Qin , Mingyang Zhou , Rui Mao , Wei Chen , Naipeng Chao

Implicit neural representation (INR) can describe the target scenes with high fidelity using a small number of parameters, and is emerging as a promising data compression technique. However, limited spectrum coverage is intrinsic to INR,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Runzhao Yang , Tingxiong Xiao , Yuxiao Cheng , Jinli Suo , Qionghai Dai

Implicit Neural Representations (INRs) encode discrete signals in a continuous manner using neural networks, demonstrating significant value across various multimedia applications. However, the vulnerability of INRs presents a critical…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Wenyong Zhou , Yuxin Cheng , Zhengwu Liu , Taiqiang Wu , Chen Zhang , Ngai Wong