中文
相关论文

相关论文: Inductive Gradient Adjustment For Spectral Bias In…

200 篇论文

The perturbation test remains the go-to evaluation approach for explanation methods in computer vision. This evaluation method has a major drawback of test-time distribution shift due to pixel-masking that is not present in the training…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Lokesh Badisa , Sumohana S. Channappayya

Recent pre-trained vision-language models (PT-VLMs) often face a Multi-Domain Task Incremental Learning (MTIL) scenario in practice, where several classes and domains of multi-modal tasks are incrementally arrived. Without access to…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Hao Fu , Hanbin Zhao , Jiahua Dong , Henghui Ding , Chao Zhang , Hui Qian

Implicit Neural Representations (INRs) have recently gained attention as a powerful approach for continuously representing signals such as images, videos, and 3D shapes using multilayer perceptrons (MLPs). However, MLPs are known to exhibit…

机器学习 · 计算机科学 2024-10-10 Adam Kania , Marko Mihajlovic , Sergey Prokudin , Jacek Tabor , Przemysław Spurek

Preference alignment has emerged as an effective strategy to enhance the performance of Multimodal Large Language Models (MLLMs) following supervised fine-tuning. While existing preference alignment methods predominantly target…

计算机视觉与模式识别 · 计算机科学 2025-09-08 Zitian Wang , Yue Liao , Kang Rong , Fengyun Rao , Yibo Yang , Si Liu

The integration of contextual embeddings into the optimization processes of large language models is an advancement in natural language processing. The Context-Aware Neural Gradient Mapping framework introduces a dynamic gradient adjustment…

计算与语言 · 计算机科学 2025-04-25 David Boldo , Lily Pemberton , Gabriel Thistledown , Jacob Fairchild , Felix Kowalski

The empirical success of derivative-free methods in reinforcement learning for planning through contact seems at odds with the perceived fragility of classical gradient-based optimization methods in these domains. What is causing this gap,…

机器人学 · 计算机科学 2022-01-25 H. J. Terry Suh , Tao Pang , Russ Tedrake

Motivated by applications arising from sensor networks and machine learning, we consider the problem of minimizing a finite sum of nondifferentiable convex functions where each component function is associated with an agent and a…

最优化与控制 · 数学 2021-03-22 Harshal D. Kaushik , Farzad Yousefian

This paper studies an acceleration technique for incremental aggregated gradient ({\sf IAG}) method through the use of \emph{curvature} information for solving strongly convex finite sum optimization problems. These optimization problems of…

最优化与控制 · 数学 2020-03-02 Hoi-To Wai , Wei Shi , Cesar A. Uribe , Angelia Nedich , Anna Scaglione

Sinusoidal neural networks have been shown effective as implicit neural representations (INRs) of low-dimensional signals, due to their smoothness and high representation capacity. However, initializing and training them remain empirical…

机器学习 · 计算机科学 2025-04-07 Tiago Novello , Diana Aldana , Andre Araujo , Luiz Velho

Brain-Computer Interfaces (BCIs) rely on accurately decoding electroencephalography (EEG) motor imagery (MI) signals for effective device control. Graph Neural Networks (GNNs) outperform Convolutional Neural Networks (CNNs) in this regard,…

信号处理 · 电气工程与系统科学 2024-05-03 Htoo Wai Aung , Jiao Jiao Li , Yang An , Steven W. Su

Neural operators serve as fast, data-driven surrogates for scientific modeling but typically rely on a monolithic, single-pass inference procedure that struggles to resolve high-frequency details, a limitation known as spectral bias. We…

机器学习 · 计算机科学 2026-05-27 Xiaotian Liu , Shuyuan Shang , Xiaopeng Wang , Pu Ren , Yaoqing Yang

In this paper, we study Interaction-Grounded Learning (IGL) [Xie et al., 2021], a paradigm designed for realistic scenarios where the learner receives indirect feedback generated by an unknown mechanism, rather than explicit numerical…

机器学习 · 计算机科学 2026-02-10 Mengxiao Zhang , Yuheng Zhang , Haipeng Luo , Paul Mineiro

Existing graph contrastive learning methods rely on augmentation techniques based on random perturbations (e.g., randomly adding or dropping edges and nodes). Nevertheless, altering certain edges or nodes can unexpectedly change the graph…

机器学习 · 计算机科学 2022-11-08 Huidong Liang , Xingjian Du , Bilei Zhu , Zejun Ma , Ke Chen , Junbin Gao

The mainstream CNN-based remote sensing (RS) image semantic segmentation approaches typically rely on massive labeled training data. Such a paradigm struggles with the problem of RS multi-view scene segmentation with limited labeled views…

计算机视觉与模式识别 · 计算机科学 2023-08-09 Zipeng Qi , Hao Chen , Chenyang Liu , Zhenwei Shi , Zhengxia Zou

Like humans, deep networks have been shown to learn better when samples are organized and introduced in a meaningful order or curriculum. Conventional curriculum learning schemes introduce samples in their order of difficulty. This forces…

计算机视觉与模式识别 · 计算机科学 2020-08-14 Madan Ravi Ganesh , Jason J. Corso

Supervised Deep-Learning (DL)-based reconstruction algorithms have shown state-of-the-art results for highly-undersampled dynamic Magnetic Resonance Imaging (MRI) reconstruction. However, the requirement of excessive high-quality…

图像与视频处理 · 电气工程与系统科学 2025-11-11 Jie Feng , Ruimin Feng , Qing Wu , Zhiyong Zhang , Yuyao Zhang , Hongjiang Wei

Neural integral equations are deep learning models based on the theory of integral equations, where the model consists of an integral operator and the corresponding equation (of the second kind) which is learned through an optimization…

数值分析 · 数学 2025-11-14 Emanuele Zappala

Whether Large Language Models (LLMs) develop coherent internal world models remains a core debate. While conventional Next-Token Prediction (NTP) focuses on one-step-ahead supervision, Multi-Token Prediction (MTP) has shown promise in…

机器学习 · 计算机科学 2026-04-21 Qimin Zhong , Hao Liao , Haiming Qin , Mingyang Zhou , Rui Mao , Wei Chen , Naipeng Chao

Implicit neural representation (INR) can describe the target scenes with high fidelity using a small number of parameters, and is emerging as a promising data compression technique. However, limited spectrum coverage is intrinsic to INR,…

计算机视觉与模式识别 · 计算机科学 2023-03-22 Runzhao Yang , Tingxiong Xiao , Yuxiao Cheng , Jinli Suo , Qionghai Dai

Implicit Neural Representations (INRs) encode discrete signals in a continuous manner using neural networks, demonstrating significant value across various multimedia applications. However, the vulnerability of INRs presents a critical…

计算机视觉与模式识别 · 计算机科学 2025-08-20 Wenyong Zhou , Yuxin Cheng , Zhengwu Liu , Taiqiang Wu , Chen Zhang , Ngai Wong