中文
相关论文

相关论文: A Disentangled Low-Rank RNN Framework for Uncoveri…

200 篇论文

Recurrent neural networks (RNNs) are more suitable for learning non-linear dependencies in dynamical systems from observed time series data. In practice all the external variables driving such systems are not known a priori, especially in…

The Dirichlet Belief Network~(DirBN) has been recently proposed as a promising approach in learning interpretable deep latent representations for objects. In this work, we leverage its interpretable modelling architecture and propose a deep…

机器学习 · 计算机科学 2020-04-30 Yaqiong Li , Xuhui Fan , Ling Chen , Bin Li , Zheng Yu , Scott A. Sisson

In many scientific disciplines, we are interested in inferring the nonlinear dynamical system underlying a set of observed time series, a challenging task in the face of chaotic behavior and noise. Previous deep learning approaches toward…

In this paper, we study Discretized Neural Networks (DNNs) composed of low-precision weights and activations, which suffer from either infinite or zero gradients due to the non-differentiable discrete function during training. Most…

机器学习 · 计算机科学 2024-12-20 Jun Chen , Hanwen Chen , Mengmeng Wang , Guang Dai , Ivor W. Tsang , Yong Liu

Most of neural approaches to relation classification have focused on finding short patterns that represent the semantic relation using Convolutional Neural Networks (CNNs) and those approaches have generally achieved better performances…

计算与语言 · 计算机科学 2017-11-02 Jonggu Kim , Jong-Hyeok Lee

The deep learning methods have achieved attractive performance in dynamic MR cine imaging. However, all of these methods are only driven by the sparse prior of MR images, while the important low-rank (LR) prior of dynamic MR cine images is…

图像与视频处理 · 电气工程与系统科学 2020-07-29 Ziwen Ke , Wenqi Huang , Jing Cheng , Zhuoxu Cui , Sen Jia , Haifeng Wang , Xin Liu , Hairong Zheng , Leslie Ying , Yanjie Zhu , Dong Liang

Learning relies on coordinated synaptic changes in recurrently connected populations of neurons. Therefore, understanding the collective evolution of synaptic connectivity over learning is a key challenge in neuroscience and machine…

神经元与认知 · 定量生物学 2023-11-07 Arthur Pellegrino , N Alex Cayco-Gajic , Angus Chadwick

Developing autonomous agents that can interact with changing environments is an open challenge in machine learning. Robustness is particularly important in these settings as agents are often fit offline on expert demonstrations but deployed…

机器学习 · 计算机科学 2023-12-01 Neehal Tumma , Mathias Lechner , Noel Loo , Ramin Hasani , Daniela Rus

Recent architectural developments have enabled recurrent neural networks (RNNs) to reach and even surpass the performance of Transformers on certain sequence modeling tasks. These modern RNNs feature a prominent design pattern: linear…

Disentangled representation learning has recently attracted a significant amount of attention, particularly in the field of image representation learning. However, learning the disentangled representations behind a graph remains largely…

机器学习 · 计算机科学 2020-06-11 Xiaojie Guo , Liang Zhao , Zhao Qin , Lingfei Wu , Amarda Shehu , Yanfang Ye

Capturing long-range dependencies in feature representations is crucial for many visual recognition tasks. Despite recent successes of deep convolutional networks, it remains challenging to model non-local context relations between visual…

计算机视觉与模式识别 · 计算机科学 2019-05-29 Songyang Zhang , Shipeng Yan , Xuming He

Deep unfolding methods---for example, the learned iterative shrinkage thresholding algorithm (LISTA)---design deep neural networks as learned variations of optimization methods. These networks have been shown to achieve faster convergence…

机器学习 · 计算机科学 2020-03-19 Huynh Van Luong , Boris Joukovsky , Nikos Deligiannis

Recurrent Neural Networks (RNNs) achieve state-of-the-art results in many sequence-to-sequence modeling tasks. However, RNNs are difficult to train and tend to suffer from overfitting. Motivated by the Data Processing Inequality (DPI), we…

机器学习 · 统计学 2018-05-24 Ziv Aharoni , Gal Rattner , Haim Permuter

The ability to recognize objects despite there being differences in appearance, known as Core Object Recognition, forms a critical part of human perception. While it is understood that the brain accomplishes Core Object Recognition through…

机器学习 · 计算机科学 2020-05-15 Harshvardhan Sikka

Despite the significant recent progress in deep generative models, the underlying structure of their latent spaces is still poorly understood, thereby making the task of performing semantically meaningful latent traversals an open research…

机器学习 · 计算机科学 2023-07-04 Yue Song , T. Anderson Keller , Nicu Sebe , Max Welling

We address the problem of disentangled representation learning with independent latent factors in graph convolutional networks (GCNs). The current methods usually learn node representation by describing its neighborhood as a perceptual…

机器学习 · 计算机科学 2019-11-27 Yanbei Liu , Xiao Wang , Shu Wu , Zhitao Xiao

Classical methods of solving spatiotemporal dynamical systems include statistical approaches such as autoregressive integrated moving average, which assume linear and stationary relationships between systems' previous outputs. Development…

动力系统 · 数学 2022-02-16 Yonggi Park , Kelum Gajamannage , Dilhani I. Jayathilake , Erik M. Bollt

The tensor low-rank prior has attracted considerable attention in dynamic MR reconstruction. Tensor low-rank methods preserve the inherent high-dimensional structure of data, allowing for improved extraction and utilization of intrinsic…

图像与视频处理 · 电气工程与系统科学 2025-01-14 Yinghao Zhang , Peng Li , Yue Hu

We present Latent Diffeomorphic Dynamic Mode Decomposition (LDDMD), a new data reduction approach for the analysis of non-linear systems that combines the interpretability of Dynamic Mode Decomposition (DMD) with the predictive power of…

机器学习 · 计算机科学 2025-08-04 Willem Diepeveen , Jon Schwenk , Andrea Bertozzi

Given an image dataset, we are often interested in finding data generative factors that encode semantic content independently from pose variables such as rotation and translation. However, current disentanglement approaches do not impose…

计算机视觉与模式识别 · 计算机科学 2019-09-27 Tristan Bepler , Ellen D. Zhong , Kotaro Kelley , Edward Brignole , Bonnie Berger