English
Related papers

Related papers: Dense Associative Memory with Epanechnikov Energy

200 papers

The inability to acquire clean high-resolution (HR) electron microscopy (EM) images over a large brain tissue volume hampers many neuroscience studies. To address this challenge, we propose a deep-learning-based image super-resolution (SR)…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Mohammad Khateri , Morteza Ghahremani , Alejandra Sierra , Jussi Tohka

In this paper, we focus on solving one of the most important tasks in the field of speech processing, i.e., automatic speech recognition (ASR), with speech foundation encoders and large language models (LLM). Recent works have complex…

Computation and Language · Computer Science 2024-02-15 Ziyang Ma , Guanrou Yang , Yifan Yang , Zhifu Gao , Jiaming Wang , Zhihao Du , Fan Yu , Qian Chen , Siqi Zheng , Shiliang Zhang , Xie Chen

Deep learning models are effective for sequential data modeling, yet commonly used activation functions such as ReLU, LeakyReLU, and PReLU often exhibit gradient instability when applied to noisy, non-stationary financial time series. This…

Machine Learning · Computer Science 2026-01-26 George Awiakye-Marfo , Elijah Agbosu , Victoria Mawuena Barns , Samuel Asante Gyamerah

The development of next-generation molecular simulation models requires moving beyond pre-defined functional forms toward machine learning (ML) techniques that directly capture multiscale physics. Here, we demonstrate such an approach using…

The rapid surge in data generated by Internet of Things (IoT), artificial intelligence (AI), and machine learning (ML) applications demands ultra-fast, scalable, and energy-efficient hardware, as traditional von Neumann architectures face…

Image registration is a fundamental task for medical imaging. Resampling of the intensity values is required during registration and better spatial resolution with finer and sharper structures can improve the resampling performance and…

Image and Video Processing · Electrical Eng. & Systems 2022-01-03 Kaicong Sun , Sven Simon

With the emergence of light field imaging in recent years, the compression of its elementary image array (EIA) has become a significant problem. Our coding framework includes modeling and reconstruction. For the modeling, the…

Image and Video Processing · Electrical Eng. & Systems 2021-08-24 Boning Liu , Yan Zhao , Xiaomeng Jiang , Shigang Wang , Jian Wei

Deep learning-based single image super-resolution enables very fast and high-visual-quality reconstruction. Recently, an enhanced super-resolution based on generative adversarial network (ESRGAN) has achieved excellent performance in terms…

Image and Video Processing · Electrical Eng. & Systems 2019-11-21 Chih-Chung Hsu , Chia-Hsiang Lin

Self-attention networks (SAN) have been introduced into automatic speech recognition (ASR) and achieved state-of-the-art performance owing to its superior ability in capturing long term dependency. One of the key ingredients is the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-30 Zhao You , Dan Su , Jie Chen , Chao Weng , Dong Yu

Deep convolution-based single image super-resolution (SISR) networks embrace the benefits of learning from large-scale external image resources for local recovery, yet most existing works have ignored the long-range feature-wise…

Computer Vision and Pattern Recognition · Computer Science 2020-06-03 Yiqun Mei , Yuchen Fan , Yuqian Zhou , Lichao Huang , Thomas S. Huang , Humphrey Shi

Dense Associative Memory (DenseAM) is a promising family of AI architectures that is represented by a neural network performing temporal dynamics on an energy landscape. While hyperparameter transfer methods are well-studied for…

Machine Learning · Computer Science 2026-05-12 Roi Holtzman , Dmitry Krotov , Boris Hanin

For years, Single Image Super Resolution (SISR) has been an interesting and ill-posed problem in computer vision. The traditional super-resolution (SR) imaging approaches involve interpolation, reconstruction, and learning-based methods.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Karthick Prasad Gunasekaran

Neural networks have been criticised for their inability to perform continual learning due to catastrophic forgetting and rapid unlearning of a past concept when a new concept is introduced. Catastrophic forgetting can be alleviated by…

Machine Learning · Computer Science 2022-05-16 Heinrich van Deventer , Pieter Janse van Rensburg , Anna Bosman

Herein, a bit-wise Convolutional Neural Network (CNN) in-memory accelerator is implemented using Spin-Orbit Torque Magnetic Random Access Memory (SOT-MRAM) computational sub-arrays. It utilizes a novel AND-Accumulation method capable of…

Machine Learning · Computer Science 2019-04-18 Arman Roohi , Shaahin Angizi , Deliang Fan , Ronald F DeMara

Accurate short-term energy consumption forecasting is essential for efficient power grid management, resource allocation, and market stability. Traditional time-series models often fail to capture the complex, non-linear dependencies and…

Computers and Society · Computer Science 2026-01-27 Abhishek Maity , Viraj Tukarul

Energy disaggregation estimates appliance-by-appliance electricity consumption from a single meter that measures the whole home's electricity demand. Recently, deep neural networks have driven remarkable improvements in classification…

Neural and Evolutionary Computing · Computer Science 2015-09-29 Jack Kelly , William Knottenbelt

Ternary content addressable memory (TCAM) has been a critical component in caches, routers, etc., in which density, speed, power efficiency, and reliability are the major design targets. There have been the conventional low-write-power but…

Emerging Technologies · Computer Science 2021-01-26 Hongtao Zhong , Shengjie Cao , Huazhong Yang , Xueqing Li

This paper introduces OPTIMUM-DERAM, a highly consistent, scalable, secure, and decentralized shared memory solution. Traditional distributed shared memory implementations offer multi-object support by multi-threading a single object memory…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-21 Nicolas Nicolaou , Kishori M. Konwar , Moritz Grundei , Aleksandr Bezobchuk , Muriel Médard , Sriram Vishwanath

Visual sensors, including 3D LiDAR, neuromorphic DVS sensors, and conventional frame cameras, are increasingly integrated into edge-side intelligent machines. Realizing intensive multi-sensory data analysis directly on edge intelligent…

Personalized large language models (LLMs) rely on memory retrieval to incorporate user-specific histories, preferences, and contexts. Existing approaches either overload the LLM by feeding all the user's past memory into the prompt, which…

Information Retrieval · Computer Science 2026-03-11 Yingyi Zhang , Junyi Li , Wenlin Zhang , Penyue Jia , Xianneng Li , Yichao Wang , Derong Xu , Yi Wen , Huifeng Guo , Yong Liu , Xiangyu Zhao