English
Related papers

Related papers: OpenTensor: Reproducing Faster Matrix Multiplicati…

200 papers

While the recent advances in deep neural networks (DNN) bring remarkable success, the computational cost also increases considerably. In this paper, we introduce Greenformer, a toolkit to accelerate the computation of neural networks…

Machine Learning · Computer Science 2021-10-12 Samuel Cahyawijaya , Genta Indra Winata , Holy Lovenia , Bryan Wilie , Wenliang Dai , Etsuko Ishii , Pascale Fung

Deep learning using neural networks is an effective technique for generating models of complex data. However, training such models can be expensive when networks have large model capacity resulting from a large number of layers and nodes.…

Machine Learning · Computer Science 2023-01-19 Jarom D. Hogue , Robert M. Kirby , Akil Narayan

Reinforcement Learning (RL) is a research area that has blossomed tremendously in recent years and has shown remarkable potential in among others successfully playing computer games. However, there only exists a few game platforms that…

Artificial Intelligence · Computer Science 2018-01-29 Per-Arne Andersen , Morten Goodwin , Ole-Christoffer Granmo

Reinforcement learning (RL) algorithms have been around for decades and employed to solve various sequential decision-making problems. These algorithms however have faced great challenges when dealing with high-dimensional environments. The…

Machine Learning · Computer Science 2020-04-01 Thanh Thi Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi

We propose a novel training method that integrates rules into deep learning, in a way the strengths of the rules are controllable at inference. Deep Neural Networks with Controllable Rule Representations (DeepCTRL) incorporates a rule…

Machine Learning · Computer Science 2021-11-18 Sungyong Seo , Sercan O. Arik , Jinsung Yoon , Xiang Zhang , Kihyuk Sohn , Tomas Pfister

Deep Learning (DL) is a machine learning procedure for artificial intelligence that analyzes the input data in detail by increasing neuron sizes and number of the hidden layers. DL has a popularity with the common improvements on the…

Machine Learning · Computer Science 2021-01-26 Gokhan Altan , Yakup Kutlu

We study the recovery of the underlying graphs or permutations for tensors in the tensor ring or tensor train format. Our proposed algorithms compare the matricization ranks after down-sampling, whose complexity is $O(d\log d)$ for $d$-th…

Numerical Analysis · Mathematics 2024-04-04 Ziang Chen , Jianfeng Lu , Anru R. Zhang

In recent years, a new kind of accelerated hardware has gained popularity in the Artificial Intelligence (AI) and Machine Learning (ML) communities which enables extremely high-performance tensor contractions in reduced precision for deep…

Computational Physics · Physics 2024-05-01 Adela Habib , Joshua Finkelstein , Anders M. N. Niklasson

Reinforcement Learning (RL) has emerged as a powerful paradigm in Artificial Intelligence (AI), enabling agents to learn optimal behaviors through interactions with their environments. Drawing from the foundations of trial and error, RL…

Artificial Intelligence · Computer Science 2025-02-04 Majid Ghasemi , Amir Hossein Moosavi , Dariush Ebrahimi

Recent advances in Reinforcement Learning, grounded on combining classical theoretical results with Deep Learning paradigm, led to breakthroughs in many artificial intelligence tasks and gave birth to Deep Reinforcement Learning (DRL) as a…

Machine Learning · Computer Science 2019-07-09 Sergey Ivanov , Alexander D'yakonov

Even nowadays, where Deep Learning (DL) has achieved state-of-the-art performance in a wide range of research domains, accelerating training and building robust DL models remains a challenging task. To this end, generations of researchers…

Machine Learning · Computer Science 2024-08-22 Manos Kirtas , Nikolaos Passalis , Anastasios Tefas

Solving complex computer vision tasks by deep learning techniques relies on large amounts of (supervised) image data, typically unavailable in industrial environments. The lack of training data starts to impede the successful transfer of…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Christoph Heindl , Lukas Brunner , Sebastian Zambal , Josef Scharinger

The state-of-the-art approaches employ approximate computing to reduce the energy consumption of DNN hardware. Approximate DNNs then require extensive retraining afterwards to recover from the accuracy loss caused by the use of approximate…

Neural and Evolutionary Computing · Computer Science 2020-01-31 Vojtech Mrazek , Zdenek Vasicek , Lukas Sekanina , Muhammad Abdullah Hanif , Muhammad Shafique

Reinforcement learning (RL) has increasingly become a pivotal technique in the post-training of large language models (LLMs). The effective exploration of the output space is essential for the success of RL. We observe that for complex…

Machine Learning · Computer Science 2025-07-08 Shihan Dou , Muling Wu , Jingwen Xu , Rui Zheng , Tao Gui , Qi Zhang , Xuanjing Huang

Deep learning (DL) has recently emerged to address the heavy storage and computation requirements of the baseline dictionary-matching (DM) for Magnetic Resonance Fingerprinting (MRF) reconstruction. Fed with non-iterated back-projected…

Computer Vision and Pattern Recognition · Computer Science 2019-02-28 Mohammad Golbabaee , Carolin M. Pirkl , Marion I. Menzel , Guido Buonincontri , Pedro A. Gómez

Deep reinforcement learning (DRL) is one promising approach to teaching robots to perform complex tasks. Because methods that directly reuse the stored experience data cannot follow the change of the environment in robotic problems with a…

Robotics · Computer Science 2022-01-26 Taisuke Kobayashi

The Recurrent Neural Networks and their variants have shown promising performances in sequence modeling tasks such as Natural Language Processing. These models, however, turn out to be impractical and difficult to train when exposed to very…

Computer Vision and Pattern Recognition · Computer Science 2017-07-07 Yinchong Yang , Denis Krompass , Volker Tresp

A large number of computational and scientific methods commonly require decomposing a sparse matrix into triangular factors as LU decomposition. A common problem faced during this decomposition is that even though the given matrix may be…

Machine Learning · Computer Science 2023-10-17 Arpan Dasgupta , Pawan Kumar

LLMs have made significant progress in complex but easy-to-verify problems, yet they still struggle with discovering the unknown. In this paper, we present \textbf{AlphaResearch}, an autonomous research agent designed to discover new…

Computation and Language · Computer Science 2026-04-02 Zhaojian Yu , Kaiyue Feng , Yilun Zhao , Shilin He , Xiao-Ping Zhang , Arman Cohan

Over the past decade, reflection matrix microscopy (RMM) and advanced image reconstruction algorithms have emerged to address the fundamental imaging depth limitations of optical microscopy in thick biological tissues and complex media. In…

Optics · Physics 2024-07-03 Sungsam Kang , Seokchan Yoon , Wonshik Choi