English
Related papers

Related papers: Theoretically informed selection of latent activat…

200 papers

This work describes a novel data-driven latent space inference framework built on paired autoencoders to handle observational inconsistencies when solving inverse problems. Our approach uses two autoencoders, one for the parameter space and…

Machine Learning · Computer Science 2026-01-19 Emma Hart , Bas Peters , Julianne Chung , Matthias Chung

For many machine learning algorithms, predictive performance is critically affected by the hyperparameter values used to train them. However, tuning these hyperparameters can come at a high computational cost, especially on larger datasets,…

The primary neural networks decision-making units are activation functions. Moreover, they evaluate the output of networks neural node; thus, they are essential for the performance of the whole network. Hence, it is critical to choose the…

Machine Learning · Computer Science 2020-10-20 Tomasz Szandała

Textual explanations have proved to help improve user satisfaction on machine-made recommendations. However, current mainstream solutions loosely connect the learning of explanation with the learning of recommendation: for example, they are…

Information Retrieval · Computer Science 2021-01-26 Aobo Yang , Nan Wang , Hongbo Deng , Hongning Wang

Improving reasoning abilities of Large Language Models (LLMs), especially under parameter constraints, is crucial for real-world applications. Looped transformers address this by performing multiple latent iterations to refine each token…

Computation and Language · Computer Science 2026-04-28 Tianyu Fu , Yichen You , Zekai Chen , Guohao Dai , Huazhong Yang , Yu Wang

The recommender systems have long been investigated in the literature. Recently, users' implicit feedback like `click' or `browse' are considered to be able to enhance the recommendation performance. Therefore, a number of attempts have…

Information Retrieval · Computer Science 2019-04-09 Jingbin Zhong , Xiaofeng Zhang

Online learning is an important technical means for sketching massive real-time and high-speed data. Although this direction has attracted intensive attention, most of the literature in this area ignore the following three issues: (1) they…

Machine Learning · Computer Science 2022-01-20 Si-si Zhang , Jian-wei Liu , Xin Zuo , Run-kun Lu , Si-ming Lian

This work develops problem statements related to encoders and autoencoders with the goal of elucidating variational formulations and establishing clear connections to information-theoretic concepts. Specifically, four problems with varying…

Information Theory · Computer Science 2021-07-15 Karthik Duraisamy

Autodock is a widely used molecular modeling tool which predicts how small molecules bind to a receptor of known 3D structure. The current version of AutoDock uses meta-heuristic algorithms in combination with local search methods for doing…

Machine Learning · Statistics 2018-12-07 Hojjat Rakhshani , Lhassane Idoumghar , Julien Lepagnot , Mathieu Brevilliers , Edward Keedwell

Autoencoders have long been considered a nonlinear extension of Principal Component Analysis (PCA). Prior studies have demonstrated that linear autoencoders (LAEs) can recover the ordered, axis-aligned principal components of PCA by…

Machine Learning · Computer Science 2026-01-28 Qipeng Zhan , Zhuoping Zhou , Zexuan Wang , Li Shen

In this paper we propose Structuring AutoEncoders (SAE). SAEs are neural networks which learn a low dimensional representation of data which are additionally enriched with a desired structure in this low dimensional space. While traditional…

Machine Learning · Computer Science 2019-08-20 Marco Rudolph , Bastian Wandt , Bodo Rosenhahn

Recent advances in pretraining 3D point cloud encoders (e.g., Point-BERT, Point-MAE) have produced powerful models, whose abilities are typically evaluated on geometric or semantic tasks. At the same time, topological descriptors have been…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Louis Martinez , Maks Ovsjanikov

In recent years, deep neural networks have yielded state-of-the-art performance on several tasks. Although some recent works have focused on combining deep learning with recommendation, we highlight three issues of existing models. First,…

Machine Learning · Computer Science 2018-12-20 Qibing Li , Xiaolin Zheng , Xinyue Wu

This paper is dedicated to control theoretically explainable application of autoencoders to optimal fault detection in nonlinear dynamic systems. Autoencoder-based learning is a standard machine learning method and widely applied for fault…

Systems and Control · Electrical Eng. & Systems 2023-05-17 Linlin Li , Steven X. Ding , Ketian Liang , Zhiwen Chen , Ting Xue

Modern commercial platforms typically offer both search and recommendation functionalities to serve diverse user needs, making joint modeling of these tasks an appealing direction. While prior work has shown that integrating search and…

Information Retrieval · Computer Science 2025-04-11 Teng Shi , Jun Xu , Xiao Zhang , Xiaoxue Zang , Kai Zheng , Yang Song , Enyun Yu

Terahertz (THz) sensing is a promising imaging technology for a wide variety of different applications. Extracting the interpretable and physically meaningful parameters for such applications, however, requires solving an inverse problem in…

Computer Vision and Pattern Recognition · Computer Science 2019-10-30 Tak Ming Wong , Matthias Kahl , Peter Haring Bolívar , Andreas Kolb , Michael Möller

While the activations of neurons in deep neural networks usually do not have a simple human-understandable interpretation, sparse autoencoders (SAEs) can be used to transform these activations into a higher-dimensional latent space which…

Machine Learning · Computer Science 2025-08-07 Gonçalo Paulo , Alex Mallen , Caden Juang , Nora Belrose

Tokenizers are a crucial component of latent diffusion models, as they define the latent space in which diffusion models operate. However, existing tokenizers are primarily designed to improve reconstruction fidelity or inherit pretrained…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Zhengrong Yue , Taihang Hu , Mengting Chen , Haiyu Zhang , Zihao Pan , Tao Liu , Zikang Wang , Jinsong Lan , Xiaoyong Zhu , Bo Zheng , Yali Wang

In this paper, we present a novel structure, Semi-AutoEncoder, based on AutoEncoder. We generalize it into a hybrid collaborative filtering model for rating prediction as well as personalized top-n recommendations. Experimental results on…

Information Retrieval · Computer Science 2017-08-17 Shuai Zhang , Lina Yao , Xiwei Xu , Sen Wang , Liming Zhu

This paper demonstrates the computational design of soft elastomeric pneumatic actuators using nonlinear topology optimization. An existing density- and porohyperelasticity-based topology optimization framework was extended from 2D to 3D…

Robotics · Computer Science 2026-05-20 Sumit Mehta , Konstantinos Poulios