English
Related papers

Related papers: Mapping Energy Landscapes of Non-Convex Learning P…

200 papers

An extreme learning machine (ELM) is a three-layered feed-forward neural network having untrained parameters, which are randomly determined before training. Inspired by the idea of ELM, a probabilistic untrained layer called a…

Machine Learning · Computer Science 2022-10-28 Yuri Kanno , Muneki Yasuda

In many recent works, the potential of Exploratory Landscape Analysis (ELA) features to numerically characterize, in particular, single-objective continuous optimization problems has been demonstrated. These numerical features provide the…

Machine Learning · Computer Science 2024-07-30 Moritz Vinzent Seiler , Pascal Kerschke , Heike Trautmann

Meta-learning is a line of research that develops the ability to leverage past experiences to efficiently solve new learning problems. Meta-Reinforcement Learning (meta-RL) methods demonstrate a capability to learn behaviors that…

Machine Learning · Computer Science 2022-08-25 Brieuc Pinon , Jean-Charles Delvenne , Raphaël Jungers

As multi-microgrids become readily available, some limited models have been proposed that study operational and power quality constraints with local energy markets independently. This paper proposes a convex optimization model of an energy…

Systems and Control · Electrical Eng. & Systems 2022-12-06 Johanna Castellanos , Carlos Adrian Correa-Florez , Alejandro Garcés , Gabriel Ordóñez-Plata , César A. Uribe , Diego Patino

Energy-based learning is a powerful learning paradigm that encapsulates various discriminative and generative approaches. An energy-based model (EBM) is typically formed of inner-model(s) that learn a combination of the different features…

Machine Learning · Computer Science 2023-06-05 Firas Laakom , Jenni Raitoharju , Alexandros Iosifidis , Moncef Gabbouj

Latent class model (LCM), which is a finite mixture of different categorical distributions, is one of the most widely used models in statistics and machine learning fields. Because of its non-continuous nature and the flexibility in shape,…

Machine Learning · Statistics 2021-03-23 Hao Chen , Lanshan Han , Alvin Lim

In reality, learning from multi-view multi-label data inevitably confronts three challenges: missing labels, incomplete views, and non-aligned views. Existing methods mainly concern the first two and commonly need multiple assumptions to…

Machine Learning · Computer Science 2024-06-12 Xiang Li , Songcan Chen

Deep energy-based models are powerful, but pose challenges for learning and inference (Belanger and McCallum, 2016). Tu and Gimpel (2018) developed an efficient framework for energy-based models by training "inference networks" to…

Computation and Language · Computer Science 2020-10-13 Lifu Tu , Richard Yuanzhe Pang , Kevin Gimpel

Exploratory landscape analysis (ELA) supports supervised learning approaches for automated algorithm selection and configuration by providing sets of features that quantify the most relevant characteristics of the optimization problem at…

Neural and Evolutionary Computing · Computer Science 2022-12-08 Quentin Renau , Carola Doerr , Johann Dreo , Benjamin Doerr

We review a class of energy landscape analysis method that uses the Ising model and takes multivariate time series data as input. The method allows one to capture dynamics of the data as trajectories of a ball from one basin to a different…

Disordered Systems and Neural Networks · Physics 2025-05-13 Naoki Masuda , Saiful Islam , Si Thu Aung , Takamitsu Watanabe

Extreme learning machine (ELM) is a network model that arbitrarily initializes the first hidden layer and can be computed speedily. In order to improve the classification performance of ELM, a $\ell_2$ and $\ell_{0.5}$ regularization ELM…

Optimization and Control · Mathematics 2023-01-05 Liangjuan Zhou , Wei Miao

Energy functions for pure and heterogenous systems are one of the backbones for molecular simulation of condensed phase systems. With the advent of machine learned potential energy surfaces (ML-PESs) a new era has started. Statistical…

We introduce a methodology to study the possible matter flows of an ecosystem defined by observational biomass data and realistic biological constraints. The flows belong to a polyhedron in a multi dimensional space making statistical…

Adaptation and Self-Organizing Systems · Physics 2021-02-04 Jean-Guy Caputo , Valerie Girardin , Arnaud Knippel , Hieu Nguyen , Nathalie Niquil , Quentin Nogues

Labor-intensive labeling becomes a bottleneck in developing computer vision algorithms based on deep learning. For this reason, dealing with imperfect labels has increasingly gained attention and has become an active field of study. We…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Heewon Kim , Hyun Sung Chang , Kiho Cho , Jaeyun Lee , Bohyung Han

Predictive models are highly advanced in understanding the mechanisms of brain function. Recent advances in machine learning further underscore the power of prediction for optimal representation in learning. However, there remains a gap in…

Machine Learning · Computer Science 2025-05-22 Xingsi Dong , Xiangyuan Peng , Si Wu

One of the most common problem-solving heuristics is by analogy. For a given problem, a solver can be viewed as a strategic walk on its fitness landscape. Thus if a solver works for one problem instance, we expect it will also be effective…

Machine Learning · Computer Science 2023-12-06 Mingyu Huang , Ke Li

Exploratory landscape analysis (ELA) is a well-established tool to characterize optimization problems via numerical features. ELA is used for problem comprehension, algorithm design, and applications such as automated algorithm selection…

Neural and Evolutionary Computing · Computer Science 2024-07-11 Konstantin Dietrich , Raphael Patrick Prager , Carola Doerr , Heike Trautmann

Structural learning, a method to estimate the parameters for discrete energy minimization, has been proven to be effective in solving computer vision problems, especially in 3D scene parsing. As the complexity of the models increases,…

Computer Vision and Pattern Recognition · Computer Science 2017-01-13 Mengtian Li , Daniel Huber

This paper studies the fundamental problem of multi-layer generator models in learning hierarchical representations. The multi-layer generator model that consists of multiple layers of latent variables organized in a top-down architecture…

Machine Learning · Computer Science 2023-10-17 Jiali Cui , Ying Nian Wu , Tian Han

Energy-based models, a.k.a. energy networks, perform inference by optimizing an energy function, typically parametrized by a neural network. This allows one to capture potentially complex relationships between inputs and outputs. To learn…

Machine Learning · Computer Science 2022-10-13 Mathieu Blondel , Felipe Llinares-López , Robert Dadashi , Léonard Hussenot , Matthieu Geist