English
Related papers

Related papers: Loss networks

200 papers

We show that learning can be improved by using loss functions that evolve cyclically during training to emphasize one class at a time. In underparameterized networks, such dynamical loss functions can lead to successful training for…

Machine Learning · Computer Science 2021-06-24 Miguel Ruiz-Garcia , Ge Zhang , Samuel S. Schoenholz , Andrea J. Liu

After a more than decade-long period of relatively little research activity in the area of recurrent neural networks, several new developments will be reviewed here that have allowed substantial progress both in understanding and in…

Machine Learning · Computer Science 2012-12-17 Yoshua Bengio , Nicolas Boulanger-Lewandowski , Razvan Pascanu

Many natural systems, such as neurons firing in the brain or basketball teams traversing a court, give rise to time series data with complex, nonlinear dynamics. We can gain insight into these systems by decomposing the data into segments…

In this paper, we consider the problem of exploring structural regularities of networks by dividing the nodes of a network into groups such that the members of each group have similar patterns of connections to other groups. Specifically,…

Physics and Society · Physics 2015-05-30 Hua-Wei Shen , Xue-Qi Cheng , Jia-Feng Guo

This paper introduces how human languages can be studied in light of recent development of network theories. There are two directions of exploration. One is to study networks existing in the language system. Various lexical networks can be…

Computation and Language · Computer Science 2007-05-23 Jinyun KE

Deep neural networks are currently among the most commonly used classifiers. Despite easily achieving very good performance, one of the best selling points of these models is their modular design - one can conveniently adapt their…

Machine Learning · Computer Science 2017-02-21 Katarzyna Janocha , Wojciech Marian Czarnecki

These notes derive a number of technical results on nonlinear contraction theory, a comparatively recent tool for system stability analysis. In particular, they provide new results on the preservation of contraction through system…

Adaptation and Self-Organizing Systems · Physics 2007-05-23 Nicolas Tabareau , Jean-Jacques Slotine

New checkable criteria for persistence of chemical reaction networks are proposed, which extend and complement those obtained by the authors in previous work. The new results allow the consideration of reaction rates which are time-varying,…

Molecular Networks · Quantitative Biology 2009-05-12 David Angeli , Patrick De Leenheer , Eduardo Sontag

The human organism is an integrated network where complex physiologic systems, each with its own regulatory mechanisms, continuously interact, and where failure of one system can trigger a breakdown of the entire network. Identifying and…

Data Analysis, Statistics and Probability · Physics 2012-03-02 Amir Bashan , Ronny P. Bartsch , Jan W. Kantelhardt , Shlomo Havlin , Plamen Ch. Ivanov

We discuss several interesting random network models which exhibit (provable) explosive transitions and their applications.

Disordered Systems and Neural Networks · Physics 2010-02-02 Eric J. Friedman , Joel Nishimura

Many real-world networks are known to exhibit facts that counter our knowledge prescribed by the theories on network creation and communication patterns. A common prerequisite in network analysis is that information on nodes and links will…

Physics and Society · Physics 2018-04-03 Guy Kelman , Eran Manes , Marco Lamieri , David Breé

Online social networks represent a main source of communication and information exchange in today's life. They facilitate exquisitely news sharing, knowledge elicitation, and forming groups of same interests. Researchers in the last two…

Social and Information Networks · Computer Science 2020-09-02 Mohammed Abufouda

Optimization networks are a new methodology for holistically solving interrelated problems that have been developed with combinatorial optimization problems in mind. In this contribution we revisit the core principles of optimization…

One explanation for the impressive recent boom in network theory might be that it provides a promising tool for an understanding of complex systems. Network theory is mainly focusing on discrete large-scale topological structures rather…

Statistical Mechanics · Physics 2015-06-25 Stefan Thurner

The theory of complex networks and of disordered systems is used to study the stability and dynamical properties of a simple model of material flow networks defined on random graphs. In particular we address instabilities that are…

Disordered Systems and Neural Networks · Physics 2009-11-13 Kartik Anand , Tobias Galla

In this paper we define a new class of weighted complex networks sharing several properties with fractal sets, and whose topology can be completely analytically characterized in terms of the involved parameters and of the fractal dimension.…

Other Condensed Matter · Physics 2014-01-10 Timoteo Carletti , Simone Righi

We discuss various aspects of the statistical formulation of the theory of random graphs, with emphasis on results obtained in a series of our recent publications.

Statistical Mechanics · Physics 2009-11-10 Zdzislaw Burda , Jerzy Jurkiewicz , Andre Krzywicki

A longitudinal social network evolves over time through the creation and/ or deletion of links among a set of actors (e.g. individuals or organizations). Longitudinal social networks are studied by network science and social science…

Social and Information Networks · Computer Science 2013-11-04 Shahadat Uddin , Mahendra Piraveenan , Arif Khan , Babak Amiri

Boolean networks have been successfully used in modelling gene regulatory networks. In this paper we propose a reduction method that reduces the complexity of a Boolean network but keeps dynamical properties and topological features and…

Quantitative Methods · Quantitative Biology 2009-07-06 Alan Veliz-Cuba

We propose a synthetical weights' dynamic mechanism for weighted networks which takes into account the influences of strengths of nodes, weights of links and incoming new vertices. Strength/Weight preferential strategies are used in these…

Physics and Society · Physics 2007-09-10 Lujun Fang , Zhongzhi Zhang , Shuigeng Zhou , Jihong Guan