Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
residual [2018/04/23 11:23]
admin
residual [2018/04/23 11:26] (current)
admin
Line 171: Line 171:
  
 https://​arxiv.org/​abs/​1804.07209 NAIS-Net: Stable Deep Networks from Non-Autonomous Differential Equations https://​arxiv.org/​abs/​1804.07209 NAIS-Net: Stable Deep Networks from Non-Autonomous Differential Equations
 +
 +Non-autonomy is implemented
 +by skip connections from the block input
 +to each of the unrolled processing stages and allows
 +stability to be enforced so that blocks can
 +be unrolled adaptively to a pattern-dependent processing
 +depth. We prove that the network is globally
 +asymptotically stable so that for every initial
 +condition there is exactly one input-dependent
 +equilibrium assuming tanh units, and multiple
 +stable equilibria for ReL units.
  
 We believe that cross-breeding machine learning and control We believe that cross-breeding machine learning and control