Exploiting layerwise convexity of rectifier networks with sign constrained weights
© 2018 Elsevier Ltd By introducing sign constraints on the weights, this paper proposes sign constrained rectifier networks (SCRNs), whose training can be solved efficiently by the well known majorization–minimization (MM) algorithms. We prove that the proposed two-hidden-layer SCRNs, which exhibit...
| Main Authors: | , , , |
|---|---|
| Format: | Journal Article |
| Published: |
Pergamon, Elsevier
2018
|
| Online Access: | http://hdl.handle.net/20.500.11937/69564 |