Deep CollabNet: Rede Deep Learning Colaborativa

Abstract

In order to improve the learning of deep neural networks, this work presents the CollabNet network, a new method of insertion of new layers into a Deep FeedForward neural networks, changing the traditional stacked autoencoders method. This new way of insertion is considered collaborative and seeks to improve training against approaches based on stacked autoencoders. In this new approach, the insertion of a new layer is performed in a coordinated and gradual manner, keeping under designer’s control the influence of the new layer on the training and no longer as random and stochastic as in traditional stacking. The collaboration proposed in this work consists of making the learning of the new inserted layer continues the learning obtained by the previous layers, without prejudice to the global learning of the network. In this way, the new inserted layer collaborates with the previous layers and the set of layers works in a way more aligned to the learning. CollabNet was tested in the Wisconsin Breast Cancer Dataset, obtaining satisfactory and promising results.