Tetsushi Noda

Artificial neural networks with input gates

An architecture of multilayer neural networks is proposed. The networks are equipped with gates on their input channels in order to control the flow of input signals. A gate on an input channel opens and closes depending on the current values of the other input signals. The dependency is automatically determined based on the training data. These gates give the networks a good generalization ability because they can eliminate harmful inputs. They can also indicate which input is significant and in which situations, and therefore they provide an insight into the input-output relationship underlying the training data.