tree 7aab9adc242686d0dfbf4afdac64d8eec4befcd8
parent 24f429a080b1c4ac07b97c0b63e4cfcecf73112f
author mlchen <mlchen@google.com> 1560466322 -0700
committer Mingliang Chen <mlchen@google.com> 1560963230 +0000

Refactor NN structure (NN_CONFIG_V2).

Refactor NN structure (NN_CONFIG_V2).
  - Add struct FC_LAYER to make the NN configuration more clear.
  - Add ReLU and sigmoid as optional activation functions.
  - Add softmax cross entropy as optional loss function.
Add the pointer to layer outputs and gradients.
  - We plan to add back propagation for the NN model to make it online
  learning (adjust the model weight during the encoding process).
Implement forward prediction for NN_CONFIG_V2.
Add an experimental flag CONFIG_NN_V2 for the change.

Change-Id: Id5c038dbc4a12a248c43d841b80f99946ce7ae6e