commit | 6957e7a077ba090ac19dceef8251815a7d3d835f | [log] [tgz] |
---|---|---|
author | Deb Mukherjee <debargha@google.com> | Fri Jul 11 11:23:10 2014 -0700 |
committer | Deb Mukherjee <debargha@google.com> | Fri Jul 11 11:39:18 2014 -0700 |
tree | 0ff11ede44771629721980e8d233e4e5411b0d18 | |
parent | a75d55df1b362cb608f1ea6b70154cf166c32a3f [diff] |
Some extra bit probability cleanups Refactoring to remove some duplication of probability tables between tokenization and detokenization. Change-Id: I2fc6a6497f9c0410021a9b41f828bc58a864e466