tree 6d5b903f04d82d779ef3b55d5350eb18b4a487d9
parent add4b15580e410c00c927ee366fa65545045a5d9
author Yunqing Wang <yunqingwang@google.com> 1550268768 -0800
committer Yunqing Wang <yunqingwang@google.com> 1551918797 -0800

Fix an issue in md5 calculation

While building with CONFIG_LOWBITDEPTH equaling 0 or 1, aomdec generates
different md5 values for the same 8-bit AV1 bitstream. Here is an example:
./aomdec *.ivf -o *.yuv --rawvideo --md5

On the other hand, if we run
./aomdec *.ivf -o *.yuv --rawvideo
aomdec generates identical output for the above 2 cases, which is
correct.

This patch fixed the md5 calcultion issue, so that an identical md5 is
generated no matter CONFIG_LOWBITDEPTH is 0 or 1.

BUG=aomedia:2329

Also, added several checkings to silence static analysis warnings.

Change-Id: Icba20e03c8219b307f03b1fbb554ba51eb63f333
(cherry picked from commit 65124b09e4cd5c0657d7a677c9fc000917d57eaf)