tree a4fb90154184e5d888fbf2f71bc8c6a34d06aeca
parent 2e2b09cb2ccb3bac8a777f4783daa4db4671c927
author Yunqing Wang <yunqingwang@google.com> 1561144036 -0700
committer Yunqing Wang <yunqingwang@google.com> 1561492465 +0000

Unify probability calculation

Unify probability calculation in prune_tx_2D regardless of tx_set_type.
AWCY result:
Speed 1
Video    PSNR    PSNR HVS   SSIM    CIEDE 2000
Average -0.02     -0.03    -0.00     -0.02
Speed 3
Video    PSNR    PSNR HVS   SSIM    CIEDE 2000
Average -0.08    -0.04     -0.10     -0.03

Speed test result:
Speed 1: average 0.71% slower
Speed 3: average 1.04% slower

The thresholds could be further adjusted.

STATS_CHANGED

Change-Id: I52a5ccef440884ce6d264b5363701dca76282392