tree ac301099fa71d1b5d6c2125768acfa12752ea4c7
parent f3ef3f2eabe9475bc15eab2e08cd6146f2051fd3
author chiyotsai <chiyotsai@google.com> 1626907240 -0700
committer Chi Yo Tsai <chiyotsai@google.com> 1626994553 +0000

Fix an incorrect index used by prune_tx_2D

In prune_tx_2D function, the encoder attempts to re-enable the tx_type
with maximum probability by checking
!(allow_bitmask >> max_score_i) & 0x1.
But tx_type_table_2D[max_score_i] should be used instead of max_score_i.

This commit fixes this and consolidates the bit operations to a couple
functions.

The BDRate change is noise level < 0.01%.

STATS_CHANGED

Change-Id: I9e067194215757f287b5ddb84198855fbdb76d37