tree a1596b75cba1bc79c03489ea94a31459ef65ad83
parent 10274fddf1a3bc22a9717f479abfdb908e5344a0
author Aasaipriya <aasaipriya.c@ittiam.com> 1615983933 +0530
committer Urvang Joshi <urvang@google.com> 1616526101 +0000

Reduce the NN output precision bits to 9

This patch modifies the precision bits from 11 to 9 in
av1_nn_output_prec_reduce(). The input features to the
NN module contains precision level difference across the
OS, thereby causing the mismatch. This patch currently
fixes the bitstream mismatch by reducing the precision
bits. However this may not solve the problem entirely.

Verified on below OS and compiler version,
Windows - VS2019
Ubuntu - gcc 7.4.0, gcc 7.5.0
Centos - gcc 7.4.0

BUG=aomedia:2928
STATS_CHANGED

Change-Id: I46284de1771500b492bbe6bc4020d6e6e1141701