tree c34488c0d1841ce9c70ad15e0fedf54c87c9f338
parent 4efe20e99dcd9b6f8eadc8de8acc825be7416578
author Wan-Teh Chang <wtc@google.com> 1619819152 -0700
committer Wan-Teh Chang <wtc@google.com> 1619829120 +0000

aom_dsp: Fix aom_noise_strength_lut_init with zero size

Return 0 when lut size is zero. aom_noise_strength_lut_eval() assumes
lut size is nonzero. For example, it accesses lut->points[0] and
lut->points[lut->num_points - 1] without checking lut->num_points.

Also handle the failure of aom_noise_strength_solver_fit_piecewise().

BUG=aomedia:2999

Change-Id: I19858c8bd097f523f6316effedb5e3b9acd2e4b7