| commit | 07d35de0561e9b6ae5458beaa78ee2687f0fe4cf | [log] [tgz] |
|---|---|---|
| author | Jingning Han <jingning@google.com> | Thu Jul 07 11:59:22 2016 -0700 |
| committer | Jingning Han <jingning@google.com> | Thu Jul 07 12:00:38 2016 -0700 |
| tree | d4c1ca00c5a51885bc9cd359ea76b9a6e408fba9 | |
| parent | d5ddb56721fcbdf86160f714019eca5d97b9e243 [diff] |
Fix ioc in trellis optimization with hbd Use int64_t type for distortion. This avoids integer overflow issues in the trellis optimization function in high bit-depth settings. Change-Id: I550c3ca9f11a3191ef8638a152887018cd476141