| commit | 838a53d6236c7c09ca16ab784c3d3f492054420d | [log] [tgz] |
|---|---|---|
| author | David Barker <david.barker@argondesign.com> | Tue Nov 22 10:59:33 2016 +0000 |
| committer | Debargha Mukherjee <debargha@google.com> | Wed Nov 23 16:48:14 2016 +0000 |
| tree | 6c3f9bf7260d67a8cdd451d3928c3f40cd94b787 | |
| parent | 29c61068d7d20393380d2cb335c6c89f05b71344 [diff] |
Improve rectangular transform accuracy By adjusting the internal scaling and rounding in the transforms, we can adjust the maximum round-trip errors to: * 8x16 and 16x8: 0 pixel values (ie, transforms are exact) * 16x32: 1 pixel value * 32x16: 2 pixel values Change-Id: I0ba691a8d27042dcf1dd5ae81568d07a92d68781