commit 6de4a77df349bd9072d2bf8f257602eb819f5e61
author Angie Chiang <angiebird@google.com> Thu Apr 14 15:16:08 2016 -0700
committer Angie Chiang <angiebird@google.com> Mon Apr 18 11:00:13 2016 -0700
tree 4d17e57385470b4add47a2cfa588e82a140c742c
parent 716f0ea3cf9efc3ca4ce53dc9f9b08e9234cd367

Remove double operation from tx_size selection

This CL fix the bug
rdopt.c:1687: choose_tx_size_from_rd: Assertion
`mbmi->tx_type == DCT_DCT' failed

It is caused by
1) mms register access before double operation
2) different compiler behaviors
code:
  int64_t a = INT64_MAX;
  double b = 1. * INT64_MAX;
  printf("a < b: %d\n", a < b);
result:
  a < b: 0

code:
  --target=x86-linux-gcc
  int64_t a = INT64_MAX;
  double b = 1. * INT64_MAX;
  printf("a < b: %d\n", a < b);
result:
  a < b: 1

I remove the double operation and test it with EXT_TX experiment.
The psnr change is around 0.05%, which is considered as noise level.

Change-Id: If8935c70c8603617fcfa8571accd30ccdda786a0