Google Git
Sign in
aomedia / avm / 5fb95f7d0296734021713569e0d12e0b34732b77
commit5fb95f7d0296734021713569e0d12e0b34732b77[log] [tgz]
authorUrvang Joshi <urvang@google.com>Fri May 05 17:36:16 2017 -0700
committerUrvang Joshi <urvang@google.com>Mon May 08 07:39:25 2017 +0000
tree85c5ca9d888f777791509c0d2cb9b3cdf719bd12
parent9395b34e2088fa266232e6fa8c7dfe63bb064254 [diff]
Palette: Handle case of too few unique centroids.

Even though number of unique colors in a block may be at least
PALETTE_MIN_SIZE, sometimes the K-means can generate fewer than
PALETTE_MIN_SIZE unique centroids due to integer rounding.

This was resulting in "k - PALETTE_MIN_SIZE" being negative and using
that as an index into palette_y_size_cost array was causing a UBSan
error.

BUG=aomedia:515

Change-Id: Ia00b4bb2efebbe43d1fec7b619ebb837b1ae961c
1 file changed
tree: 85c5ca9d888f777791509c0d2cb9b3cdf719bd12
  1. aom/
  2. aom_dsp/
  3. aom_mem/
  4. aom_ports/
  5. aom_scale/
  6. aom_util/
  7. av1/
  8. build/
  9. examples/
  10. test/
  11. third_party/
  12. tools/
  13. .clang-format
  14. .gitattributes
  15. .gitignore
  16. .mailmap
  17. aomdec.c
  18. aomenc.c
  19. aomenc.h
  20. aomstats.c
  21. aomstats.h
  22. args.c
  23. args.h
  24. AUTHORS
  25. CHANGELOG
  26. CMakeLists.txt
  27. codereview.settings
  28. configure
  29. docs.mk
  30. examples.mk
  31. ivfdec.c
  32. ivfdec.h
  33. ivfenc.c
  34. ivfenc.h
  35. keywords.dox
  36. libs.doxy_template
  37. libs.mk
  38. LICENSE
  39. mainpage.dox
  40. md5_utils.c
  41. md5_utils.h
  42. PATENTS
  43. rate_hist.c
  44. rate_hist.h
  45. README
  46. solution.mk
  47. tools_common.c
  48. tools_common.h
  49. usage.dox
  50. usage_cx.dox
  51. usage_dx.dox
  52. video_common.h
  53. video_reader.c
  54. video_reader.h
  55. video_writer.c
  56. video_writer.h
  57. warnings.c
  58. warnings.h
  59. webmdec.cc
  60. webmdec.h
  61. webmenc.cc
  62. webmenc.h
  63. y4menc.c
  64. y4menc.h
  65. y4minput.c
  66. y4minput.h