Skip to content
Commit 51201a53 authored by Ian Tayler Lessa's avatar Ian Tayler Lessa
Browse files

Fix ULP bound for MAX_RESIZE mode



This now correctly computes the ULP bound relative to the maximum
absolute input, while previously we were computing it relative to the
reference output.

Extend the unit test coverage for max resize verification to catch
regressions and other bugs in bfloat16 and float16

Refactor a calcAbsErrorBound function matching the spec to use across
verification code.

Signed-off-by: Ian Tayler Lessa's avatarIan Tayler Lessa <ian.taylerlessa@arm.com>
Change-Id: I04b08d5d160258c560dbfde3b70247d76bf3f225
parent bc3ab19f
Loading
Loading
Loading
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment