Skip to content
Commit ee3475b8 authored by Ian Tayler Lessa's avatar Ian Tayler Lessa Committed by Jeremy Johnson
Browse files

Relax INEXACT_ROUND conformance



Update the bounds calculations to account for floating point rounding
when summing the output zero points in rescale.

Also add some unit tests for inexact rescale in the output_unsigned case
because the "signless" input value could easily be interpreted
incorrectly when converting to floating point.

Signed-off-by: Ian Tayler Lessa's avatarIan Tayler Lessa <ian.taylerlessa@arm.com>
Change-Id: Ia2b1fba90162b78772ce15c2f4fc3a521967b4b4
parent ce70c8da
Loading
Loading
Loading
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment