Skip to content
Commit 852a5d73 authored by Ian Tayler Lessa's avatar Ian Tayler Lessa Committed by Eric Kunze
Browse files

Update inexact round bounds and computation



The current version of the specification only allows output zero points
to be subtracted as integers, so the FP32 implementation was updated to
reflect that.

The error bound was fixed to now use the output before the zero point is
added to compute the error scale.

Signed-off-by: Ian Tayler Lessa's avatarIan Tayler Lessa <ian.taylerlessa@arm.com>
Change-Id: I5d2834b22180137880ffa905567ff1722d61c060
parent 18036bb6
Loading
Loading
Loading
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment