Skip to content
Commit 050792c2 authored by Johan Alfvén's avatar Johan Alfvén
Browse files

MLBEDSW-9889: MLCE: RSQRT int16 produces output diff 



 - Update LUT table generation for RSQRT int16 to use
float to match reference and avoid rounding issues

Change-Id: I1d9af2a2f682dccadc918736f9e40a2e3e1c4986
Signed-off-by: Johan Alfvén's avatarJohan Alfven <johan.alfven@arm.com>
parent aa2389c0
Hide whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment