check-sr-results.yaml: allow empty temp folder

The temp folder is a spurious folder, which sometimes remains. Allow it to
be empty to avoid unnecessary errors.

Signed-off-by: Vincent Stehlé <vincent.stehle@arm.com>