ci: Use maxdepth option to clean up `DL_DIR`

Fix cache corruption during the pipeline run when deleting unused files
in the `DL_DIR` because of it being a git repository or tarball files.

Signed-off-by: Vikas Katariya <vikas.katariya@arm.com>