ida: Remove assertions that an ID was allocated

Nobody finds value in asserting that an ID that we try to free was
already allocated, so just remove those assertions.

Signed-off-by: Matthew Wilcox (Oracle) <willy@infradead.org>