Remove filter to skip float conversion tests

The conversions were previously not implemented for Neon. The
functionality and the tests have now been removed entirely. It is
intended that conversions will be re-added, except with Neon
implementations included.