Fix FPRoundInt's handling of INT64_MAX.

This fixes a bug caused by an implicit conversion from `int64_t` to
`double`, as well as several related warnings (from recent versions of
Clang) in the "frint" tests.

Change-Id: Ie5dccbf7a86c5e3a608570bd0ffc566bf3813380