pinctrl: at91-pio4: remove #ifdef CONFIG_PM_SLEEP

Remove #ifdef CONFIG_PM_SLEEP and use pm_sleep_ptr() macro instead.

Signed-off-by: Claudiu Beznea <claudiu.beznea@microchip.com>
Link: https://lore.kernel.org/r/20220704101253.808519-1-claudiu.beznea@microchip.com


Signed-off-by: Linus Walleij <linus.walleij@linaro.org>