gpio: pca953x: Clear the polarity invert register at init