dm: pinctrl: Use right device pointer for configuring pinctrl