clk: rmobile: Assure SD-IF clock are configured correctly