spi: designware_spi: Disable and free clock when remove driver