net: designware: Add driver remove support