usb: kbd: Do not deregister usbkbd twice when using dm