xilinx: Introduce board_late_init_xilinx()