am33xx: Stop modifying certain EMIF4D registers