[U-Boot] [PATCH] arm: socfpga: Fix delay in clock manager