[PATCH] Revert "ARM: uniphier: add weird workaround code for LD20"