[U-Boot] udelay/udelay_masked problems

Hi all, Is their a problem using udelay in board_init functions? When I do this on my at91, arm926ejs board, it seems to be in an endless loop. I thought this was a timer issue but I only have this problem with board init and not in the drivers. Does anyone have any ideas? Is timer_init a arch specific call or should it be board specific for arm?