Thanks a lot! I am sorry for confusing you.
But the fact is that the 2 boards are connected as the following drawing. The hardware is designed as this. I need to download kernel for board 2 from hard drive of board 1. Usually switch cannot talk to switch without bridge or router. So in this case I think I need VPN in order to download the kernel using tftp.
HD----CPU1 ----switch1 ------switch 2----CPU2 (uboot)
|----------board 1------ ---|-------------board 2--------------|