Is that USB 1.0? It's very slow, so such boot times could result.
It might also have to do with the graphics card. Do you have extensions mounted (showing in yellow during boot), and a "failed in waitforX" message?
edit: In general, such old computers don't have good compatibility with booting from USB, installing to the HD would be advisable.