Maybe your BIOS offers you a method to choose a secondary boot device - either on startup by pressing a key or in the BIOS configuration. But make sure, that you've installed a bootloader on the USB drive.
Good luck!