Hello, I solved the issue.
I had a hunch it was my USB stick and I tried everything to fix it. I found that by changing the loaders around as mentioned above, I could sometimes get my USB 3.2 Sandisk thumb drive to launch without issues (and without having to take it out and plug it in again)...