You can't boot retail carts in GW mode unless you use
this.
To exit Smash without being booted back to sysNAND, you have to launch another application like Quick Rebooter or my dummy 'rebooter' (see the homebrew section for either of those two), or something like Nintendo Video/the camera app.