Nah you are not dumb, it is just the way retroarch is it takes a bit to figure things out with it since all the emulators are linked together in a way.I'm dumb. It can be changed through Settings > Input > Input User 1 Binds or through retroarch.cfg
Going to take me a while to figure it out completely but it does work.
--------------------- MERGED ---------------------------
Try out a nes emulator that comes with retroarch called "quicknes". That is full speed on o3ds for the most part. I never had any slowdown issues.I just installed the FCEUMM core for NES from the latest nightly on an O3DS with CakesFW 10.3 emunand, it runs abysmally, totally unplayable. I'm fairly certain the O3DS can handle NES emulation when running off CIA so what's wrong? I tried rolling back a few weeks and no change.

