Yuzu horrible performance randomly

[w00t5000]

I've just started dipping into Switch emulation via Fitgirl's repacks. I started playing Fire Emblem Three Houses and was getting a solid 30fps with no issues running the game with Vulkan pointing to my GPU.

However, randomly, when I start the game, it drops to a completely unplayable frame rate, like 1-4 fps just in the main menu. Tinkering with settings doesn't seem to help, disabling the Geforce overlay doesn't seem to help, it seems like something like one in fifteen tries I get the game to play smoothly. The GPU and RAM usage shoot up and even the Yuzu app itself performs sluggishly as I try to navigate file menus. Can anyone recommend any fixes?

EDIT: Looks like switching to OpenGL improves the performance for now. It displays a "loading shaders" progress bar while booting that Vulkan does not. If I delete the Vulkan shaders folder in an attempt to reload them, nothing repopulates. Am I safe to just use OpenGL or am I leaving performance on table not using Vulkan?

Specs

MSI B550 Gaming GEN3

Corsair 80 PLUS Bronze Certified 750W (cmpsu-750txv2)

ZOTAC GAMING GeForce GTX 1660 SUPER ZT-T16620F-10L

AMD Ryzen 5 5500

Corsair VENGEANCE LPX DDR4 16GB (2x8GB)

Kingston NV2 1TB M.2

 

[IchigoMait]

Don't use in adv graphics "force maximum clocks (vulkan only)" (drops fps by an insane amount) and "barrier feedback loops".
Those two are pretty much the worst settings for any game, latter causing loads of crashing or just doesn't load at all.
Also for this game don't use Accuracy Level High for it, instead use normal, the rest are like eh, still trying to tweak for a friend. It gets for some reason some weird slow downs, while fps drops too and then the audio is garbled, and if you try to move the mouse around or interact with anything then the emulator almost freezes, and then it's fine again for a while and then slows down again, constant repeated loop of it. Shaders have nothing to do with it.

Also make sure to restart the app after changing settings each time.

Edit: lel for some reason I had set in ProcessLasso for yuzu.exe cpu affinity 1-11 or something, removed that nonsense, now game runs smooth as butter.