If you go into the menu of Not64 (just press reset on the wii), you should enable FB Textures.
This doesn't completely fix the problem, but it does speed up the menu access and close.
I went from 5-7 seconds menu opening, to down to 2-3 seconds menu opening, and 1/2 second to close the menu.