You're probably going to need to keep your wifi adapter off then, as there is no known way to fix it.Have someone's 3DS here that has the exact same problem, shutting off the wifi seems to stop the problem for me to...
If it helps, the console seems to not be able to connect to any nearby access points for the time that it is on.






