Downgrading will stick out to Nintendo like a sore thumb when connecting online, especially where they have the ability to count fuse burns.
For example if you checked in with 5.1 yesterday, and check in with 3.0 tomorrow, HUGE red flag.
There's no reason currently to downgrade, so unless...