At this point, I'm confident enough to say that there is no risk in downgrading if the update files you downloaded are legitimate. Check that they match your 3ds model, check their md5 sum, make sure they copy to the microSD completely and make sure to unmount your microsd before you remove it...