I just attempted a downgrade on a New 3DS XL, Firmware was 10.3.0-28 EUR.
Before I attempted it I moved my DSi titles to the SD Card and then erased them from the SysNAND thinking they might interfere.
Then using Menuhax2.1 I started sysupdater (Julian's Libkhax Build) the first time it failed...