Homebrew Displacement occurs when playing WAV file

[Togetoge]

I make rhythm games using wav files.
Deviation occurs between when I play the game Notes and sound.
Is this a 3DS hard specification? Is there a way to avoid it?

 

[Spectral Blizzard]

IDK if this will help, but most 3DS audio is at 32000 hz, in a proprietary format, and at 292 kbps.