So, I fixed the arrangement, but it still didn't work with the arrow keys, BUT I got it working with WASD. Might be a bug?
So for example, DUp is configured as follows:
Key pressed
[KeyDown] KEY_W
[KeyUp] KEY_W
Key released
[KeyUp] KEY_W
Key held
[KeyDown] KEY_W
All the arrow keys now work...