I am curious about the Right Joy-Con IR processing you have here. I do not have labo or 1-2 switch so I'm not sure how fast/what quality the console can typically capture at, but for those higher resolution streams is it possible to achieve a quicker poll? I tried manipulating settings like exposure, gain, de-noise, IR filter, etc. and the only thing that seemed to have a drastic effect on the frame rate was the resolution... Which is, naturally, the last thing I want to sacrifice for my purposes (interested in building a barcode capture tool for it). Not sure about the sensor register/value boxes. I'd hope for min. 4 FPS.
How much of the IR camera I/O format is really understood, at this point? I did check out the "Issue" thread on IR capture at the Reverse Engineering GitHub, however it seems you've made leaps and bounds of progress since your last message there.