Here's a new version (still pre-alpha) with hardware colorspace conversion, hardware JPEG encoding and a much more optimized USB transfer function: https://transfer.sh/VflAB/udcd_uvc.skprx
JPEG encoding by hardware takes at least around 86ms which means that unless I apply downscaling (to 480x272 for example) we won't get a lot of FPS.