This problem happened to my to, and i manged to fix it ... i have 502Gb of games, all in xci format.
it used to take up to 5 -10 min to scan every thing and now it take less than 5 second, here is how to fix it:
1- download "Switch Backup Manager" from here ...