If you're concerned about it, which makes sense considering the number of people who've posted similar issues in the past, then you should avoid swapping cards. Get a big enough card and stick with it, and use ftp transfers, usb installs etc. The last time I removed my card from my Switch was when I set up Android on it sometime last year.