Fragmentation itself is NOT the problem. I had files with 5 fragments which loaded just fine.
That probably depends what the fragments consist of. If you put untrimmed ROMs on your microSD, and some blocks of ROM fill data (0xFF) ends up somewhere else, it won't matter; that's my guess, at least.