I've been using a timer under various settings and scenarios to determine which things affect load times the most. I'm still testing but my preliminary findings are fairly shocking...
Using ANY kind of playlist, regardless of format (old or new), playlist settings, or even the number of items in the playlist increased load times by about 20 seconds compared to loading them directly from the Load Content menu. This applied to Favorites and History as well, even if there was only one item in either of them. I've found no speed difference whatsoever between a playlist with 1 entry vs a playlist with 800 entries. Using playlists at all added about 20 seconds to ROM loading times.
Zipped vs unzipped was a much smaller difference. It was maybe just a second or two faster unzipped, at least with the smaller ROMs I've been testing with.
Also, Rgui is definitely the fastest menu driver. Fastest to boot, fastest to load ROMs and fastest to close content. The next-fastest was glui, which was an average of 4 seconds slower in each of those actions. XMB was about 11 seconds slower. Ozone was about 15 seconds slower.