I tried Pacman World using retroarch with pcsx rearmed libreto. graphics are fine but sound is a little bit glitchy.
OK, tried the first level of this game. Intro video/animation had a pop or two in the audio but the game itself played with steady audio and FPS was between 59-60.1.
That said, this particular game makes HEAVY use of CD Audio tracks. My copy of the game started as a proper rip (each track as a separate file) and I compressed it to a .chd file. If your copy wasn't properly ripped - and especially if you're still trying to use it as a bin/cue, multi-bin, or mds/mdf/ccd then you're working without audio compression and it's possible it just can't load the audio data fast enough from SD to keep up. I recommend making it into a PBP or, ideally a CHD if you can.
If you're already using a PBP or CHD, either (1) your config file isn't setup ideally, (2) your PBP/CHD was made from a bad rip, or (3) your SD card is a "fake" and/or has garbage read speeds. If you think it's config file related, you can try mine in the first post of this thread as that setup is working for me with this game and I'm not even using the read caching option that the CHD format allows you to use. It makes it possible to load ahead a bunch of game and audio data into RAM - ignoring the read speed limits and data loading patterns of original hardware. Again, the biggest change in my config over stock EverSD Retroarch is enabling "Threaded Video" so check that out first if you haven't already.