You have two options:
1. Open the SD card in RawkSD, select each song individually, and delete it.
2. View the card in CaitSith's DLC Manager and delete them there.
For either case, you should be able to play immediately after removing the tracks without re-running the Rawk Installet, although I could be wrong.