I got the same kind of problem before, when my 4GB MS Pro Duo suddenly corrupted (since it's a Class A product) and decided to reformat using the PSP's "Memory Stick Format" option under System Settings.
But after formatting it and put some games on it, some games (ex. DJMAX Portable 3) tend...