you don't need a mem stick to be present to be able to just turn it on so try taking it out completely... if it still persists, it's not the memstick... moreover if you have your psp plugged into an outlet, there should be no need for a battery at all, so something is definatly wrong there.
I...