When you don't hold L, your Vita won't get to the home screen, right?
When you hold L, your Vita boots, but, all homebrew is removed, right?
You can't remove the plugin without homebrew, so there's nothing you can do to remove it, to get it to turn on without L.
So, while you have held down L...