But there was not a gateway logoThat means you're in Gateway mode, just insert the red card and start playing games.
That's... Odd. Sounds like a cartridge issue more than an Emunand issue. Try the ol' blowing on the cartridge trick and give it another try. It should work.