I agree with you 100%.
N64 is one of those consoles that are really freaking hard to get right.
It's hard to emulate, and really freaking hard, I tried Mupen64, RetroArch and a lot of other emulators, but I still have problems to get games like Resident Evil 2 and Rogue Squadron working right.
Also, it's hard to get it to play nice in HDTVs.
The only option I can think of to manage to get N64 on an HDTV just fine is getting an Everdrive 64 for easy storage and access, but those shits are really hard to find and pricy as hell.
Second, getting an RGB/HDMI modded console or getting a AV to HD converter, something like the Enko converter might do the job, also worth it for other old consoles from NES and onwards.
And last, getting a freaking modded N64 controller which has the Gamecube analog stick, because fuck the original N64 analog stick.
That's the road I was intending to go, Everdrive 64 + Enko AV2HD converter + Modded N64 controller, but sadly I don't have the money to get the first one xD