Rooting him up from his home, the life he knew, ruining his childhood and forcing him on some bogus quest that's not even of his choosing?
In their defense, his childhood WAS kind of sucking, and he was a total outcast... and the Deku Tree DID ask him if he would partake in this quest.
Also, who said he was talking about Ocarina of Time?
EDIT: Also, Wind Waker.
The Link of Ocarina of Time and Majora's Mask is the only one who carried the title "Hero of Time." Link in the Wind Waker is called the "Hero of Time, reborn," at least once in the game, but his official title was "Hero of Winds."
Also, personally, I'd like to think that because of the
Triforce of Courage (in most games) he sort of unconsciously possessed the skills and power of the Goddesses.