I also noticed the time of my Omega was wrong by a couple of seconds after one day, and obviously more after a lot of days, but I wasn't that bothered because when I re-set my Omega to the correct time the Pokemon in-game time was fine again.
Also, a failing battery can cause the RTC to not run...