Looks like it could be more serious than I thought.
The clock problem occurred on another of my PS2 (I switch of the power line when I don't use it, and the battery eventually died). However, the problem is not the same. Only clock settings are reset, the console kept language for instance...