Actually they serve a purpose.
It's been found recently (literally in this decade) that our Galaxy is spinning downwards, and it's been since the beginning of time.
Turns out that the gravitatory force of said spin affects our solar system too.
So, our Sun is spinning downwards too, and thus, our very own planet is spinning downwards.
This movement, of course affects our Rotatory movement. This create small differences between each complete orbit around the sun. Thus, each year our Rotary movement gets kind of misadjusted each year.
Turns out (and I'm not making this up) that every single 4 years we kinda reset back to our original place within the Orbit around the Solar System.
Thus, Leap years helps us adjust to that Rotary effect misadjustments.