After I uninstalled the Badge Arcade and disabled all my badges, sorting out all the icons in my home screen in the process, this miraculously worked on the second try!
With badges on my screen it just froze there, so I think that may be a problem...