Ok so i got to the old man who taught me how to use magic. How do get him to move all the books behind his desk?

 

You're probably past this point by now, but just in case:

After the old man teaches you how to stack magic, you need to go outside and talk to the people in the courtyard to unlock the next dungeon on the world map. iirc, it's the kids by the fountain.