Hateno Village and the Castle remain those locations that depend on the CPU power, not the GPU.
I also wrote a guide for Zelda BOTW modding and you can install the performance patch, it will help increase FPS a little more.
I can quote a review from one person with tests at a frequency of 650...