You need to configure your filezilla like that if your screenshot above is legit:
Even though its in german, you should be able to get it..
Then just press connect if both your computer and vita are in the same network.
If you have an error now, then something with your wifi or windows...