Homebrew WiiU FTP Server (use WUT, fix inject failures and increase bandwith)

[Laf111]

The app store version yeah. FTPiiU_Everywhere v0.4u2 by dimok and fix94.
The one with "for CBHC" in the icon.

Ok, thanks,

That's weird, this version gives me lower transfert rate on my side...
Have you checked the 2 versions at the same moment (in same conditions) ?

For the returning to HBL menu issue, i'm aware of that but i'd like to focus on the bandwith first.
Have a nice day

 

[Laf111]

The app store version yeah. FTPiiU_Everywhere v0.4u2 by dimok and fix94.
The one with "for CBHC" in the icon.

V5 is out : 2.5 times faster than FTPiiU_Everywhere v0.4u2 for download and 10 times faster for upload


https://github.com/Laf111/WiiUFtpServer/releases/download/V5/HBL-WiiUFtpServer.zip

 

[rjwboys2]

NOTES :
The server does not implement the MTDM function (and so does not preserves files timestamps) but now displays the correct dates

will this ever get Implemented... my ftp client of choice which I'm, used to Filezilla seems to always want to use mtdm and failed the upload when it tries to use it, i read a different post to use a different ftp winscp... i found a alternative for Linux crossftp but its
confusing

 

[depaul]

Great improvement. @jacobsson might be interested he was searching a while ago how to optimize transfer from/to Wii U.

 

[Laf111]

will this ever get Implemented... my ftp client of choice which I'm, used to Filezilla seems to always want to use mtdm and failed the upload when it tries to use it, i read a different post to use a different ftp winscp... i found a alternative for Linux crossftp but its
confusing

No and i don't think it is possible (system functions are buggy and not stables).

I recommend you WinScp where you can define the criterion to use.

EDIT : in FilleZilla, the setting seems to be in Menu / View / Directories comparison / Compare filesize

 

[V10lator]

No and i don't think it is possible

AFAIK Aroma CFW (not yet released) has a FTP plugin which supports this, so it should be possible. You might want to get in contact with @Maschell for details.

 

[godreborn]

I installed this just now (the channel version). the incomplete injection might be what happened to @MikaDubbz with his menu. I used ftpii u everywhere as well with that same menu, and it would start, then stop, start then stop at about 50KB/s. I didn't think it went through, but I compared the sizes of the original file with what was uploaded and they were the same. menu works, but boy did it take a while for something so small (maybe 2 minutes with ftpii u everywhere). I've only tested this ftp app with deleting the channel version install files from the install folder. the real test will be while MikaDubbz releases his dark menu.

 

[rjwboys2]

No and i don't think it is possible (system functions are buggy and not stables).

I recommend you WinScp where you can define the criterion to use.

yeah i got winscp running under WINE now and it works great after i changed how it called for directories as it wasn't listing the sdcard till i told it to not MLSD for directory listing

EDIT : in FilleZilla, the setting seems to be in Menu / View / Directories comparison / Compare filesize

that didn't do anything about MTDM it still used it after i messed with that setting, all it did was put colors in the two windows to show file size differences, read online the Filezilla forums and... it seems others are have trouble with it, told the DEV, and the DEV doesn't care... and saw on the people that make the code for ftp forgot which forum i found it on as i can't find it in my history lol, said that FileZilla isn't following the rules of RFC and is using the wrong code for setting time stamps and should be useing MFMT


also found quarks of FileZilla and crossftp before i used winscp,
both had trouble deleteing files,
filezilla couldn't transfer files over due to mtdm of course

oh and none can rename, not even winscp have to delete then transfer over the correct named file
of course that could be that im running winscp via wine on ubuntu lunix... but the responce is 550 success

 

[Laf111]

2021/08/12 V5-1 :
> now allow simultaneous tranferts also for upload (client -> server)
> restore FTP thread (fixing v4-5 issue)
> fix to 1 client max with 6 connections max
> add a socket optimization : Suppress delayed ACKs
> bring the channel version transferts speeds close to the HBL one

https://github.com/Laf111/WiiUFtpServer/releases/latest

 

[jacobsson]

Great improvement. @jacobsson might be interested he was searching a while ago how to optimize transfer from/to Wii U.

I appreciate the info! Will have a look

 

[AlexoC]

Well, I tried use channel version, and it works.
Before with ftpiiu everywhere the transfer was usually 100 KiB/s with FileZilla
Now the transfer is 700 KiB/s (with FileZilla )
Thanks so much!

EDIT: After a while, the app goes crazy and passes all the files at once, obviously passing all the files wrong

 

[Laf111]

After a while, the app goes crazy and passes all the files at once, obviously passing all the files wrong

Thank you for your feedback.
I'm aware of this. Set only 1 simultaneous transfert on your FTP client seems to avoid issues.
Next version will fix the max simultaneous transferts to 1

 

[Laf111]

EDIT: After a while, the app goes crazy and passes all the files at once, obviously passing all the files wrong

2021/09/01 V5-2 :
> mount NAND paths ONLY if asked (by pressing B) : a very good idea from Masana@GBATemp, thanks!!!
> if auto shudown feature is enabled, pressing DOWN toggle the feature OFF/ON
> add a verbose mode for server log (disable by default) that can be toggled with UP
> longer value for internal timeout to avoid data transfer deconnexions
> only 1 simultaneous tranfers for up/download (fix deconnexion and others issues)
> WUT is now also used for HBL version (since now it performs like dynamic libs one)
> add some socket optimizations :
- Leave received OOB data in line (SO_OOBINLINE)
- Disable slow start feature (SO_NOSLOWSTART)
- Socket memory optimization (thanks to V10lator@GBATemp for your support!!!)
> now channel version exit to Wii-u Menu

 

[Laf111]

2021/09/02 V6 :
> fix a display issue when exit (missing a draw call)
> + 10% speed (UL/DL) with using a double sized buffer (corresponding to the size
really allocated by the system when using setsockopt on SO_RCVBUF & SO_SNDBUF)

https://1drv.ms/u/s!Apr2zdKB1g7fgwGjHRA9C3GTxpUx?e=XWAnYu

 

[meeeow]

Great tool! Big speed improvement, and the possibility to just mount the sd card and to return to the menu are nice features.
Being able to add a USERW is probably not necessary since the server is only running for a short time (and in a private network)

I do a backup of my sd-card using the rsync command on a linux os from time to time. From time to time, because I am to lazy to take the card to my computer, start it, do the backup, bring it back. Given the speed improvement, I wrote a bash script that uses lftp's mirror command.

Well, the syncing gets slow in (sub)directories with many files like "retroarch/assets/xmb/*/png" (I don't know why but it works perfectly for quickly backing up some save game / configuration files). Anyway, in case anyone is interested in using and/or improving it:


#!/bin/bash
#USER="user"
#PASS="pw"
#HOST="192.168.foo.bar"
#URL="ftp://$USER:$PASS@$HOST"
URL="192.168.foo.bar"
LOCAL_DIR="/your/local/dir"
REMOTE_DIR="storage_sdcard"

# delete option is disabled by default
#DELETE="--delete"

# do the mirroring
lftp $URL <<EOF
set ftp:use-mdtm off
mirror --verbose \
$DELETE \
$REMOTE_DIR $LOCAL_DIR \
--exclude retroarch/assets/assets/xmb \
--exclude retroarch/assets/cheats \
--exclude install \
--exclude games \
--exclude wbfs
EOF

# some templates for exclude-glob
# --exclude-glob a-dir-to-exclude/ \
# --exclude-glob a-file-to-exclude \
# --exclude-glob a-file-group-to-exclude* \
# --exclude-glob other-files-to-exclude"

 

[Laf111]

the possibility to just mount the sd card

a very good idea from Masana !

 

[Laf111]

V6 with Ethernet connection (USB adapter / LAN / Ethernet 5)

 

[Laf111]

2021/10/12 V6-1 :

> Wii-U PRO controller and WiiMote support. Thanks godreborn@GBATemp for testing!
> tweaks for maximum performance :
+10% DL speed compare to V6
+70% UL speed (UL is now faster than DL)
> enhance robustness (fix errors -99, -100, ENOMEM, ECONABORTED...). thanks Masana@GBATemp for testing!
> add a NAND backup/restore process :
- when you choose to mount NAND paths, if no backup is found in WiiuFtpServer app folder on the SDcard,
create a partial (2MB) or a FULL system files NAND backup (500MB free on SD card are requiered)
- if you brick your Wii-U with NO NETWORK AVAILABLE (so you can't start FTP) : restore only the files
needed (partial backup ones) to get WiiuFtpServer working again (then unbrick as the usual way)

 

[Laf111]

 

[godreborn]

@Laf111 , still up, so I just updated both and tested the channel version by deleting the install folder for wii u ftp server.