Hacking Wii backup Manager for Windows

scrotty · Dec 16, 2009

VashTS said:
... Is it a problem that im trying to transfer to a NTFS formatted drive?... Nope just tried it formatted to FAT32 and still only copied 1 game...

I have the same problem - originally thought it was down to NTFS too but then discovered it wouldn't work with FAT either.

xzxero · Dec 16, 2009

VashTS said:
blah that sucks, good luck and the program looks sweet, i like the look better than WBFS Manager thank you for your work.

i decided to go with a fat32 and a WBFS partition. Im pretty sure its gotta be FAT32 Primary and active? then WBFS anyone can confirm sorry i know its offtopic

yeah set the FAT partiton as primary/active

fig2k4 · Dec 16, 2009

QUOTE said:
I got an ugly problem here...

Shit, yeah I see the problem. It's caused by some code that's used to close the partition after the transfer, to allow .tmp files to be renamed to .wbfs and deleting the source .wbfs files. Since the source is a WBFS drive, the partition shouldn't be closed. Obviously I can't test absolutely everything after each change, but I should've known about this one.

QUOTE said:

It transferred 89 games and then errored out saying something about integer overflow.
I'm sure I've already fixed that. I haven't had any errors, but that's only because I usually test smaller files since it's quicker. I noticed when I was writing some other code and remembered I used the same thing before and went back and fixed it. I'm 90% sure it's where that problem came from.

QUOTE

Click to expand...

I seem to remember that former versions transfered the selected games alphabetically, now the order is more or less random. just a thought ;-)

The transfers are in reverse order of whatever your column sort is. This is really only for historical reasons, where I was removing items from the files list after transfer. It was easier to do it in reverse order.

I'll try to revert some of my additions to get out a fix for these problems. There's no point introducing more experimental stuff just now until these are confirmed to be fixed.

icebrg5 · Dec 16, 2009

fig2k4 said:
QUOTE said:

It transferred 89 games and then errored out saying something about integer overflow.

Click to expand...

I'm sure I've already fixed that. I haven't had any errors, but that's only because I usually test smaller files since it's quicker. I noticed when I was writing some other code and remembered I used the same thing before and went back and fixed it. I'm 90% sure it's where that problem came from.

What version was this fixed in? Im using 0.3.1 beta

fig2k4 · Dec 16, 2009

Sorry, I meant I've fixed it in the code I have now..

icebrg5 · Dec 16, 2009

Gotcha.

So far its only happened twice and its still currently transferring games and has been for nearly the last 4 hours without any more issues.Still have almost 3 hours left according to it though so we shall see.

When will the next version be released?

pontomedon · Dec 16, 2009

I left the transfer (rar'd iso -> wbfs folder) running over night, got the "integer overflow" bug, but it seems to be fixed already, good news! Now running again, doesn't seem to have any problems so far.

I'm looking forward to the next version with wbfs->wbfs folder working and the int overflow bug removed!

edit: hmmm now that i see the wbfs file format: Do the folder names have to be this way? Would be nice if they would be named after titles.txt (of course without not-filename-compatibel characters like ':', but [A-z0-9\._-] and spaces are valid, everything else could be replaced by an underscore, for example)

fig2k4 · Dec 16, 2009

I've upped beta 2 with the fixes.

http://gbatemp.net/index.php?showtopic=188...t&p=2359707

I've tried to remove all the experimental stuff for now, with the exception of the CISO creation. If anyone wants to test that... Convert back and forth from CISOWBFS etc. a few times and play test it. There's no real way to check it byte for byte because it doesn't use the WBFS block size. Actually, there was never really was any way to check CISO like that, since it usually does depend on the block size. With WBFS->CISO->WBFS->CISO, the 2 CISOs should be identical though..

oggzee · Dec 16, 2009

oggzee said:
Ok I think I have solved the fragmentation issue.

By doing pre-allocation first and enable sparse right after that the files don't get so fragmented any more, but still has the sparse property.

Example:

For the .iso:
Fragments File Size Most fragmented files
163 4.38 GB \Temp\wii\RHAP01_PARTY_PACK_for_REVOLUTION.iso

and no fragmentation for the .wbfs

I will make a new version of wbfs_file today / tomorrow...
This is the code, if it helps:

CODEÂÂÂÂDWORD dw;
ÂÂÂÂLARGE_INTEGER noff;
ÂÂÂÂ//printf("off: %I64d\n", length);
ÂÂÂÂret = SetFilePointerEx(fh, (LARGE_INTEGER)length, &noff, FILE_BEGIN);
ÂÂÂÂif (ret == 0) {
ÂÂÂÂÂÂÂÂprint_error("SetFilePointerEx");
ÂÂÂÂÂÂÂÂreturn -1;
ÂÂÂÂ}
ÂÂÂÂ//printf("noff: %I64d\n", noff);
ÂÂÂÂret = SetEndOfFile(fh);
ÂÂÂÂif (ret == 0) {
ÂÂÂÂÂÂÂÂprint_error("SetEndOfFile");
ÂÂÂÂÂÂÂÂreturn -1;
ÂÂÂÂ}
ÂÂÂÂ
ÂÂÂÂ// enable sparse files on windows
ÂÂÂÂBOOL bRet = DeviceIoControl(fh, FSCTL_SET_SPARSE, NULL, 0, NULL, 0, &dw, NULL);
ÂÂÂÂif (!bRet) {
ÂÂÂÂÂÂÂÂprintf("file not sparse (%d)\n", (int)GetLastError());
ÂÂÂÂ}

scrotty · Dec 16, 2009

Well, it's fixed the problem of transferring only a single file for me so I'm happy

**EDIT**
Spoke too soon. Went to close the app after doing a few transfers and I now get Integer Overflow errors. I can only close the app by using task manager to kill it and now when I try to open it again I get an error saying 'unable to create directory'.

**EDIT**
Deleted the settings.ini and it's all back up and running - not sure why it didn't like it but we're up and running again now

fig2k4 · Dec 16, 2009

@oggzee
So it's just a case of allocating the final size before writing to the file.. It makes sense in a way.

Cheers for the code.

@scrotty
Any idea what settings were different?

scrotty · Dec 16, 2009

fig2k4 said:
@scrotty
Any idea what settings were different?

No idea mate - as far as I'm aware it's pretty much bog-standard. All I did was select drives 1 and 2, picked a few small games and did a transfer. All went OK until I closed the app and then it went tits-up. Deleted the ini file and did the exact same thing and this time it worked. Closed the app, reopened it no problem and it's now chugging it's way through a heap of games with no apparent problems.

pepxl · Dec 16, 2009

nice updates fig2k4, just wondering when the rename to customtitles will be implemented

thanks keep up the good work

dun4cheap · Dec 16, 2009

Fig,

First, I hope your child is feeling better. Nothing worse than your kid not feeling good.

Thanks for the new update. I went to try the transferring the games from my wbfs drive to my hard drive as CISO's and it is still reporting that I don't have enough room. I noticed the changelog for the updated 3.1 beta 2 sais it will remove duplicates. I have 80 gig left on my ciso storage drive and I am only missing 8 games so 80 gig should be plent unless the names are not matching. I was wondering if you could set this option in the select section, so I can visibly see which games are missing from my ciso collection compared to my drive. This will let me also debug and see if the problem is with the naming convention of my games or a bug.

thanks for any help and ideas.

pontomedon · Dec 16, 2009

I'm sorry having to report another bug:
129 of my 130 Games work fine but the 130th ("Secret Files: Tunguska") is causing problems:
I can add it to my fat drive, and it displays correctly, no errors in the log. but as soon as i unmount the disk and mount again it is displayed red and says invalid as name and 00000 as id. This happened two times now, and both times i renamed all games from titles.txt before unmounting. I'm currently adding it one more time to see if the renaming causes the problem. If i can reproduce the problem i will also post the log.

edit: It's the renaming: I think because it tries to rename it to the same string, just with changed case ("RTUPKM_SECRET FILES- TUNGUSKA" to "RTUPKM_Secret Files- Tunguska").

Here's the full log (I've stripped a lot of common lines and added a few comments)

<html>
<body backgroundcolor=gray>
<c>Wii Backup Manager Log 21:41:07</c> 
21:27:53 Log Started 
21:27:53 (DebugLevel) 3 
21:27:53 (ReadSettings) C:\Dokumente und Einstellungen\poseidon\Desktop\WiiBackupManager\settings.ini 
21:27:53 (Settings) PrevOpenFolder X:\cd Images\Wii 
21:27:53 (Settings) PrevSaveFolder 
21:27:53 (Settings) TempDir D:\WinRAR Temp 
21:27:53 (Settings) PartitionSelect 0 
21:27:53 (Settings) AddFolderRecurse true 
21:27:53 (Settings) ExtractRAROnAdd false 
21:27:53 (Settings) AllowDupFiles false 
21:27:53 (Settings) AllowAnyFSForFAT false 
21:27:53 (Settings) NTFSISO true 
21:27:53 (Settings) WBFSFileSize 2 
21:27:53 (Settings) UnitSize 0 
21:27:53 (Settings) TitlesLanguage 0 
21:27:53 (Settings) UseTitles true 
21:27:53 (Settings) WBFSFileUseFolders true 
21:27:53 (Settings) ConvertConventionOnMount true 
21:27:53 (Settings) AdvancedEntryEdit false 
21:27:53 (Settings) DriveBarColor 0 EBE9ED 
21:27:53 (Settings) DriveBarColor 1 000000 
21:27:53 (Settings) DriveBarColor 2 008000 
21:27:53 (Settings) DriveBarColor 3 00FF00 
21:27:53 (Settings) DriveBarColor 4 FF0000 
21:27:53 (Settings) ProgressBarColor 0 EBE9ED 
21:27:53 (Settings) ProgressBarColor 1 000000 
21:27:53 (Settings) ProgressBarColor 2 008000 
21:27:53 (Settings) ProgressBarColor 3 00FF00 
21:27:53 (Settings) ProgressBarColor 4 008000 
21:27:53 (Settings) LogColor 0 800080 
21:27:53 (Settings) LogColor 1 FF0000 
21:27:53 (Settings) LogColor 2 000080 
21:27:53 (Settings) LogColor 3 008000 
21:27:53 (Settings) TitleColor 0 000000 
21:27:53 (Settings) TitleColor 1 0000FF 
21:27:53 (Settings) TitleColor 2 800080 
21:27:53 (LoadTitles) Titles database version language: EN version: 20091216205731 
21:27:53 (LoadTitles) Titles found 2220 
21:27:53 (LoadCustomTitles) Custom titles disabled 
21:27:56 (MountDrive1Thread) Thread started 
21:27:56 (WiiDrive.OpenFromDrive) Opened successfully. I WBFS Folder (FAT32) 

(...) (...) (A lot "Opened volume" / "Added disc" entries) 

21:27:57 (MountDrive1Thread) Valid drive. Drive (I

- FAT32 
21:27:57 (ColumnSort) 0 ms 
21:27:57 (MountDrive1Thread) Found discs. 129 
21:27:57 (MountDrive1Thread) Thread terminated. 
21:27:59 (AddFolder) Folder dialog shown.. 
21:28:01 (AddFolder) Folder dialog returned true 
21:28:01 (SearchFoldersThread) Thread started 

(...) (...) (A lot "Found file" entries) 

21:28:03 Found files. 2111 
21:28:03 (SearchFoldersThread) Thread terminated. 
21:28:03 (SearchFoldersThread) Time taken. 00:00:02 
21:28:03 (AddFilesThread) Thread started 
21:28:03 (AddFilesThread) File count 2111 

(...) (...) (A lot "No valid files found in archive" and "Disc added" entries because of the multi part rar archives) 

21:28:49 (AddFilesThread) Valid discs added. 79 
21:28:49 (ColumnSort) 15 ms 
21:28:49 (AddFilesThread) Thread terminated. 
21:28:49 (AddFilesThread) Time taken. 00:00:45 
21:28:51 (AddFolder) Folder dialog shown.. 
21:28:57 (AddFolder) Folder dialog returned true 
21:28:57 (SearchFoldersThread) Thread started 

(...) (...) (A lot "Found file" entries (added a second folder ;-)) 

21:28:58 Found files. 1328 
21:28:58 (SearchFoldersThread) Thread terminated. 
21:28:58 (SearchFoldersThread) Time taken. 00:00:01 
21:28:58 (AddFilesThread) Thread started 
21:28:58 (AddFilesThread) File count 1328 

(...) (...) (A lot "No valid files found in archive" and "Disc added" entries because of the multi part rar archives) 

21:29:42 (AddFilesThread) Valid discs added. 51 
21:29:42 (ColumnSort) 16 ms 
21:29:42 (AddFilesThread) Thread terminated. 
21:29:42 (AddFilesThread) Time taken. 00:00:43 

(...) (...) (Here i started the transfer to Drive1) 

21:32:41 (FilesToDrive1Thread) Thread started 
21:32:41 (FilesToDrive1Thread) Disc count 1 
21:35:30 (WiiFatDrive.GetTempFilename) Created folder I:\wbfs\RTUPKM_SECRET FILES- TUNGUSKA 
21:35:30 (WiiFatDrive.OpenVolume) Created volume I:\wbfs\RTUPKM_SECRET FILES- TUNGUSKA\~416C.tmp 
21:38:47 (WiiFatDrive.OpenVolume) Created volume I:\wbfs\RTUPKM_SECRET FILES- TUNGUSKA\~416C.tm1 
21:38:53 (WiiFatDrive.OpenVolume) Opened volume I:\wbfs\RTUPKM_SECRET FILES- TUNGUSKA\~416C.tmp 
21:38:53 (WBFSPartition.AddDisc) Disc added successfully. RTUPKM SECRET FILES: TUNGUSKA 
21:38:53 (WBFSPartition.Trim) 4216 MB 
21:38:53 (WiiFatDrive.RenameTempFiles) Renamed ~416C.tmp RTUPKM.wbfs 
21:38:53 (WiiFatDrive.RenameTempFiles) Renamed ~416C.tm1 RTUPKM.wbf1 
21:38:54 (FilesToDrive1Thread) Refreshing drive. Drive (I

21:38:54 (FilesToDrive1Thread) Thread terminated. 
21:38:54 (FilesToDrive1Thread) Time taken. 00:06:11 
21:38:54 (MountDrive1Thread) Thread started 
21:38:54 (WiiDrive.OpenFromDrive) Opened successfully. I WBFS Folder (FAT32) 

(...) (...) (Again: A lot "Opened volume" / "Added disc" entries, among them the "Secret Files: Tunguska") 

21:39:08 (WiiFatDrive.OpenVolume) Opened volume I:\wbfs\RTUPKM_SECRET FILES- TUNGUSKA\RTUPKM.wbfs 
21:39:08 (MountDrive1Thread) Added disc. RTUPKM SECRET FILES: TUNGUSKA 
21:39:08 (MountDrive1Thread) Valid drive. Drive (I

- FAT32 
21:39:08 (ColumnSort) 0 ms 
21:39:08 (MountDrive1Thread) Found discs. 130 
21:39:08 (MountDrive1Thread) Thread terminated. 

(...) (...) (Here i remounted the drive - everything fine so far) 

21:39:27 (MountDrive1Thread) Thread started 
21:39:28 (WiiDrive.OpenFromDrive) Opened successfully. I WBFS Folder (FAT32) 

(...) (...) (Again: A lot "Opened volume" / "Added disc" entries, among them the "Secret Files: Tunguska") 

21:39:29 (WiiFatDrive.OpenVolume) Opened volume I:\wbfs\RTUPKM_SECRET FILES- TUNGUSKA\RTUPKM.wbfs 
21:39:29 (MountDrive1Thread) Added disc. RTUPKM SECRET FILES: TUNGUSKA 
21:39:29 (MountDrive1Thread) Valid drive. Drive (I

- FAT32 
21:39:29 (ColumnSort) 0 ms 
21:39:29 (MountDrive1Thread) Found discs. 130 
21:39:29 (MountDrive1Thread) Thread terminated. 

(...) (...) (Here i clicked the rename all button and there's an error, seems because windows doesn't like renaming when only the case changed) 

21:40:38 (RenameTitlesThread) Thread started 
21:40:39 (WiiFatDrive.OpenVolume) Opened volume I:\wbfs\RTUPKM_SECRET FILES- TUNGUSKA\RTUPKM.wbfs 
21:40:39 (WBFSPartition.UpdateActiveDisc) RTUPKM SECRET FILES: TUNGUSKA RTUPKM Secret Files: Tunguska 
21:40:39 (WiiFatDrive.OpenVolume) Opened volume I:\wbfs\RTUPKM_SECRET FILES- TUNGUSKA\RTUPKM.wbfs 
21:40:39 (WiiFatDrive.UpdateActiveDisc) Moved file I:\wbfs\RTUPKM_SECRET FILES- TUNGUSKA\RTUPKM.wbfs I:\wbfs\RTUPKM_Secret Files- Tunguska\RTUPKM.wbfs 
21:40:39 (WiiFatDrive.UpdateActiveDisc) Error Moving file I:\wbfs\RTUPKM_SECRET FILES- TUNGUSKA\RTUPKM.wbf1 I:\wbfs\RTUPKM_Secret Files- Tunguska\RTUPKM.wbf1 (Das System kann die angegebene Datei nicht finden) 
21:40:39 (WiiFatDrive.UpdateActiveDisc) Error deleting folder I:\wbfs\RTUPKM_SECRET FILES- TUNGUSKA (Das Verzeichnis ist nicht leer) 
21:40:39 (WiiFatDrive.OpenVolume) Opened volume I:\wbfs\RTUPKM_Secret Files- Tunguska\RTUPKM.wbfs 
21:40:39 (WBFSPartition.OpenFromHandle) Invalid HD sector count. Try enabling force mode. 
21:40:39 (ColumnSort) 0 ms 
21:40:39 (RenameTitlesThread) Thread terminated. 

(...) (...) (Remount again) 

21:40:44 (MountDrive1Thread) Thread started 
21:40:45 (WiiDrive.OpenFromDrive) Opened successfully. I WBFS Folder (FAT32) 

(...) (...) (Again: A lot "Opened volume" / "Added disc" entries, then as a last one:") 

21:40:46 (WiiFatDrive.OpenVolume) Opened volume I:\wbfs\RTUPKM_SECRET FILES- TUNGUSKA\RTUPKM.wbfs 
21:40:46 (WBFSPartition.OpenFromHandle) Invalid HD sector count. Try enabling force mode. 
21:40:46 (MountDrive1Thread) Invalid disc index. 129 
21:40:46 (MountDrive1Thread) Valid drive. Drive (I

- FAT32 
21:40:46 (ColumnSort) 16 ms 
21:40:46 (MountDrive1Thread) Found discs. 130 
21:40:46 (MountDrive1Thread) Thread terminated. 
</body>
</html>

edit2: yes, it's the case sensitivity problem. i tricked the program into renaming correctly by manually editing titles.txt two times ;-) No error this time!

TeenTin · Dec 16, 2009

@pontomedon

So, as long as you don't rename, there would be no problem at all. Right ?

pontomedon · Dec 16, 2009

yes, as i said, the problem is the renaming. without renaming theres no problem, and i managed to make the program rename it to the correct (lower case) name by editing titles.txt, first to "Secret Files: Tunguska_asdf", then renaming in the manager, then editing titles.txt back to original "Secret Files: Tunguska" and again renaming in the manager. Took me a while to figure out that titles.txt is only read at program startup, so i had to restart the manager after every action ;-)

TeenTin · Dec 16, 2009

Strange.

If the file is once made invalid, can it be fixed by your steps ? Or, it is needed to be transfer (made) again ?

pontomedon · Dec 17, 2009

i have to transfer again, because the game is larger than 4gb and the second file is deleted on the failed try to rename ;-).

I guess whats happening is (in unix commands):
CODEmkdir #fails because windows is not case sensitive and thinks the directory already exists
mv #does nothing because for windows newdir is the same as the old one
rmdir -r #fails because the manager has a lock on the .wbfs file, but .wbf1 etc are removed

so the result is that the folder doesn't change, but every wbfs file except for the first one (.wbfs) are removed.

fig2k4 · Dec 17, 2009

Thanks for testing that, I'll look into it just now.

Edit:
A quick look at the log shows that I really should be using case insensitive string comparisons.. That should fix it.

Also, I didn't think to take into account that multi-volume RAR files would be using the newer naming convention. ie *.part01.rar, *.part02.rar...

Edit2:
BTW, the reason the system can't find the file is because I delete it before the move. When moving a file from source to destination, the destination file can't already exist or the move will fail. So, I delete the destination first, if it exists. Obviously because of the case sensitivity, that messes things up here quite badly..

Edit3:
The reason I use Movefile() now instead of RenameFile() is because of the new folder layout. It correctly handles renaming from flat files, as oggzee put it, to files in sub-folders and vice versa, just in case the drive is using a different convention than you've selected in the settings. If the filenames are identical apart from the case, then RenameFile() should be used instead.

Hacking Wii backup Manager for Windows

Active Member

♥bong milk does good for the brain♥

Well-Known Member

Well-Known Member

Well-Known Member

Well-Known Member

Active Member

Well-Known Member

Well-Known Member

Active Member

Well-Known Member

Active Member

GFX W!Z4RD

Well-Known Member

Active Member

Well-Known Member

Active Member

Well-Known Member

Active Member

Well-Known Member

Similar threads

Popular threads in this forum