Hacking wwt+wit: Wiimms WBFS+ISO Tools

Wiimm · Jan 3, 2010

deo said:
Hey Wiimm,

I just pulled rev544 from SVN and I'm still seen the 'chmod' call in the gen-template.sh file...

Another issue: the CP_FLAGS from the install.sh are also incompatible with the BSD version of cp. Any special reason about why cp/mv/rm is being used, instead of the more traditional way (install)?

Consider this additional patch:

I will change this. I have never noticed the 'install' command before. I will give it a chance.

Wiimm · Jan 3, 2010

pvanwelt said:
I am using a wd passport 320 GB drive to play games on my wii.
A month ago I could not play games anymore and then I used the wimms tool to repair my WBFS partition.

However now it doesn't recognize my device again, but when I try to use the wwt tool, it says no WBFS partition found.
but with wbfs manager I can see my device with all games on it.

I am a bit confused, do I need to do something another way ?
wwt looks into the partitions and search the "WBFS" magic and makes some plausibility checks. Only partitions/files which pass both are valid WBFS.

Skeeve said:

And a short question. What exactly does this message suggest?
-------------------------------------------------------------------------------
$ ./wwt fsck
***** wwt: Wiimms WBFS Tool v0.23a r544 mac - Dirk Clemens - 2010-01-02 *****

CHECK /dev/disk6s1

* Summary of WBFS Check: 8 errors found:
8 free WBFS sectors marked as used!
Note: 8 errors are based on a bug in libwbfs v0.
-------------------------------------------------------------------------------
The libwbfs implementation of (nearly) all others progs have a bug:
They can't use the last blocks of the WBFS. I have changed this in my libwbfs and called this "libwbfs v1". Details: Free Blocks Table and Bugs

QUOTE(Skeeve @ Jan 2 2010, 09:29 AM)

Click to expand...

(Update) I think I will like the tool. But it gives me a riddel. What am I missing here?
-------------------------------------------------------------------------------
$ ./wwt -d /Volumes/HOMEBREW/isoetc/wdf/ --wdf -z -x RELPA4 --auto X
***** wwt: Wiimms WBFS Tool v0.23a r544 mac - Dirk Clemens - 2010-01-02 *****
!! wwt: ERROR #19 [MISSING PARAMETERS] in cmd_extract() @ wwt.c#2073
!! missing parameters
-------------------------------------------------------------------------------

(Update 2) sorted! I just had to add a wildcard for the ID6s to extract:
./wwt -d /Volumes/HOMEBREW/isoetc/wdf/ --wdf -z -x RELPA4 --auto X \*

The extract command needs at least one parameter that tells wwt which images should be extracted. Use '+' for all images.

Wiimm · Jan 3, 2010

zx3junglist said:
Hi Wiimm,

fantastic tools, thank you. I have a question, I'm using "wit" to scrub .iso files into .wbfs to my NTFS disk. The format that usb loaders are expecting is ./wbfs/GAMEID_gametitle/GAMEID.wbfs. My USB drive is mounted at /media/Wii. So, when I use wit I do something like:

Code:

wit SCRUB -B -s SOURCE.iso -d /media/Wii/wbfs/%I_%T/%I.wbfs

this works fantastic for titles that have one word, but it gives an error message for any titles with a space in the title. I'm assuming it's the linux os that is disallowing this, since a space character needs to be escaped with a backslash "\". Is there a way for me to get this to work? If so, I can automate it with a script rather than having a more time-intensive process.

Thanks
-ZX

I will work on this. There is "directory creating" problem too.

Skeeve · Jan 3, 2010

I LIKE WWT!

Many thanks for this great stuff! No more need to start an XP in a VirtualBox just to get my WPFS partition managed.

Wiimm · Jan 3, 2010

wwt: Wiimms WBFS Tool v0.24a - 2010-01-03
A command line WBFS tool set for various os.

I have updated the tool. The first post with more details is updated too.

Download:

wwt-v0.24a-r549-i386.tar.gz : linux/i386 version
wwt-v0.24a-r549-cygwin.zip : cygwin (win32) version

Last changes:

Code:

wwt v0.23a r544 - 2009-12-31

- Formatting will clear all inodes. That gives undelte a better chance.
ÂÂ In respect to sparse files the inodes will be read before and only zeroed
ÂÂ if non zero data is found.
- CYGWIN: The filenames beginning "x:/" will be replaced by "/cygdrive/x/".

wwt v0.24a r549 - 2010-01-03

- Suppress a read error if reading behind end of file while creating a
ÂÂ growing wbfs (copy to wbfs file with a singe disc).
- If the destination path of a copy command contains at least 1 valid
ÂÂ %-escape conversion than the directory path will be created automatically.
- CYGWIN bugfix: Unclear bug while rename "x:/" to "/cygdrive/x/".
ÂÂ Now we have a small memory leak (The original filename is not freed).
- Script 'install.sh' use now the system command 'install'.

Sources comes with GPL2. Checkout the sources directly from the SVN repository or browse the source.

Wiimm · Jan 3, 2010

zx3junglist said:
Hi Wiimm,

fantastic tools, thank you. I have a question, I'm using "wit" to scrub .iso files into .wbfs to my NTFS disk. The format that usb loaders are expecting is ./wbfs/GAMEID_gametitle/GAMEID.wbfs. My USB drive is mounted at /media/Wii. So, when I use wit I do something like:

Code:

wit SCRUB -B -s SOURCE.iso -d /media/Wii/wbfs/%I_%T/%I.wbfs

this works fantastic for titles that have one word, but it gives an error message for any titles with a space in the title. I'm assuming it's the linux os that is disallowing this, since a space character needs to be escaped with a backslash "\". Is there a way for me to get this to work? If so, I can automate it with a script rather than having a more time-intensive process.

Thanks
-ZX

It should now work. But the command is not SCRUB, it is COPY.

drh · Jan 3, 2010

Today I cam across a with a Wii file with a ciso extension.

This seems to be a hang-over from the PSP scene.

I have scoured the internet and its not a widly supported format on the Wii, by the looks of it and where it is supported, its only through Windoz WBFS Managers.

It seems a complete waste of time too since the compression between a scrubbed ISO and a CISO is negligable anyway but before I delete it and move on, anyone know if I can recover this file to a readable format on MAC OSX?

Wiimm · Jan 3, 2010

I searching for any info about CISO, plain text is the best.

myron0815 · Jan 3, 2010

useing wit - great tool, but some suggestions:

1) i need an easy way to rename the FILENAME only (with "rename" i am able to rename the internal ID;
and with move '%X' it is not intuitive (or have i overlooked something?!)
(i like clear filenames

1a) move rename gives some error, but works

Code:

K:\WII\>wit.exe move "xxx.iso" -d .. '%X'
*****ÂÂwit: Wiimms ISO Tool v0.24a r549 cygwin - Dirk Clemens - 2010-01-03ÂÂ*****
- Move ISO:xxx.iso -> ../Anno - Create a New World [RN4P41].iso
!! e:wit: ERROR #12 [CAN'T OPEN FILE] in SetupReadSF() @ lib-sf.c#166
!!ÂÂÂÂÂÂÂÂCan't open file: %X

2) where do you get the naming for %X ?!
Its not the name in the iso... and its not the name in your supplied title*.txts
(My PAL backup gets renamed to "Anno - Create a New World [RN4P41].iso" - but it is everywhere spelled with "Anno: Create..." (with colon)
Maybe you could query wiitdb.com?! (or support a local copy?!)
(\\/:|\" of course have to be replaced by some underscore)

Bauldrick · Jan 3, 2010

Wiimm - I wanted to make sure I had all the .wdf images from my HDD enclosure (/dev/sdb) backed up on my NAS hdd, so I used this command (is probably wrong).

Code:

sudo wwt -a -vvv EXTRACT *

This gives me alot of error #11 (FILE ALREADY EXISTS) - which is good because those are on the NAS already. Anyway here is a bit of the output:

Code:

!! wwt: ERROR #11 [FILE ALREADY EXISTS] in cmd_extract() @ wwt.c#2185
!!ÂÂÂÂÂÂFile already exists: Jelly Belly Ballistic Beans [R7BP7J].wdf
- EXTRACT RL4P64 -> WDF:Lego Indiana Jones 2 - The Adventure Continues [RL4P64].wdf
!! wwt: ERROR #11 [FILE ALREADY EXISTS] in cmd_extract() @ wwt.c#2185
!!ÂÂÂÂÂÂFile already exists: Lego Indiana Jones 2 - The Adventure Continues [RL4P64].wdf
- EXTRACT RLGP64 -> WDF:Lego Star Wars - The Complete Saga [RLGP64].wdf
!! wwt: ERROR #15 [READ FILE FAILED] in WrapperReadSector() @ lib-std.c#2667
!!ÂÂÂÂÂÂRead failed [F=3,88fc00000+200000]: /dev/sdb
!!ÂÂÂÂÂÂ-> Input/output error
!! wwt: ERROR #18 [WBFS ERROR] in wbfs_extract_disc() @ libwbfs/libwbfs.c#1266
!!ÂÂÂÂÂÂreading disc
ÂÂÂÂÂÂ987 MiB copied in 12:28.321,ÂÂ1.3 MiB/sec
!! wwt: ERROR #18 [WBFS ERROR] in cmd_extract() @ wwt.c#2207
!!ÂÂÂÂÂÂCan't extract disc [RLGP64] @/dev/sdb
- EXTRACT RL4P64 -> WDF:Lego Indiana Jones 2 - The Adventure Continues [RL4P64].wdf
!! wwt: ERROR #11 [FILE ALREADY EXISTS] in cmd_extract() @ wwt.c#2185
!!ÂÂÂÂÂÂFile already exists: Lego Indiana Jones 2 - The Adventure Continues [RL4P64].wdf

===SNIP===

- EXTRACT RQNEWR -> WDF:Scooby-Doo! First Frights [RQNEWR].wdf
!! wwt: ERROR #11 [FILE ALREADY EXISTS] in cmd_extract() @ wwt.c#2185
!!ÂÂÂÂÂÂFile already exists: Scooby-Doo! First Frights [RQNEWR].wdf
- EXTRACT RVHP41 -> WDF:Scrabble Interactive - 2009 Edition [RVHP41].wdf
!! wwt: ERROR #11 [FILE ALREADY EXISTS] in cmd_extract() @ wwt.c#2185
!!ÂÂÂÂÂÂFile already exists: Scrabble Interactive - 2009 Edition [RVHP41].wdf
- EXTRACT RIDP7J -> WDF:Smiley World - Island Challenge [RIDP7J].wdf
!! wwt: ERROR #11 [FILE ALREADY EXISTS] in cmd_extract() @ wwt.c#2185
!!ÂÂÂÂÂÂFile already exists: Smiley World - Island Challenge [RIDP7J].wdf
- EXTRACT RSAP78 -> WDF:SpongeBob's Atlantis SquarePantis [RSAP78].wdf
!! wwt: ERROR #18 [WBFS ERROR] in wbfs_extract_disc() @ libwbfs/libwbfs.c#1266
!!ÂÂÂÂÂÂreading disc
ÂÂÂÂÂÂÂÂ0 MiB copied in 0:00.019,ÂÂ0.0 MiB/sec
!! wwt: ERROR #18 [WBFS ERROR] in cmd_extract() @ wwt.c#2207
!!ÂÂÂÂÂÂCan't extract disc [RSAP78] @/dev/sdb
- EXTRACT R2SP18 -> WDF:Sports Island 2 [R2SP18].wdf
!! wwt: ERROR #11 [FILE ALREADY EXISTS] in cmd_extract() @ wwt.c#2185
!!ÂÂÂÂÂÂFile already exists: Sports Island 2 [R2SP18].wdf
- EXTRACT RDXP18 -> WDF:Sports Island [RDXP18].wdf
!! wwt: ERROR #11 [FILE ALREADY EXISTS] in cmd_extract() @ wwt.c#2185
!!ÂÂÂÂÂÂFile already exists: Sports Island [RDXP18].wdf
- EXTRACT RLFP64 -> WDF:Star Wars - The Clone Wars Lightsaber Duels [RLFP64].wdf
!! wwt: ERROR #11 [FILE ALREADY EXISTS] in cmd_extract() @ wwt.c#2185
!!ÂÂÂÂÂÂFile already exists: Star Wars - The Clone Wars Lightsaber Duels [RLFP64].wdf
- EXTRACT R9OE69 -> WDF:Tiger Woods PGA Tour 10 [R9OE69].wdf
!! wwt: ERROR #11 [FILE ALREADY EXISTS] in cmd_extract() @ wwt.c#2185
!!ÂÂÂÂÂÂFile already exists: Tiger Woods PGA Tour 10 [R9OE69].wdf
- EXTRACT RWHP4F -> WDF:Top Trumps - Doctor Who [RWHP4F].wdf
!! wwt: ERROR #11 [FILE ALREADY EXISTS] in cmd_extract() @ wwt.c#2185
!!ÂÂÂÂÂÂFile already exists: Top Trumps - Doctor Who [RWHP4F].wdf
- EXTRACT R5IX4Q -> WDF:Toy Story Mania! [R5IX4Q].wdf
!! wwt: ERROR #11 [FILE ALREADY EXISTS] in cmd_extract() @ wwt.c#2185
!!ÂÂÂÂÂÂFile already exists: Toy Story Mania! [R5IX4Q].wdf

The original error #18 ( - EXTRACT RLGP64 -> WDF:Lego Star Wars - The Complete Saga [RLGP64].wdf ) is already on the NAS as is the next error #18 ( - EXTRACT RSAP78 -> WDF:SpongeBob's Atlantis SquarePantis [RSAP78].wdf )

I think actually the HDD (/dev/sdb) might be bad? Trying to extract individualy gives:

Code:

WBFSv1 #1 opened: /dev/sdb
SCAN TITLE FILE /usr/local/share/wwt/titles.txt
! wwt: Title file not found: titles.local.txt
- EXTRACT RSAP78 -> WDF:SpongeBob's Atlantis SquarePantis [RSAP78].wdf
!! wwt: ERROR #15 [READ FILE FAILED] in WrapperReadSector() @ lib-std.c#2667
!!ÂÂÂÂÂÂRead failed [F=3,514000000+200000]: /dev/sdb
!!ÂÂÂÂÂÂ-> Input/output error
!! wwt: ERROR #18 [WBFS ERROR] in wbfs_extract_disc() @ libwbfs/libwbfs.c#1266
!!ÂÂÂÂÂÂreading disc
ÂÂÂÂÂÂ551 MiB copied in 7:36.523,ÂÂ1.2 MiB/sec
!! wwt: ERROR #18 [WBFS ERROR] in cmd_extract() @ wwt.c#2207
!!ÂÂÂÂÂÂCan't extract disc [RSAP78] @/dev/sdb

! wwt: Disc [RSAP78] not found.

But why is it trying to extract that when it's already on the NAS?

Code:

matt@LinkStation2:/home/wii_games$ ls

-----
Smiley World - Island Challenge [RIDP7J].wdf
Spiderwick.wdf
Spongebob's Atlantis Squarepantis [RSAP78].wdf
Sports Island 2 [R2SP18].wdf
------

Wiimm · Jan 3, 2010

@myron0815:
1.) try: wit move xxx.iso ../%X
2.) I use the title database of wiitdb and translate special characters in a way i like.

@Bauldrick:
The * is be expanded by the shell simulation in cygwin. Escape it with apostrophs or just use + instead.

Use --update to extract only non existing files or --overwrite to overwrite them. A renaming/backup scheme is not implemented. For this extract in a temp dir and use 'mv --backup=...'.

Wiimm · Jan 4, 2010

wwt: Wiimms WBFS Tool v0.25a - 2010-01-04
A command line WBFS tool set for various os.

I have updated the tool. The first post with more details is updated too.

Download:

wwt-v0.25a-r558-i386.tar.gz : linux/i386 version
wwt-v0.25a-r558-cygwin.zip : cygwin (win32) version

Last changes:

Code:

wwt v0.24a r549 - 2010-01-03

- Suppress a read error if reading behind end of file while creating a
ÂÂ growing wbfs (copy to wbfs file with a sinlge disc).
- If the destination path of a copy command contains at least 1 valid
ÂÂ %-escape conversion than the directory path will be created automatically.
- CYGWIN bugfix: Unclear bug while rename "x:/" to "/cygdrive/x/".
ÂÂ Now we have a small memory leak (The original filename is not freed).
- Script 'install.sh' use now the system command 'install'.

wwt v0.25a r558 - 2010-01-04

- wwt REMOVE: Print id6 and (that's new) title of removed discs.
- wwt EXTRACT+REMOVE: No warning if parameters are given, but no disc found
ÂÂ because of exclude lists.
- New option: --DEST (-D): Works like --dest (-d), but the directory path
ÂÂ of the destination files will be created automatically.

Sources comes with GPL2. Checkout the sources directly from the SVN repository or browse the source.

NReale3370 · Jan 4, 2010

Wonderful just the updates I had been hoping for...thank you so much for your hard work on what's definitely THE best WBFS manager

Wiimm · Jan 5, 2010

wwt: Wiimms WBFS Tool v0.26a - 2010-01-05
A command line WBFS tool set for various os.

I have updated the tool. The first post with more details is updated too.

Download:

wwt-v0.26a-r569-i386.tar.gz : linux/i386 version
wwt-v0.26a-r569-cygwin.zip : cygwin (win32) version

Last changes:

Code:

wwt v0.25a r558 - 2010-01-04

- wwt REMOVE: Print id6 and (that's new) title of removed discs.
- wwt EXTRACT+REMOVE: No warning if parameters are given, but no disc found
ÂÂ because of exclude and/or include lists.
- New option: --DEST (-D): Works like --dest (-d), but the directory pathes
ÂÂ of the destination files will be created automatically.

wwt v0.26a r569 - 2010-01-05

- cygwin: stdout and stderr use windows line ending (CR+LF).
- Allow german umlaut in destination file names.
- Bug fix: Option --include-path was only proccessed if also option
ÂÂ --exclude-path was set.
- The local title files contain now all titles and not only the local
ÂÂ modifications. This is good for cygwin which do not support automatic
ÂÂ language detection. Just rename 'titles-XY.txt' to 'titles.txt'.

Sources comes with GPL2. Checkout the sources directly from the SVN repository or browse the source.

myron0815 · Jan 6, 2010

nice - just in time ^^
wanted to post that language/titles issue right now...

fyi, umlauts seem not to work in cygwin....

Code:

>wit.exe move indi*.iso -d ./%X -T titles-de.txt
*****ÂÂwit: Wiimms ISO Tool v0.26a r568M cygwin - Dirk Clemens - 2010-01-05ÂÂ*****
- Move ISO:indi.iso -> ./Indiana Jones und der Stab der KÃ¶nige [RJ8P64].iso

zx3junglist · Jan 6, 2010

@Wiimm:

very glad to hear that you're actively developing this. It's very helpful. I fear that the directory creation still may not be working properly, but I'm not convinced that I'm using the syntax correctly.
*EDIT* I'm not sure if it matters, but if it's not clear from the output, I'm using an ntfs drive to hold my wbfs files.

Code:

previces@Optimus:~/iso$ wit COPY -B Blah\ Blah\ Blah/Test.iso -d /media/NTFS/wbfs/%I_%T/%I.wbfs
*****ÂÂwit: Wiimms ISO Tool v0.26a r568M i386 - Dirk Clemens - 2010-01-05ÂÂ*****
* wit SCRUB ISO:Blah Blah Blah/Test.iso -> WBFS:/media/NTFS/wbfs/ABCD01_Blah Blah Blah/ABCD01.wbfs
!! wit: ERROR #13 [CAN'T CREATE FILE] in exec_copy() @ wit.c#1118
!!ÂÂÂÂÂÂCan't create temp file: /media/NTFS/wbfs/ABCD01_Blah Blah Blah/ABCD01.wbfs
previces@Optimus:~/iso$ mkdir "/media/NTFS/wbfs/ABCD01_Blah Blah Blah"
previces@Optimus:~/iso$ ls /media/NTFS/wbfs/ABCD01_Blah\ Blah\ Blah/
previces@Optimus:~/iso$ wit COPY -B Blah\ Blah\ Blah/Test.iso -d /media/NTFS/wbfs/%I_%T/%I.wbfs
*****ÂÂwit: Wiimms ISO Tool v0.26a r568M i386 - Dirk Clemens - 2010-01-05ÂÂ*****
* wit SCRUB ISO:Blah Blah Blah/Test.iso -> WBFS:/media/NTFS/wbfs/ABCD01_Blah Blah Blah/ABCD01.wbfs
previces@Optimus:~/iso$ ls /media/NTFS/wbfs/ABCD01_Blah\ Blah\ Blah/
ABCD01.wbfs
previces@Optimus:~/iso$

Wiimm · Jan 6, 2010

@myron0815
"KÃ¶nige" looks like an UTF-8 problem.

zx3junglist said:
@Wiimm:

very glad to hear that you're actively developing this.
My Christmas holidays are gone ... and now I haven't so much time as before.

QUOTE(zx3junglist @ Jan 6 2010, 07:09 AM) It's very helpful. I fear that the directory creation still may not be working properly, but I'm not convinced that I'm using the syntax correctly.
*EDIT* I'm not sure if it matters, but if it's not clear from the output, I'm using an ntfs drive to hold my wbfs files.

Code:

previces@Optimus:~/iso$ wit COPY -B Blah\ Blah\ Blah/Test.iso -d /media/NTFS/wbfs/%I_%T/%I.wbfs ***** wit: Wiimms ISO Tool v0.26a r568M i386 - Dirk Clemens - 2010-01-05 ***** * wit SCRUB ISO:Blah Blah Blah/Test.iso -> WBFS:/media/NTFS/wbfs/ABCD01_Blah Blah Blah/ABCD01.wbfs !! wit: ERROR #13 [CAN'T CREATE FILE] in exec_copy() @ wit.c#1118 !! Can't create temp file: /media/NTFS/wbfs/ABCD01_Blah Blah Blah/ABCD01.wbfs[/quote] And what happpens if you use "-D" instead of "-d"? If -D isn't working too than I will create a debug version for you which dumps a trace with more infos.

mbsill · Jan 6, 2010

I apologize if this has been said before, I wasn't able to read all the posts left so far.

Anyway, I'm a novice to command line action like this. Can anyone tell me if there is a guide that might be more useful for someone like me?

Also, can I ask that someone help me with an example? What's the easiest way to dump the files from the wbfs to a local fat32 partition? I realize that I use wwt.exe extract but I'm having trouble with the parameters. This is what I have so far:

C:\bin>wwt.exe X -p "/dev/sdc1" -aA -d "A:\Wii\" -W

"/dev/sdc1/" is what the tool spits out when I use the find command. "A:\Wii\" is the destination path. I want them in the wdf format and I want to extract all of the .isos from the disk.

Thanks for your help

P.S. I'm using the most recent version (for windows)

Wiimm · Jan 6, 2010

@zx3junglist
create dir bug found!

@mbsill
You don't need the -p and -A if there is exact 1 WBFS drive. Use only -a. And read the section "Processing partitions" in wwt.txt for details.

myron0815 · Jan 6, 2010

Wiimm said:
@myron0815
"KÃ¶nige" looks like an UTF-8 problem.

yes, for sure.
but in your supplied title-de.txt, it is correctly stated with ö.
(checked in UltraEdit - file is UTF8/unix)

so where's the problem?!
maybe any needed windows/cygwin locale env setting missing?!

Hacking wwt+wit: Wiimms WBFS+ISO Tools

Developer

Developer

Developer

Well-Known Member

Developer

Developer

Well-Known Member

Developer

Active Member

Well-Known Member

Developer

Developer

Well-Known Member

Developer

Active Member

Member

Developer

New Member

Developer

Active Member

Similar threads

Popular threads in this forum