Hacking wwt+wit: Wiimms WBFS+ISO Tools

[Wiimm]

I haven't forgotten this, but in the last weeks I spent all my free time into a MKW-Fun project with more than 32 tracks. And here in germany we have also only 24 hours per day ....

 

[megazig]

Germany needs to get with the times. 24 hours? that's so 20th century

 

[naxil]

sorry but, qt gui of wit can be used under linux? i have download the source but i can't compile it..

 

[mike333]

Hi,

Is there any simple way of converting command

wbfs_file -g file.iso convert directory/

to wit?

I would like to get directory called "game name [gameid]" with "gameid.wbfs, gameid.wbf1" files inside.

I don't need script like this: https://gist.github.com/openback/1138763
Just one/simple command line.

 

[Wiimm]

Hi,

Is there any simple way of converting command

wbfs_file -g file.iso convert directory/

to wit?

I would like to get directory called "game name [gameid]" with "gameid.wbfs, gameid.wbf1" files inside.

I don't need script like this: https://gist.github.com/openback/1138763
Just one/simple command line.

Don't know what -g means.

Unix: wit copy --wbfs SOURCE /BASEDIR/%X/%I.wbfs
Windows: wit copy --wbfs -E$ SOURCE /BASEDIR/$X/$I.wbfs

SOURCE is a list of souece files or directories. BASEDIR is the base directory of the output. A relative path is also possible.

Add -t or --test for tests (don't create anything).

 

[mike333]

Thank You for fast response.
"-g" means "Copy only game partition from ISO"
So I believe it translates to "--psel DATA", right?

wbfs_file is no longer developed and last release was on Jan 2010:
http://code.google.com/p/cfg-loader/downloads/detail?name=wbfs_file_2.9.zip&
and need some patching for 64bit systems:
http://git.animux.de/overlay/diff/g...h?id=d30069f48c7ec183ebc60077bdf4fcf887dab0ac

I think it is time to break habit and use more mature tool.

Wiimm, could You point me to doc which describes %X,%I macros?

Is there magic command which for specified dir:
- find all .wbfs files (recursive dig)
- checks them (one at a time, this is not flash/ssd storage)
- pint nice looking summary

Thanks

 

[Wiimm]

Hey Wiimm, would it be possible to support the --sections option for the CHECK and REPAIR commands of wwt? That would simplify a lot the implementation of these commands in GUIs.

Which verbose level is important for you: none, -v or -vv?

Thank You for fast response.
"-g" means "Copy only game partition from ISO"
So I believe it translates to "--psel DATA", right?

Yes

Wiimm, could You point me to doc which describes %X,%I macros?

http://wit.wiimm.de/info/iso-images.html#esc

Is there magic command which for specified dir:
- find all .wbfs files (recursive dig)
- checks them (one at a time, this is not flash/ssd storage)
- pint nice looking summary

Only: Find all wii images: --recurse BASEDIR
It is possible for all commands, also for CHECK.
One status line for each game partition is print, or more. Play with --quiet and --verbose.

 

[Wiimm]

Nickkk

Here is the result of a first implementation (verbose level 0)

# ./wwt check a.wbfs  --sections
[version]
prog=wwt
name=Wiimms WBFS Tool
version=2.24a
beta=0
revision=4818
system=x86_64
endian=1234 little
author=Dirk Clemens
date=2013-12-30
url=http://wit.wiimm.de/wwt
 
[check-wbfs]
wbfs=a.wbfs
 
[check-summary]
err-sectors-marked-free=1
err-sectors-marked-used=0
err-sectors-multi-usage=1
err-sectors-invalid-reference=0
err-discs-without-blocks=0
total-errors=2
total-invalid-discs=2
 
[error]
program=wwt
command=CHECK
code=19
name=INVALID WBFS
text=Invalid WBFS

 

[mike333]

Here is instruction for those who want to migrate from wbfs_file to wit.

Conversion by wbfs_file.

wbfs_file -g abcd.iso convert asd

Conversion by wit.

wit copy --wbfs --psel data -z abcd.iso "asd/%Y/%+"

There are minor differences:
- wit can create "asd" subdirectory, wbfs_file can't
- there are minor differences in %T which is part of %Y, some chars are replaced to "_" by wbfs_file

Lack of trust. How to compare wbfs files created by different tools for one source iso.

wit diff -v a.wbfs b.wbfs

Mass wbfs verification

wit verify --recurse .

Dirk, thank You for great tool!

Here are some points to Your New Year's resolution list:
- migrate to git
- host on github

 

[Wiimm]

Here are some points to Your New Year's resolution list:
- migrate to git
- host on github

Definitely no. There is no reason to switch from my open SVN repository to GIT.

 

[mike333]

Definitely no. There is no reason to switch from my open SVN repository to GIT.

http://svenpet.com/2013/02/21/dont-use-git/
Happy New Year btw

 

[moli]

Dear Wiimm,
First i'd like to congratulate to you for the inclusion of wit in the official debian repositories! I was shocked and amused when i realised this. Another script i dont have to download and install manually, imdbphp should be next

Second, recently i reinstalled my machine (got fed up with gnome, so moving to kde (me) and xfce (girlfriend & grandma) ) and purged a whole lot of packages after that, even basic ones like xterm, ftp, host. Now i dont have a progress bar when converting an image even if i specify --progress. Which package am i missing? Thanks. It appeared this moment, minutes after starting the conversion.. nevermind me

 

[Wiimm]

http://svenpet.com/2013/02/21/dont-use-git/
Happy New Year btw

SVN supports all my needs. Again, no reason to change.

Dear Wiimm,
First i'd like to congratulate to you for the inclusion of wit in the official debian repositories! I was shocked and amused when i realised this. Another script i dont have to download and install manually, imdbphp should be next

I know about integration of the wit tools in some linux distributions, but not one was done by me.

 

[Nickkk]

Nickkk

Here is the result of a first implementation (verbose level 0)

# ./wwt check a.wbfs  --sections
[version]
prog=wwt
name=Wiimms WBFS Tool
version=2.24a
beta=0
revision=4818
system=x86_64
endian=1234 little
author=Dirk Clemens
date=2013-12-30
url=http://wit.wiimm.de/wwt
 
[check-wbfs]
wbfs=a.wbfs
 
[check-summary]
err-sectors-marked-free=1
err-sectors-marked-used=0
err-sectors-multi-usage=1
err-sectors-invalid-reference=0
err-discs-without-blocks=0
total-errors=2
total-invalid-discs=2
 
[error]
program=wwt
command=CHECK
code=19
name=INVALID WBFS
text=Invalid WBFS

Hi Wiimm, this looks great. The only flags I use for printing are --scan-progress and --progress.

I received a report from a user of Witgui who says that double layer discs can't be converted. In fact, I tried converting "Disney Infinity" and an "end of data behind end of file"-error is thrown when trying to list it or to convert it.

 

[Wiimm]

I received a report from a user of Witgui who says that double layer discs can't be converted. In fact, I tried converting "Disney Infinity" and an "end of data behind end of file"-error is thrown when trying to list it or to convert it.

Please send me the output of "wit dump IMAGE"

 

[Nickkk]

Please send me the output of "wit dump IMAGE"

!! wit: ERROR #14 [INVALID WII PARTITION] in wd_check_part_offset() @ src/libwbfs/wiidisc.c#1930
!! Partition 0 [DATA]: End of data (0x1fa550000) behind end of file
!! (0x118240000): /Users/nicolaskick/Downloads/Disney Infinity.iso

Dump of file /Users/nicolaskick/Downloads/Disney Infinity.iso

ISO file size: 118240000/hex = 4699979776 = 4482 MiB
Scrubbed size: aa30000/hex = 178454528 = 170 MiB, 3.80%, 5446*32K
File & disc type: ISO/WII & Wii
Disc & part IDs: disc=SQIP4Q, ticket=.UPP, tmd=.UPP, boot=RELSAB
Disc name: Disney Infinity
ID Region: PAL [PAL ]
Region setting: 2 [Europe] / Jap=128 USA=128 ?=128 Eur=6,7,7,6,7,7 Kor=128
System menu: v514 = ?
System version: 00000001-00000004 = IOS 0x04 = IOS 4
Partitions: 1 [encrypted, well signed]
Directories: 5
Files: 71

1 partition table with 1 partition:

index type offset .. end off size/hex = size/dec = MiB status
----------------------------------------------------------------------------------------
0 part.tab 40020 .. 40028 8 = 8 1 partition
----------------------------------------------------------------------------------------
0.0 UPDATE 1 50000 .. aa68000 aa18000 = 178356224 = 170 enc,signed
----------------------------------------------------------------------------------------

 

[Wiimm]

It's clearly a bad dump (ripping error?):

!! Partition 0 [DATA]: End of data (0x1fa550000) behind end of file

The "End of data" is the assumed end of the image after reading the disc header. 0x1fa550000 is about 7.9 GiB.

ISO file size: 118240000/hex = 4699979776 = 4482 MiB

But the image is to small, because only a single layer disc was ripped.

 

[Wiimm]

WIT: Wiimms ISO Tools v2.25a - 2014-01-03
A command line ISO+WBFS tool set for various os.

WIT (Wiimms ISO Tools) is a set of command line tools to manipulate Wii ISO images and WBFS containers. The two main tools are called wit (Wiimms ISO Tool) and wwt (Wiimms WBFS Tool, the WBFS manager).

Feature overview:

• WIT (Wiimms ISO Toolset) is a set of command line tools.
• wit (Wiimms ISO tool) is the main Wii and GameCube ISO manipulation tool.
• wwt (Wiimms WBFS tool) is a complete WBFS manager including FS checking and repairing, time stamps and multi WBFS support.
• wdf (Wiimms WDF Tool) is a little tool to manage WDF, CISO and WIA files.
• wfuse (Wiimms FUSE Tool) mounts Wii and GameCube images and WBFS files and partitions using FUSE.
• WIT supports 6 Wii disc file types (ISO, CISO, WDF, WIA, WBFS and FST) and can read from pipes (indirect RAR/ZIP/7Z support).
• wit can verify and compare (diff) Wii and GameCube ISO images.
• wit can extract and compose Wii ISO images.
• wit can patch Wii and GameCube ISO images while copying.
• wit can mix partitions from different sources into a new Wii ISO images.
• wit and wwt support many diagnostic commands.
• Advanced shell support.

Visit http://wit.wiimm.de/features.html for more details.

Download of the current version:

• wit-v2.25a-r4825-i386.tar.gz : Linux/i386 version
• wit-v2.25a-r4825-x86_64.tar.gz : Linux/x86_64 version
• wit-v2.25a-r4825-mac.tar.gz : Mac OS universal binaries (ppc, i386 and x86-64)
• wit-v2.25a-r4825-cygwin.zip : Cygwin (Windows) version
• Other releases are available at http://wit.wiimm.de/download.html.

There are also some GUI available:

• QtWitGui, manipulate and convert single ISO images.
  This QT based GUI focuses on manipulating single ISO images. It can do much more.
  
• Wii Backup Fusion, a WBFS and ISO manager.
  This QT based GUI is a complete WBFS manager and ISO tool.
  
• Witgui for Mac.
  This is a graphical user interface for wit available for Mac OS X.

Highlights of this release:

• The new (but experimental) option --auto-split enables a feature to detect, if an new image must be split. I hope, that it doesn't slow down the image creation under any circumstances.
  
  The feature is based on tests with fseek(). First test with Linux are fine. Cygwin reports always SUCCESS, so that the maximum file size can't be estimated. On Macs I had no chance to test it.
  
  It is planned to enable --auto-split by default in future versions of the tools. You can do it by setting the environment variables WIT_OPT and WWT_OPT to --auto-split.
  
  If you're using --auto-split, then please tell it me (in this thread). And please tell also, if you found any disadvantages.
  .

Change log:

wit v2.25a r4825 - 2014-01-03

 - New option --auto-split: If set, the tools try to find out, if an image
   split is needed. The split size is then either below 4 or 2 GiB. Auto-Split
   base on tests with fseek() and works fine under Linux, but it don't work
   with Cygwin. Mac is unknown. In future versions --auto-split is enabled by
   default. It is disabled by any other split option.
 - New option --no-split: Disable file splitting at all. At the moment and in
   old versions of the tools, this is the default.
 - wwt CHECK+REPAIR: Support for option --sections.
 - Windows only: Cygwin update to v1.7.27 2013-12-09.

The source is published under the license of GPL2. Checkout the sources directly from the SVN repository or browse the source. Visit http://wit.wiimm.de/ for more information.

 

[Nickkk]

It's clearly a bad dump (ripping error?):

The "End of data" is the assumed end of the image after reading the disc header. 0x1fa550000 is about 7.9 GiB.

But the image is to small, because only a single layer disc was ripped.

Ok, thank you for the hint.

By the way, would it be possible to extend the --sections flag to the verify command of wit?

 

[Wiimm]

All is possible, it's always a point of time and fun.
Are there more --sections wishes?