Hacking wwt+wit: Wiimms WBFS+ISO Tools

[drh]

Hi Wiimm,

I emailed you earlier.

I did the debug command and I couldnt find the trace file, so I just pasted the output from the make.

[22:30:45] [iMac-2] [~/Desktop/wiimms-wbfs-tool]: make clean debug all
***ÂÂÂÂÂÂrm *.{o,d,tmp,bak,exe} */*.{tmp,bak} */*/*.{tmp,bak} ./_mode.flag iso2wbfs iso2wdf wdf-cat wdf-dump wdf2iso wit wtest wwt install.sh load-titles.sh
***ÂÂenable debug (-DDEBUG)
***ÂÂobject iso2wbfs.o -DDEBUG
***ÂÂobject dclib-utf8.o -DDEBUG
***ÂÂobject debug.o -DDEBUG
***ÂÂobject lib-sf.o -DDEBUG
***ÂÂobject lib-std.o -DDEBUG
lib-std.c: In function ‘AppendParam’:
lib-std.c:3735: warning: cast from pointer to integer of different size
lib-std.c:3735: warning: cast from pointer to integer of different size
lib-std.c:3735: warning: cast from pointer to integer of different size
lib-std.c:3735: warning: cast from pointer to integer of different size
lib-std.c:3735: warning: cast from pointer to integer of different size
lib-std.c:3740: warning: cast from pointer to integer of different size
lib-std.c:3740: warning: cast from pointer to integer of different size
***ÂÂobject lib-wdf.o -DDEBUG
***ÂÂobject libwbfs.o -DDEBUG
***ÂÂobject rijndael.o -DDEBUG
***ÂÂobject titles.o -DDEBUG
***ÂÂobject wbfs-interface.o -DDEBUG
wbfs-interface.c: In function ‘CheckParamID6’:
wbfs-interface.c:459: warning: cast from pointer to integer of different size
wbfs-interface.c:459: warning: cast from pointer to integer of different size
wbfs-interface.c:459: warning: cast from pointer to integer of different size
wbfs-interface.c:459: warning: cast from pointer to integer of different size
wbfs-interface.c:459: warning: cast from pointer to integer of different size
wbfs-interface.c:562: warning: cast from pointer to integer of different size
wbfs-interface.c:562: warning: cast from pointer to integer of different size
wbfs-interface.c:562: warning: cast from pointer to integer of different size
wbfs-interface.c:562: warning: cast from pointer to integer of different size
wbfs-interface.c:562: warning: cast from pointer to integer of different size
wbfs-interface.c:569: warning: cast from pointer to integer of different size
wbfs-interface.c:569: warning: cast from pointer to integer of different size
wbfs-interface.c:569: warning: cast from pointer to integer of different size
wbfs-interface.c:569: warning: cast from pointer to integer of different size
wbfs-interface.c:569: warning: cast from pointer to integer of different size
wbfs-interface.c:578: warning: cast from pointer to integer of different size
wbfs-interface.c:578: warning: cast from pointer to integer of different size
wbfs-interface.c:578: warning: cast from pointer to integer of different size
wbfs-interface.c:578: warning: cast from pointer to integer of different size
wbfs-interface.c:578: warning: cast from pointer to integer of different size
***ÂÂobject wiidisc.o -DDEBUG
***ÂÂÂÂtool iso2wbfs -DDEBUG
***ÂÂobject iso2wdf.o -DDEBUG
***ÂÂÂÂtool iso2wdf -DDEBUG
***ÂÂobject wdf-cat.o -DDEBUG
***ÂÂÂÂtool wdf-cat -DDEBUG
***ÂÂobject wdf-dump.o -DDEBUG
***ÂÂÂÂtool wdf-dump -DDEBUG
***ÂÂobject wdf2iso.o -DDEBUG
***ÂÂÂÂtool wdf2iso -DDEBUG
***ÂÂobject wit.o -DDEBUG
***ÂÂÂÂtool wit -DDEBUG
***ÂÂobject wtest.o -DDEBUG
***ÂÂÂÂtool wtest -DDEBUG
***ÂÂobject wwt.o -DDEBUG
***ÂÂÂÂtool wwt -DDEBUG
[22:31:23] [iMac-2] [~/Desktop/wiimms-wbfs-tool]:

 

[drh]

Hi Wiimm,

Sorted the trace.

Does this indicate a problem here?:

TRACELINE;
ASSERT(!w->wbfs);
TRACE("CALL wbfs_open_partition(ss=%u,ns=%u,reset=%d)\n",
sector_size, n_sector, reset );
w->wbfs = wbfs_open_partition( WrapperReadSector,
WrapperWriteSector,
sf,
sector_size,
n_sector,
0, // partition_lba = index of partiton sector
reset );

 

[Wiimm]

I got it.
The calculation of the total size is wrong, the result is 0.
And seeking with lseek() to the end does'nt help.

 

[morgoth123]

Would it be possible for this tool to start supporting .wbfs files too? I'm referring to the usb loaders (USBloaderCFG and USBLoaderGX for ex) which can use FAT32..as I understood it .wbfs files are basically wbfs partitions with 1 game in them. Of course no all switches would make sense here but some do and it would be nice to see it supported.

 

[mousex]

It supports (and also creates) .wbfs files.

 

[drh]

I got it.
The calculation of the total size is wrong, the result is 0.
And seeking with lseek() to the end does'nt help.

Cool :-)

 

[Floyd4711]

Hi,
is ist possible to format a HDD partition to WBFS
I tried the WWT FORMAT
wwt FORMAT -s 300 --sector-size 1024 -t -f i:
***** wwt: Wiimms WBFS Tool v0.18a r465 cygwin - Dirk Clemens - 2009-11-22 ***
**
!! wwt: ERROR #13 [WRONG FILE TYPE] in cmd_format() @ wwt.c#1143
!! i:: Neither regular file nor block device: (null)
** 0 files formatted.

I: is my HDD Partition expected to be formatted to WBFS
Its a Samsung S2 portable 500Gb, all other tools failed

can you help me?

Floyd

 

[Blue-K]

Hi,
is ist possible to format a HDD partition to WBFS
I tried the WWT FORMAT
wwt FORMAT -s 300 --sector-size 1024 -t -f i:
***** wwt: Wiimms WBFS Tool v0.18a r465 cygwin - Dirk Clemens - 2009-11-22 ***
**
!! wwt: ERROR #13 [WRONG FILE TYPE] in cmd_format() @ wwt.c#1143
!! i:: Neither regular file nor block device: (null)
** 0 files formatted.

I: is my HDD Partition expected to be formatted to WBFS
Its a Samsung S2 portable 500Gb, all other tools failed

can you help me?

Floyd

I did that right now using wwt format --force /dev/sdb2 and it worked (using the Linux binary, and the partition that I wanted was sdb2. Dunno if this works on other OS...you would have to change at least the partition name).

Btw: What would be the command to copy all games from a WBFS Partition to another WBFS Partition? wwt add -d ? Can anybody help me here quick? I need it as fast as possible

 

[Wiimm]

I did that right now using wwt format --force /dev/sdb2 and it worked (using the Linux binary, and the partition that I wanted was sdb2. Dunno if this works on other OS...you would have to change at least the partition name).
Be careful that /dev/sdb2 is the right device/harddisk!

Btw: What would be the command to copy all games from a WBFS Partition to another WBFS Partition? wwt add -d ? Can anybody help me here quick? I need it as fast as possible

CODE

wwt -p dest_part add sources...
# sources is one or more of:
#ÂÂ - iso
#ÂÂ - wdf
#ÂÂ - wbfs
#ÂÂ - directory which is scanned for above
#ÂÂ - wbfs/id6 -> use the specific wbfs discs as source

# this command will copy all discs from source_wbfs to dest_wbfs that are missed in dest_wbfs
wwt -p dest_wbfs add --update source_wbfs

# instead of "add --update" you can write "update" or short "u"
wwt -p dest_wbfs u source_wbfs

# if there is only one wbfs drive connected to the computer --auto (-a) can be used
# to identify the destination wbfs
wwt -a u source_wbfs

 

[Wiimm]

@drh & other mac users & other "make self" users:

Can you compile this program (get-size.c), test it, confirm the size results and post the results if they are not correct. I need this to find out a secure function to determine the size of a block device.

compile:

gcc -o get-size get-size.c

test with 2 commands:

# mac users:
./get-sizeÂÂÂÂ/dev/disk*
./get-size -b /dev/disk*

# linux users:
./get-sizeÂÂÂÂ/dev/sd*
./get-size -b /dev/sd*

# other users: one of above?

source get-size.c:
CODE// make: gcc -o get-size get-size.c
// test: ./get-sizeÂÂÂÂ/dev/disk*
//ÂÂand: ./get-size -b /dev/disk*

#define LARGE_FILES
#define _FILE_OFFSET_BITSÂÂÂÂ64
#define GIB (1024*1024*1024)
#define TRACE printf

#include
#include
#include
#include
#include
#include

#if defined(__CYGWIN__)
ÂÂ#include
#elif defined(__linux__)
ÂÂ#include
#endif

int bin_search = 0;

static int valid_offset ( int fd, off_t off )
{
ÂÂÂÂ//TRACE(" - valid_offset(%d,%llu=%#x)\n",fd,off,off);
ÂÂÂÂchar ch;
ÂÂÂÂif (lseek(fd,off,SEEK_SET) == (off_t)-1 )
ÂÂÂÂreturn 0;
ÂÂÂÂreturn read(fd,&ch,1) == 1;
}

off_t GetBlockDevSize ( int fd )
{
if (bin_search)
ÂÂÂÂgoto _bins;

#ifdef BLKGETSIZE64
ÂÂÂÂTRACE(" - try BLKGETSIZE64\n");
ÂÂÂÂ{
ÂÂÂÂunsigned long long size64 = 0;
ÂÂÂÂif ( ioctl(fd, BLKGETSIZE64, &size64 ) >= 0 && size64 )
ÂÂÂÂÂÂÂÂreturn size64;
ÂÂÂÂ}
#endif

#ifdef DKIOCGETBLOCKCOUNT
ÂÂÂÂTRACE(" - try DKIOCGETBLOCKCOUNT\n");
ÂÂÂÂ{
ÂÂÂÂunsigned long long size64 = 0;
ÂÂÂÂif ( ioctl(fd, DKIOCGETBLOCKCOUNT, &size64 ) >= 0ÂÂ&& size64 )
ÂÂÂÂÂÂÂÂreturn size64 = 0 && size32 )
ÂÂÂÂÂÂÂÂreturn (off_t)size32

 

[drh]

Results of ./get-file /dev/disk*


[19:00:12] [iMac-2] [~/Desktop/wiimms]: ./get-size /dev/disk*
sizeof(off_t) = 8
can't open file: /dev/disk0
can't open file: /dev/disk0s1
can't open file: /dev/disk0s2
can't open file: /dev/disk0s3
----> /dev/disk1
- try binary search
----> /dev/disk1s1
- try binary search
----> /dev/disk2
- try binary search
----> /dev/disk2s0
- try binary search
----> /dev/disk2s0s1
- try binary search
----> /dev/disk2s0s2
- try binary search
-----------------
/dev/disk0 : 0 = 0 = 0 GiB
/dev/disk0s1 : 0 = 0 = 0 GiB
/dev/disk0s2 : 0 = 0 = 0 GiB
/dev/disk0s3 : 0 = 0 = 0 GiB
/dev/disk1 : 499405291520 = 0x7446e00000 = 465 GiB
/dev/disk1s1 : 499405258752 = 0x7446df8000 = 465 GiB
/dev/disk2 : 1 = 0x1 = 0 GiB
/dev/disk2s0 : 700448768 = 0x29c00000 = 0 GiB
/dev/disk2s0s1 : 32256 = 0x7e00 = 0 GiB
/dev/disk2s0s2 : 160604160 = 0x992a000 = 0 GiB
[19:01:09] [iMac-2] [~/Desktop/wiimms]:


Results of ./get-file -b /dev/disk*


[19:02:32] [iMac-2] [~/Desktop/wiimms]: ./get-size -b /dev/disk*
sizeof(off_t) = 8
can't open file: /dev/disk0
can't open file: /dev/disk0s1
can't open file: /dev/disk0s2
can't open file: /dev/disk0s3
----> /dev/disk1
- try binary search
----> /dev/disk1s1
- try binary search
----> /dev/disk2
- try binary search
----> /dev/disk2s0
- try binary search
----> /dev/disk2s0s1
- try binary search
----> /dev/disk2s0s2
- try binary search
-----------------
/dev/disk0 : 0 = 0 = 0 GiB
/dev/disk0s1 : 0 = 0 = 0 GiB
/dev/disk0s2 : 0 = 0 = 0 GiB
/dev/disk0s3 : 0 = 0 = 0 GiB
/dev/disk1 : 499405291520 = 0x7446e00000 = 465 GiB
/dev/disk1s1 : 499405258752 = 0x7446df8000 = 465 GiB
/dev/disk2 : 1 = 0x1 = 0 GiB
/dev/disk2s0 : 700448768 = 0x29c00000 = 0 GiB
/dev/disk2s0s1 : 32256 = 0x7e00 = 0 GiB
/dev/disk2s0s2 : 160604160 = 0x992a000 = 0 GiB
[19:02:39] [iMac-2] [~/Desktop/wiimms]:

 

[Wiimm]

@drh:
Is /dev/disk1 the only readable disk?
Is the size, 465 GiB, correct?

The program uses the binary size search, because DKIOCGETBLOCKCOUNT is not defined.
What says: grep -rs DKIOCGETBLOCKCOUNT /usr/include

Perhaps the definition resides in /usr/include/sys/disk.h
Can you insert "#include " in the near of the other includes, run again and watch for the message "- try DKIOCGETBLOCKCOUNT"

 

[Bauldrick]

My linux box says:


***** wwt: Wiimms WBFS Tool v0.18b r486 linux - Dirk Clemens - 2009-11-26 *****

CHECK /dev/sdb

* Summary of WBFS Check: 10 errors found:
10 free WBFS sectors marked as used!
Note: 10 errors are based on a bug in libwbfs v0.

REPAIR /dev/sdb
* Store fixed 'free blocks table' (5120 bytes).
* Set WBFS version from 0 to 1.

matt@LinkStation2:/home/wii_games$ ./get-size -b /dev/sd*
sizeof(off_t) = 8
----> /dev/sda
- try binary search
----> /dev/sda1
- try binary search
----> /dev/sda2
- try binary search
----> /dev/sda3
- try binary search
can't open file: /dev/sdb
-----------------
/dev/sda : 250059350016 = 0x3a38b2e000 = 232 GiB
/dev/sda1 : 10010133504 = 0x254a68400 = 9 GiB
/dev/sda2 : 518192640 = 0x1ee2fe00 = 0 GiB
/dev/sda3 : 239528378880 = 0x37c5010200 = 223 GiB
/dev/sdb : 0 = 0 = 0 GiB

------------------------------------------------------------------------------



matt@LinkStation2:/home/wii_games$ ./get-size /dev/sdb
sizeof(off_t) = 8
can't open file: /dev/sdb
-----------------
/dev/sdb : 0 = 0 = 0 GiB


sd 3:0:0:0: [sdb] 160086528 512-byte hardware sectors: (81.9 GB/76.3 GiB)
sd 3:0:0:0: [sdb] Write Protect is off
sd 3:0:0:0: [sdb] Mode Sense: 03 00 00 00
sd 3:0:0:0: [sdb] Assuming drive cache: write through
sd 3:0:0:0: [sdb] Assuming drive cache: write through
sdb: unknown partition table
sd 3:0:0:0: [sdb] Attached SCSI disk

 

[Wiimm]

@Bauldrick

Your link station also used the binary size search (trial and error as fall back) because the ioctl codes are not defined. Perhaps it needs only the correct include. Can you grep the following codes in /usr/include:

grep -rs -E 'DKIOCGETBLOCKCOUNT|BLKGETSIZE64|BLKGETSIZE' /usr/include

EDIT:
The error are normal because some bugs in the old libwbfs.

 

[Skizzo]

Hi Wiimm, I asked this earlier but didn't see a reply. Sorry if I missed it, or if it's a case of me needing to RTFM, let me know and I'll give that another try.

On another note, whenever I add a game it always says something like [TITLEID, 2241M], or in the case of a DL game [TITLEID, 4052M]. What is the significance of those numbers? I figured it might tell you how big the game was going to be on the drive after being added, but that's not the case.

 

[Bauldrick]

matt@LinkStation2:/home/wii_games$ grep -rs -E 'DKIOCGETBLOCKCOUNT|BLKGETSIZE64|BLKGETSIZE' /usr/include
/usr/include/linux/fs.h:#define BLKGETSIZE _IO(0x12,96) /* return device size /512 (long *arg) */
/usr/include/linux/fs.h:#define BLKGETSIZE64 _IOR(0x12,114,size_t) /* return device size in bytes (u64 *arg) */
/usr/include/sys/mount.h:#define BLKGETSIZE _IO(0x12, 96) /* Return device size. */
/usr/include/sys/mount.h:#define BLKGETSIZE64 _IOR(0x12,114,size_t) /* return device size. */

 

[Wiimm]

@Skizzo:
I haven't answered that? Sorry.
While adding it is the disc usage of the source. For WDF and for PLAIN ISO images stored as sparse file it is nearly the copy size. For all other it is bad .... I should remove it.

 

[Wiimm]

@Bauldrick
Have you run the prog without option -b

 

[Bauldrick]

yep , without -d gives:

matt@LinkStation2:/home/wii_games$ ./get-size /dev/sdb

sizeof(off_t) = 8
can't open file: /dev/sdb
-----------------
/dev/sdb : 0 = 0 = 0 GiB

 

[drh]

@drh:
Is /dev/disk1 the only readable disk?
Is the size, 465 GiB, correct?

The program uses the binary size search, because DKIOCGETBLOCKCOUNT is not defined.
What says: grep -rs DKIOCGETBLOCKCOUNT /usr/include

Perhaps the definition resides in /usr/include/sys/disk.h
Can you insert "#include " in the near of the other includes, run again and watch for the message "- try DKIOCGETBLOCKCOUNT"

Hi Wiimm,

No, Disk0xx refers to the 1TB drive inside the Mac, I don't know why it doesn't identify this properly, but we are not interested in this anyway :-)
It identifies the WBFS drive okay, which is indeed Disk1xx and is 465Gb.
Disk2xx is a firmware partition they put on the Wester Digital Passport drives. It contains a software to use with the drive. The partition is unremovable unfortunately.

Results of command above:

[21:47:47] [iMac-2] [~/Desktop/wiimms]: grep -rs DKIOCGETBLOCKCOUNT /usr/include
/usr/include/sys/disk.h: * DKIOCGETBLOCKCOUNTÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂget media's block count
/usr/include/sys/disk.h:#define DKIOCGETBLOCKCOUNTÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂÂ_IOR('d', 25, uint64_t)
[21:47:51] [iMac-2] [~/Desktop/wiimms]:

Results after adding sys/disk.h to get-size:


CODE[21:51:02] [iMac-2] [~/Desktop/wiimms]: ./get-size /dev/disk*
sizeof(off_t) = 8
can't open file: /dev/disk0
can't open file: /dev/disk0s1
can't open file: /dev/disk0s2
can't open file: /dev/disk0s3
----> /dev/disk1
- try DKIOCGETBLOCKCOUNT
----> /dev/disk1s1
- try DKIOCGETBLOCKCOUNT
----> /dev/disk2
- try DKIOCGETBLOCKCOUNT
----> /dev/disk2s0
- try DKIOCGETBLOCKCOUNT
----> /dev/disk2s0s1
- try DKIOCGETBLOCKCOUNT
----> /dev/disk2s0s2
- try DKIOCGETBLOCKCOUNT
-----------------
/dev/disk0ÂÂÂÂ :ÂÂÂÂÂÂÂÂÂÂÂÂ 0 =ÂÂÂÂÂÂÂÂÂÂÂÂ 0 =ÂÂÂÂ 0 GiB
/dev/disk0s1ÂÂ :ÂÂÂÂÂÂÂÂÂÂÂÂ 0 =ÂÂÂÂÂÂÂÂÂÂÂÂ 0 =ÂÂÂÂ 0 GiB
/dev/disk0s2ÂÂ :ÂÂÂÂÂÂÂÂÂÂÂÂ 0 =ÂÂÂÂÂÂÂÂÂÂÂÂ 0 =ÂÂÂÂ 0 GiB
/dev/disk0s3ÂÂ :ÂÂÂÂÂÂÂÂÂÂÂÂ 0 =ÂÂÂÂÂÂÂÂÂÂÂÂ 0 =ÂÂÂÂ 0 GiB
/dev/disk1ÂÂÂÂ :ÂÂ499405291520 =ÂÂ0x7446e00000 =ÂÂ 465 GiB
/dev/disk1s1ÂÂ :ÂÂ499405229568 =ÂÂ0x7446df0e00 =ÂÂ 465 GiB
/dev/disk2ÂÂÂÂ :ÂÂÂÂ 175112192 =ÂÂÂÂ 0xa700000 =ÂÂÂÂ 0 GiB
/dev/disk2s0ÂÂ :ÂÂÂÂ 175112192 =ÂÂÂÂ 0xa700000 =ÂÂÂÂ 0 GiB
/dev/disk2s0s1 :ÂÂÂÂÂÂÂÂÂÂ7680 =ÂÂÂÂÂÂÂÂ0x1e00 =ÂÂÂÂ 0 GiB
/dev/disk2s0s2 :ÂÂÂÂÂÂ40151040 =ÂÂÂÂ 0x264a800 =ÂÂÂÂ 0 GiB
[21:54:47] [iMac-2] [~/Desktop/wiimms]: