WIA = Wii ISO Archive

Discussion in 'Wii - Hacking' started by Wiimm, Aug 27, 2010.

  1. Wiimm
    OP

    Wiimm Developer

    Member
    2,133
    337
    Aug 11, 2009
    Gambia, The
    Germany
    Thanx to giantpune for the crash course ...
     


  2. Remfin

    Remfin Advanced Member

    Newcomer
    65
    0
    Mar 5, 2010
    United States
    I didn't mean to be that glib, but I kinda had to point out that shrinking the buffers just creates new problems [​IMG]

    I'm not sure it's worth even bothering thinking about until someone actually makes a CIOS that loads WIA files. I'm assuming most disc partitions end up with only 2 entries in the map: the stuff at the beginning of the partition (header, fst, dol) and the stuff at the end (all the data)? Simply implementing supporting a plain old WIA file would provide what should be a small space saving (1/32nd) and let people use the exact same format for USB loading and archival with whatever compression they like. You should see if people will get on board with that before worrying about a more complicated format that relies on testing the limits of the ARM processor/IOS memory space.
     
  3. Wiimm
    OP

    Wiimm Developer

    Member
    2,133
    337
    Aug 11, 2009
    Gambia, The
    Germany
    We talk about saving 20-40 percent disc space for a usb loader compatible and complex format. The loading time increases and the developers have to spend much time in this project. On the other side hard drives becomes larger and larger and cheaper and cheaper.

    The advantage is minimal and only pirates with multiple hundreds of games have a real advantage, because they can store all 1000 games on 1 hard drive.

    My question: Is it all worth it?
    (This includes the already ready WIA)
     
  4. vexing

    vexing Advanced Member

    Newcomer
    65
    0
    Nov 16, 2009
    United States
    i like it mainly as a conceptual problem, and it could become the new standard for images.
    yes, it'd primarily benefit pirates, but what doesn't?
     
  5. W hat

    W hat Rhythm Heaven Fan

    Member
    616
    110
    Feb 28, 2007
    United States
    DIOS MIOS! Good thing I have 28+ real GC discs.
     
  6. WiiUBricker

    WiiUBricker Fake News Reporter

    Member
    6,840
    3,731
    Sep 19, 2009
    Argentina
    Espresso
    Tomorrow should start the open beta of DIOS MIOS.
     
  7. WiiPower

    WiiPower GBAtemp Guru

    Member
    8,165
    72
    Oct 17, 2008
    Gambia, The
    Nice. So now, here's what i think makes sense(yes fstfix is very close to that already...):
    - Align all files by 32KB within the .iso. This is a requirement for audio streams, if an audio stream is not aligned at 32KB, then the game will most likely crash when trying to play the stream. .adp files should always be audio streams, but .trk and .snd can be audio streams too. Just to be sure align all files by 32KB and everything will work. For disc loading with NeoGamma aligning all files at least at 2KB results in a better read speed as it's only able to read sectors directly, so 32KB for everything is good for this too.
    - Shrink .isos. GC .isos can have any size, so it should be possible to move all data to the beginning and just cut the .iso.(that's what i think all other shrinkers do)
    - Expand .iso size for optimised reads for disc loading. There you some different options would be nice, optimised for 1/2/3 games on disc. If a single game would have a .iso with 4.37 GB and all the data is at the end, the reads are faster than a 1:1 copy.
    - Optional: Check if the file is fragmented. SD-Boot requires that .isos are in one fragment.

    Well extract/replace files is also nice, but the above is what i think most people will need. Well that is if you want to write this at all, i don't want to push you or something.
     
  8. W hat

    W hat Rhythm Heaven Fan

    Member
    616
    110
    Feb 28, 2007
    United States
    Loading a GC multiboot disc doesn't always work with softmods, right?
     
  9. Wiimm
    OP

    Wiimm Developer

    Member
    2,133
    337
    Aug 11, 2009
    Gambia, The
    Germany
    @WiiPower

    All commands (DUMP, LIST, COPY, DIFF, EDIT, MOVE, RENAME, EXTRACT, FILES, ...) works with gamecube discs and only for some I need minimal changes and a little bit fine tuning. That means, extracting, patching, scrubbing ans converting into WDF, CISO or WBFS (but not WIA) is available. Adding to a WBFS partition is also possible.

    For your aligning I have to implement a relocation module into the wiidisc module. This will take a while.

    P.S.: Beta version comes tomorrow.
     
  10. FenrirWolf

    FenrirWolf GBAtemp Psycho!

    Member
    4,346
    326
    Nov 19, 2008
    United States
    Sandy, UT
    September's a long month. Keep in mind he never gave a specific date.
     
  11. WiiPower

    WiiPower GBAtemp Guru

    Member
    8,165
    72
    Oct 17, 2008
    Gambia, The
    Please don't make tools that create something else than .iso file for gamecube games. Gamecube games are not encrypted, and there are no hashes to throw away, so if you shrink the .iso, it's nearly as small as possible(32KB alignment increases the size a little). And .iso files can just be burned, put into multi game discs, using existing tools, or can be played via SD-Boot. If you see any advantage in another format for gamecube games, please take you time and make it one format that does everything you want. Also if you create .wbfs files, people will bug around why the games don't work in their usb loaders.

    PS: You don't have any relocation tool yet? Hmm, it would be nice if you could do something like this:
    join game.iso foldername
    And this overwrites all files in game.iso with files it finds in foldername. If there's no matching file the folder, it takes the file from the .iso. And since the sizes can be different, it relocates all files of course. I don't know if wii games have any specific requirements for alignment, so 2KB* as default and 32KB as optional alignment would sound good to me. Maybe that's why file replacment doesn't always work with current tools?

    *Backup loaders that use discs use the dvd video read command, which should only be able to read sectors, so the aligment should be at least 2KB
    PPS: When relocating files in wii .isos then of couse make sure the "hole" is at the beginning of the disc. And yes, i will try to think first, and then write next time.
     
  12. Wiimm
    OP

    Wiimm Developer

    Member
    2,133
    337
    Aug 11, 2009
    Gambia, The
    Germany
    WDF, WBFS, CISO and WIA are only containers (like tar or zip). They are handled in the file layer of my tools. The commands don't see the details and read from/write to the virtual file. So support for all formats is automatically available (WIA needs only a little extension).

    Sorry [​IMG]
     
  13. Wiimm
    OP

    Wiimm Developer

    Member
    2,133
    337
    Aug 11, 2009
    Gambia, The
    Germany
  14. keine

    keine GBAtemp Fan

    Member
    407
    27
    Aug 29, 2010
    United States
    Just want to say thanks to Wiimm for the hard work. ANY ANY development at all for the WII (heaven forbid new effective containers and compressions schemes) should be treasured and appreciated to the nth degree. Thanks
     
  15. wishmasterf

    wishmasterf GBAtemp Regular

    Member
    167
    0
    Apr 20, 2009
    Australia
    Austria
    Thanks for releasing wit with WIA support. What are your plans with that format. When do you think it is stable and will not be changed?

    Do you plan a support for WIA in usb-loaders?
     
  16. hack_10299

    hack_10299 Newbie

    Newcomer
    1
    0
    Sep 4, 2010
    United States

    i was stupid and accidentally installed 4.3U!!!! when i try to run WAD Manager 1.7 my wiimote goes off, when it gets to nand device (disable)
    i dont know whats wrong.... and also usb loader wont even come up when i click on it
     
  17. Wiimm
    OP

    Wiimm Developer

    Member
    2,133
    337
    Aug 11, 2009
    Gambia, The
    Germany
    WIA is only an backup archive format. USB loaders will never support it because of the complex data structure.

    EDIT: forgotten stable answer:
    I think is is already stable. I'm waiting for test with a big endian machine to declare it as stable.



    @hack_10299
    You are off topic here. Don't expect an answer.
     
  18. Wiimm
    OP

    Wiimm Developer

    Member
    2,133
    337
    Aug 11, 2009
    Gambia, The
    Germany
    The test with a big endian machine are positive. It seems that the current format is the final one. In the next days I start a script to convert to wia and back and compare if there are no differences. I will post the bash script if it is ok.
     
  19. wishmasterf

    wishmasterf GBAtemp Regular

    Member
    167
    0
    Apr 20, 2009
    Australia
    Austria
    Ok so do you think it is ready to start backup my wbfs-drive with WIA?
     
  20. Wiimm
    OP

    Wiimm Developer

    Member
    2,133
    337
    Aug 11, 2009
    Gambia, The
    Germany
    I think "yes" but I say "no" until I have finished my (long time) tests.