New App: NKit - Restore, Shrink and Preserve Disc Images in Playable (Formerly SWiiT)

Discussion in 'Wii - Hardware, Devices and Utilities' started by nanook, Mar 11, 2019.

  1. nanook
    OP

    nanook Advanced Member

    Newcomer
    4
    Dec 17, 2008
    The tools in this release are to restore and preserve Wii and GameCube images.

    Restore:
    Wii and GameCube restoration primarily works by regenerating junk data removed by various other tools and formats to help make images smaller. NKitRestore.exe will regenerate this data and attempt to match the CRC of a known good image from Redump. Sometimes this is not enough. In this case Recovery files used if present to help force a match. These can be extracted from a good image using NKitRecoveryExtract.exe​

    Convert:
    NKitConvert shrinks any image in its exact state to the nkit format. The format is reversible and will always produce the same image it was originally used on. This is currently GC only.​

    Features:
    • Unscrub Wii/GC images from scene/scrubbed/wbfs(file)/iso.dec/iso/gcz
    • Read the above images from Rar/Zip/7zip etc
    • Convert GC images to nkit format (small, playable, reversable)
    • GC nkit format CRC matches source image CRC
    • GC nkit format can be gcz un/compressed by the included apps
    • GC nkit format aligns audio and tgc files to 32k for playability
    • Create CRC/SHA1/MD5 checksums
    • Rename restored images to match Redump dat crc
    • Rename restored images to match a secondary Redump compatible dat crc
    • Insert missing Wii Update (inc rare extra data), Channel and VC partitions
    • Replace Brickblocked Update partitions
    • Auto fixes modified disc headers (where the Data header remains intact)
    • Fixes rare corrupt Wii partition table (caused by WBM)
    • Fixes rare Wii 0 byte file scrubbing (caused by WIT)
    • Fixes truncated Wii images (where the Data partition is intact)
    • Fixes slightly overdumped images too (descrambled)
    • Fixes Wii Data partitions moved before 0xF800000 to save space
    • Fixes compacted GC images
    • Fixes moved and reordered GC files
    • Fixes modified GC headers (inc. title, region hacks)
    • Fixes mod chip modified GC apploaders
    • Fixes GC images with non conformant junk
    • Support for GC images with junk not generated with the image ID
    • All regions supported
    • Optimised for performance
    • Reusable library for use in other projects
    Read the Readme and the FAQ

    Any other questions, just ask. Wii nkit format will be coming soon.

    Edit ** Fix to the Config for Wii Repair **
    Edit ** 0.5: Fixed padding of last block of gcz compressed files - Files decompress perfectly, but the size could different between encodings. NKitRestore can be used to recompress the nkit.gcz to the exact file to match a dat if required **

    ...NKit Wii is getting closer....
     

    Attached Files:

    Last edited by nanook, Mar 22, 2019
    Zarper, Darkyose, Frostwolfo and 37 others like this.
  2. Reploid

    Reploid GBAtemp Advanced Maniac

    Member
    10
    Jan 20, 2010
    Serbia, Republic of
    Kewl, but maybe not that useful. I mean how much space we can winback? Even if it's like 20%, might not be all that noticeable, considering size of today's drives.
     
  3. nanook
    OP

    nanook Advanced Member

    Newcomer
    4
    Dec 17, 2008
    Nkit.iso for GC is about 66% of the full iso on average and restorable back 1:1. Nkit.gcz is about 54% of the full iso. You get higher compression if you z7ip or zst the nkit.iso
     
    qwertimus and KiiWii like this.
  4. FancyNintendoGamer567

    FancyNintendoGamer567 GBAtemp Advanced Fan

    Member
    5
    Feb 13, 2017
    United States
    So is this basically SWiiT 0.2/1.0? Cool!
     
  5. nanook
    OP

    nanook Advanced Member

    Newcomer
    4
    Dec 17, 2008
    Yeah, 2nd version and the Wii only title had to go :P
     
    Last edited by nanook, Mar 11, 2019
    qwertimus likes this.
  6. johnsanc

    johnsanc Member

    Newcomer
    4
    Sep 27, 2016
    United States
    I think you downplayed a key feature here... this is an ARCHIVE grade lossless format that is playable in Dolphin and works on real hardware using a USB Loader.
    Yeah the space savings aren't crazy considering GC games aren't huge to begin with and HDD space is relatively cheap... but still, you could fit every single GC game ever made on a 2 TB HDD.

    Great work Nanook!
     
  7. dubbz82

    dubbz82 GBAtemp Advanced Maniac

    Member
    7
    Feb 2, 2014
    United States
    @nanook - Just to give you a heads up, I'm working on a frontend for this, as it's a really cool program, yet i know CLI stuff scares some people off. I'll probably create a new thread once it's in a reasonably good place and can at least pass through all the basic settings.
     
  8. nanook
    OP

    nanook Advanced Member

    Newcomer
    4
    Dec 17, 2008
    Are you using .net? If so you're probably best off interfacing with the dll as it will allow you to receive progress and messages directly. It does its processing on a background thread. It's not all fully finalised and there may still be breaking changes. You can reverse one of the exes to see how it's currently done ;-)

    There is a large result set returned from processing also (It's not perfect, but it's a start) that will tell you about the state of the image etc.

    Welcome aboard
     
    Last edited by nanook, Mar 14, 2019
  9. dubbz82

    dubbz82 GBAtemp Advanced Maniac

    Member
    7
    Feb 2, 2014
    United States
    Gotcha. Right now I was just calling the executable directly with system.diagnostics, but it sounds like that may be a better solution.
     
  10. nanook
    OP

    nanook Advanced Member

    Newcomer
    4
    Dec 17, 2008
    No worries, PM me if you like :)
     
  11. trazome

    trazome Newbie

    Newcomer
    1
    Oct 27, 2014
    France
    @nanook : Thank you for your hard work and yours fantastik tools
     
    nanook likes this.
  12. PawsofHorror

    PawsofHorror Member

    Newcomer
    1
    Mar 15, 2019
    Greece
    Reduced size while being playable in Dolphin sounds cool for Wii games, will the shrinked by this tool Wii files be smaller than wbfs? (Which also work in Dolphin and can be restored back to a Redump iso if you have the update partitions)

    Wonder how big a super smash bros file will be with your tool, the clean iso is 7gb and most of the wbfs I saw are nearly the same sizeswhile the USA iso.dec files are 5gb (but unplayable)

    Never saw a playable and reduced GameCube game before but the size of the clean ISO's is 1GB so I don't care much about those (but this should be useful for people who use Dolphin on Android phones but they need to find your tool first and a big percent of the mobile Dolphin userbase is unaware of such tools xD)

    Speaking of Android it would be amazing if someone would port this or a similar tool like nNASOS and a rom scanner like clrmamepro, nowadays there are phones with 1TB space and 512 GB SD cards so storing roms can be done in such a portable device but a computer is always needed to use
     
  13. nanook
    OP

    nanook Advanced Member

    Newcomer
    4
    Dec 17, 2008
    Testers have reported average savings of about 250mb an image over iso.dec before GCZing. Dual Layer could be more. I could make an Android version. The code is written to be Endian safe. I need to test it though.
     
    PawsofHorror likes this.
  14. RandomByte

    RandomByte Newbie

    Newcomer
    1
    Mar 15, 2019
    Pakistan
    Hi, thanks a lot for sharing your work with comm. The app looks very promising. Any plans for batch processing option? Tested on a single file (compressed to .gcz) and it reduced around 110mb (1.23 gb gcz to 1.11 gb nkit.gcz).
     
  15. nanook
    OP

    nanook Advanced Member

    Newcomer
    4
    Dec 17, 2008
    It will scan subfolders and multiples of folders masks etc. Is that what you meant by batch processing?
     
  16. SpiffyJUNIOR

    SpiffyJUNIOR GBAtemp Advanced Fan

    Member
    6
    Apr 13, 2016
    United States
    US
    I think this fucked up some of my games.
    Luigi's Mansion now has a strange pale skin effect above eyes.
    The Twin Snakes freezes at 0FPS at the first codec call.
    ....and I still have around 13 more games to test.
     
  17. nanook
    OP

    nanook Advanced Member

    Newcomer
    4
    Dec 17, 2008
    Thanks for the report. Did you use Convert or Restore? Is your format iso or gcz?
     
  18. SpiffyJUNIOR

    SpiffyJUNIOR GBAtemp Advanced Fan

    Member
    6
    Apr 13, 2016
    United States
    US
    Converted with redump isos. It may be the fact that I converted from dolphins gcz to iso then to Nkit gcz.
     
  19. nanook
    OP

    nanook Advanced Member

    Newcomer
    4
    Dec 17, 2008
    If NKit matched it to redump on convert it should be okay. The issues you're seeing could be a file alignment thing after being compacted. It will be looked at and tested
     
  20. SpiffyJUNIOR

    SpiffyJUNIOR GBAtemp Advanced Fan

    Member
    6
    Apr 13, 2016
    United States
    US
    Got clean redump iso for LM, will post screenshots in a few.

    — Posts automatically merged - Please don't double post! —

    Pale skin is still there. EDIT: There is also a 20KB difference.
     
Loading...