Hardware New App: NKit - Restore, Shrink and Preserve Disc Images in Playable (Formerly SWiiT)

nanook · Mar 11, 2019

Moved to https://gbatemp.net/threads/nkit-re...-and-gamecube-disc-images-as-playable.548479/

The tools in this release are to restore and preserve Wii and GameCube images.

Restore:

Wii and GameCube restoration primarily works by regenerating junk data removed by various other tools and formats to help make images smaller. NKitRestore.exe will regenerate this data and attempt to match the CRC of a known good image from Redump. Sometimes this is not enough. In this case Recovery files used if present to help force a match. These can be extracted from a good image using NKitRecoveryExtract.exe

Convert:

NKitConvert shrinks any image in its exact state to the nkit format. The format is reversible and will always produce the same image it was originally used on. This is currently GC only.

Features:

Unscrub Wii/GC images from scene/scrubbed/wbfs(file)/iso.dec/iso/gcz
Read the above images from Rar/Zip/7zip etc
Convert GC images to nkit format (small, playable, reversable)
GC nkit format CRC matches source image CRC
GC nkit format can be gcz un/compressed by the included apps
GC nkit format aligns audio and tgc files to 32k for playability
Create CRC/SHA1/MD5 checksums
Rename restored images to match Redump dat crc
Rename restored images to match a secondary Redump compatible dat crc
Insert missing Wii Update (inc rare extra data), Channel and VC partitions
Replace Brickblocked Update partitions
Auto fixes modified disc headers (where the Data header remains intact)
Fixes rare corrupt Wii partition table (caused by WBM)
Fixes rare Wii 0 byte file scrubbing (caused by WIT)
Fixes truncated Wii images (where the Data partition is intact)
Fixes slightly overdumped images too (descrambled)
Fixes Wii Data partitions moved before 0xF800000 to save space
Fixes compacted GC images
Fixes moved and reordered GC files
Fixes modified GC headers (inc. title, region hacks)
Fixes mod chip modified GC apploaders
Fixes GC images with non conformant junk
Support for GC images with junk not generated with the image ID
All regions supported
Optimised for performance
Reusable library for use in other projects

Read the Readme and the FAQ

Any other questions, just ask. Wii nkit format will be coming soon.

Edit ** Fix to the Config for Wii Repair **
Edit ** 0.5: Fixed padding of last block of gcz compressed files - Files decompress perfectly, but the size could different between encodings. NKitRestore can be used to recompress the nkit.gcz to the exact file to match a dat if required **

...NKit Wii is getting closer....

Reploid · Mar 11, 2019

Kewl, but maybe not that useful. I mean how much space we can winback? Even if it's like 20%, might not be all that noticeable, considering size of today's drives.

nanook · Mar 11, 2019

Nkit.iso for GC is about 66% of the full iso on average and restorable back 1:1. Nkit.gcz is about 54% of the full iso. You get higher compression if you z7ip or zst the nkit.iso

FancyNintendoGamer567 · Mar 11, 2019

So is this basically SWiiT 0.2/1.0? Cool!

nanook · Mar 11, 2019

FancyNintendoGamer567 said:
So is this basically SWiiT 0.2/1.0? Cool!

Yeah, 2nd version and the Wii only title had to go

johnsanc · Mar 12, 2019

I think you downplayed a key feature here... this is an ARCHIVE grade lossless format that is playable in Dolphin and works on real hardware using a USB Loader.
Yeah the space savings aren't crazy considering GC games aren't huge to begin with and HDD space is relatively cheap... but still, you could fit every single GC game ever made on a 2 TB HDD.

Great work Nanook!

dubbz82 · Mar 13, 2019

@nanook - Just to give you a heads up, I'm working on a frontend for this, as it's a really cool program, yet i know CLI stuff scares some people off. I'll probably create a new thread once it's in a reasonably good place and can at least pass through all the basic settings.

nanook · Mar 14, 2019

dubbz82 said:
@nanook - Just to give you a heads up, I'm working on a frontend for this, as it's a really cool program, yet i know CLI stuff scares some people off. I'll probably create a new thread once it's in a reasonably good place and can at least pass through all the basic settings.

Are you using .net? If so you're probably best off interfacing with the dll as it will allow you to receive progress and messages directly. It does its processing on a background thread. It's not all fully finalised and there may still be breaking changes. You can reverse one of the exes to see how it's currently done ;-)

There is a large result set returned from processing also (It's not perfect, but it's a start) that will tell you about the state of the image etc.

Welcome aboard

dubbz82 · Mar 14, 2019

Gotcha. Right now I was just calling the executable directly with system.diagnostics, but it sounds like that may be a better solution.

nanook · Mar 14, 2019

dubbz82 said:
Gotcha. Right now I was just calling the executable directly with system.diagnostics, but it sounds like that may be a better solution.

No worries, PM me if you like

trazome · Mar 14, 2019

@nanook : Thank you for your hard work and yours fantastik tools

PawsofHorror · Mar 22, 2019

Reduced size while being playable in Dolphin sounds cool for Wii games, will the shrinked by this tool Wii files be smaller than wbfs? (Which also work in Dolphin and can be restored back to a Redump iso if you have the update partitions)

Wonder how big a super smash bros file will be with your tool, the clean iso is 7gb and most of the wbfs I saw are nearly the same sizeswhile the USA iso.dec files are 5gb (but unplayable)

Never saw a playable and reduced GameCube game before but the size of the clean ISO's is 1GB so I don't care much about those (but this should be useful for people who use Dolphin on Android phones but they need to find your tool first and a big percent of the mobile Dolphin userbase is unaware of such tools xD)

Speaking of Android it would be amazing if someone would port this or a similar tool like nNASOS and a rom scanner like clrmamepro, nowadays there are phones with 1TB space and 512 GB SD cards so storing roms can be done in such a portable device but a computer is always needed to use

nanook · Mar 23, 2019

Testers have reported average savings of about 250mb an image over iso.dec before GCZing. Dual Layer could be more. I could make an Android version. The code is written to be Endian safe. I need to test it though.

RandomByte · Mar 23, 2019

nanook said:
Testers have reported average savings of about 250mb an image over iso.dec before GCZing. Dual Layer could be more. I could make an Android version. The code is written to be Endian safe. I need to test it though.

Hi, thanks a lot for sharing your work with comm. The app looks very promising. Any plans for batch processing option? Tested on a single file (compressed to .gcz) and it reduced around 110mb (1.23 gb gcz to 1.11 gb nkit.gcz).

nanook · Mar 24, 2019

RandomByte said:
Hi, thanks a lot for sharing your work with comm. The app looks very promising. Any plans for batch processing option? Tested on a single file (compressed to .gcz) and it reduced around 110mb (1.23 gb gcz to 1.11 gb nkit.gcz).

It will scan subfolders and multiples of folders masks etc. Is that what you meant by batch processing?

Deleted member 388531 · Mar 25, 2019

I think this fucked up some of my games.
Luigi's Mansion now has a strange pale skin effect above eyes.
The Twin Snakes freezes at 0FPS at the first codec call.
....and I still have around 13 more games to test.

nanook · Mar 25, 2019

SpiffyJUNIOR said:
I think this fucked up some of my games.
Luigi's Mansion now has a strange pale skin effect above eyes.
The Twin Snakes freezes at 0FPS at the first codec call.
....and I still have around 13 more games to test.

Thanks for the report. Did you use Convert or Restore? Is your format iso or gcz?

Deleted member 388531 · Mar 25, 2019

nanook said:
Thanks for the report. Did you use Convert or Restore? Is your format iso or gcz?

Converted with redump isos. It may be the fact that I converted from dolphins gcz to iso then to Nkit gcz.

nanook · Mar 25, 2019

SpiffyJUNIOR said:
Converted with redump isos. It may be the fact that I converted from dolphins gcz to iso then to Nkit gcz.

If NKit matched it to redump on convert it should be okay. The issues you're seeing could be a file alignment thing after being compacted. It will be looked at and tested

Deleted member 388531 · Mar 25, 2019

nanook said:
If NKit matched it to redump on convert it should be okay. The issues you're seeing could be a file alignment thing after being compacted. It will be looked at and tested

Got clean redump iso for LM, will post screenshots in a few.

--------------------- MERGED ---------------------------

Pale skin is still there. EDIT: There is also a 20KB difference.

Hardware New App: NKit - Restore, Shrink and Preserve Disc Images in Playable (Formerly SWiiT)

Well-Known Member

Attachments

Well-Known Member

Well-Known Member

Well-Known Member

Well-Known Member

Well-Known Member

Well-Known Member

Well-Known Member

Well-Known Member

Well-Known Member

Member

Well-Known Member

Well-Known Member

New Member

Well-Known Member

Well-Known Member

Well-Known Member

Well-Known Member

Well-Known Member

Well-Known Member

Similar threads

Popular threads in this forum