Homebrew RELEASE NSZ Title Compression Results

godreborn

Welcome to the Machine
Member
Joined
Oct 10, 2009
Messages
38,471
Trophies
3
XP
29,180
Country
United States
@blawar , how do I know if something is verified? is there a txt file? must I compress, then decompress or is it also verified when an nsp is compressed?
 

godreborn

Welcome to the Machine
Member
Joined
Oct 10, 2009
Messages
38,471
Trophies
3
XP
29,180
Country
United States
for some reason, the compression window keeps crashing. it took over an hour to do 3GBs at level 22. I've tried doing this on another computer, but whenever I type in nsz.py, it shows an outline of a squirrel and says "fin."
 

Taorn

Well-Known Member
Member
Joined
May 27, 2017
Messages
257
Trophies
0
Age
53
XP
1,840
Country
United States
I can't get this to work. here's what happens:

Microsoft Windows [Version 10.0.17763.805]
(c) 2018 Microsoft Corporation. All rights reserved.

E:\Switch Games>nsz.py --level 22 - C "E:\Switch Games\Nsp DLC"
Traceback (most recent call last):
File "E:\Switch Games\nsz.py", line 17, in <module>
import Fs
File "E:\Switch Games\Fs\__init__.py", line 2, in <module>
from nut import Print
File "E:\Switch Games\nut\__init__.py", line 7
<!DOCTYPE html>
^
SyntaxError: invalid syntax

E:\Switch Games>

no matter what I do I can't execute the script.

--------------------- MERGED ---------------------------

here's what the folder looks like:

You didn't download the file but the web page it's one. Click on the "raw" button on the top left if you want to download files from Github directly.
 

godreborn

Welcome to the Machine
Member
Joined
Oct 10, 2009
Messages
38,471
Trophies
3
XP
29,180
Country
United States
I can get it to work on my computer, but my computer is too slow for it. my other computer keeps erroring on everything. same files, same version of python. it doesn't make any sense.
 

godreborn

Welcome to the Machine
Member
Joined
Oct 10, 2009
Messages
38,471
Trophies
3
XP
29,180
Country
United States
on that second computer, I get errors about modules being missing. I don't see how that can be, because it mirrors the computer that the scripts work on. it's way too slow on my computer. it would take weeks to compress 1TB, so I thought I'd use a different computer. nicoboss' nszip works well, and it's pretty fast, but I'm getting nspz, which I have no idea how it relates to nsz. I can't believe the compression, because with nszip, I get about 4KBs as opposed to 120KBs for the different costumes in contra. nsz was like 52KBs, so I don't know if something is wrong. I don't own a hacked switch, but I wanted to be prepared for it. suffice it to say, I can't test these things, only ask questions about them.
 
Last edited by godreborn,

JRoad

Developer
Developer
Joined
May 18, 2018
Messages
1,003
Trophies
0
XP
1,756
Country
Spain
on that second computer, I get errors about modules being missing. I don't see how that can be, because it mirrors the computer that the scripts work on. it's way too slow on my computer. it would take weeks to compress 1TB, so I thought I'd use a different computer. nicoboss' nszip works well, and it's pretty fast, but I'm getting nspz, which I have no idea how it relates to nsz. I can't believe the compression, because with nszip, I get about 4KBs as opposed to 120KBs for the different costumes in contra. nsz was like 52KBs, so I don't know if something is wrong. I don't own a hacked switch, but I wanted to be prepared for it. suffice it to say, I can't test these things, only ask questions about them.
If your issue are modules i added compression in option 8 of nsc_builder and there is a x86 and a x64 version compiled as exe:
https://github.com/julesontheroad/NSC_BUILDER/releases/tag/v0.93
Also if you want speed try the lower levels is where you get the most significant compression bump.
I saw you want verification too. I'll add something easier but for now you can decompress and use mode 4: File-Info, then option 8 "verify". That will verify the decompressed file.
 
Last edited by JRoad,
  • Like
Reactions: godreborn

godreborn

Welcome to the Machine
Member
Joined
Oct 10, 2009
Messages
38,471
Trophies
3
XP
29,180
Country
United States
If your issue are modules i added compression in option 8 of nsc_builder and there is a x86 and a x64 version compiled as exe:
https://github.com/julesontheroad/NSC_BUILDER/releases/tag/v0.93
Also if you want speed try the lower levels is where you get the most significant compression bump.

I'll try it. what exactly is an nspz/xciz? they don't appear to be the same as nsz. in the release thread of nszip, it says that it goes from nsz to nspz. nspz isn't compatible with something like sx os, is it? I think they added support recently for nsz. what's the point in taking it one step further if nothing supports it? the compression seems to be even more insane with nspz. I am very confused by these terms.
 

JRoad

Developer
Developer
Joined
May 18, 2018
Messages
1,003
Trophies
0
XP
1,756
Country
Spain
I'll try it. what exactly is an nspz/xciz? they don't appear to be the same as nsz. in the release thread of nszip, it says that it goes from nsz to nspz. nspz isn't compatible with something like sx os, is it? I think they added support recently for nsz. what's the point in taking it one step further if nothing supports it? the compression seems to be even more insane with nspz. I am very confused by these terms.
nspz was the old format from Nicoboss, nsz and xcz are normal nsp or xci files with compressed nca files called nsz. Only big nca types are compressed because that's where the gain and not compressing the control and meta nca files allows to keep it compatible with reading file information, for example i could add support to most of my file information functions quickly with nsz.
Nicoboss can probably give you more information about his standard since i only checked the code for his first revision. Either way i'll add the xcz format in NSC_Builder soon.
Either way this format thinks about xci and nsp files as a container modifying only part of the ncas inside.
 
  • Like
Reactions: godreborn

godreborn

Welcome to the Machine
Member
Joined
Oct 10, 2009
Messages
38,471
Trophies
3
XP
29,180
Country
United States
alright, I have them compressing. I just hope cmd doesn't crash. this happened the last couple times I used the python scripts. I was/am using 22 as the compression ratio. at this speed, I think it might take several days to compress over 100 games
 

JRoad

Developer
Developer
Joined
May 18, 2018
Messages
1,003
Trophies
0
XP
1,756
Country
Spain
alright, I have them compressing. I just hope cmd doesn't crash. this happened the last couple times I used the python scripts. I was/am using 22 as the compression ratio. at this speed, I think it might take several days to compress over 100 games
Yeah, it'll depend on your aim. Level22 is slow also don't use threads at level22 because it may give you memory errors, at least that happens for me with most of the files. I'd say threads are mostly good at lower levels even if they hurt compression a little.
 
  • Like
Reactions: godreborn

godreborn

Welcome to the Machine
Member
Joined
Oct 10, 2009
Messages
38,471
Trophies
3
XP
29,180
Country
United States
yeah, I put d. can this ever cause a game to become corrupted? that's my fear, especially when using level 22. I've spent a lot of time fixing everything, like those nsps that have part of the file cut off.
 

JRoad

Developer
Developer
Joined
May 18, 2018
Messages
1,003
Trophies
0
XP
1,756
Country
Spain
yeah, I put d. can this ever cause a game to become corrupted? that's my fear, especially when using level 22. I've spent a lot of time fixing everything, like those nsps that have part of the file cut off.
No, tinfoil decrypts it on the console. Either way i'll add my verification pre-compression and after. Basically what can make something compress badly is if the titlekey or masterkeys the user has have a wrong value which the verification will solve.
For decompression\installation i'd say blawar made it simple enough that it won't give issues.
 
  • Like
Reactions: godreborn

godreborn

Welcome to the Machine
Member
Joined
Oct 10, 2009
Messages
38,471
Trophies
3
XP
29,180
Country
United States
do you mean that the files are verified after compression? or, should I just decompress them and check if the files are the right size?
 

godreborn

Welcome to the Machine
Member
Joined
Oct 10, 2009
Messages
38,471
Trophies
3
XP
29,180
Country
United States
No, tinfoil decrypts it on the console. Either way i'll add my verification pre-compression and after. Basically what can make something compress badly is if the titlekey or masterkeys the user has have a wrong value which the verification will solve.
For decompression\installation i'd say blawar made it simple enough that it won't give issues.

for some reason, some of my nsz files are larger than their nsp counterparts, like the contra shirts. nsp = 120KBs; nsz = 155KBs. this only happens on really small nsp files.
 

JRoad

Developer
Developer
Joined
May 18, 2018
Messages
1,003
Trophies
0
XP
1,756
Country
Spain
for some reason, some of my nsz files are larger than their nsp counterparts, like the contra shirts. nsp = 120KBs; nsz = 155KBs. this only happens on really small nsp files.
DLCs maybe? I guess the zstandard adds some data to decompress the file. Also those really small dlcs are normally a txt file with some lines (txt,json,.data) I saw one that just said "unlock content number 4).
It was proposed to me to add an skip option for files smaller than X size or just dlcs smaller than that size, I'll do in next version.
 
  • Like
Reactions: godreborn

Site & Scene News

Popular threads in this forum

General chit-chat
Help Users
  • Psionic Roshambo @ Psionic Roshambo:
    hmmm 360 even lol
  • Psionic Roshambo @ Psionic Roshambo:
    Well I was getting a discount so 320 is probably right
  • BigOnYa @ BigOnYa:
    That is cheap, I used to pay $100 for a tine.
  • Psionic Roshambo @ Psionic Roshambo:
    Tine? One gram?
  • BigOnYa @ BigOnYa:
    Sixteenth
  • Psionic Roshambo @ Psionic Roshambo:
    Also it was literally out of a kilo when I got it off the boat so absolutely pure
  • Psionic Roshambo @ Psionic Roshambo:
    Holy shiz that's a lot
    +1
  • Psionic Roshambo @ Psionic Roshambo:
    I was getting 3.5 Grams for 320 could have stepped on it and doubled my money easy lol
    +1
  • BigOnYa @ BigOnYa:
    I'd be afraid to it nowdays, my heart would explode prob. I just stick beers n buds nowdays.
  • Psionic Roshambo @ Psionic Roshambo:
    I would get to drive from tarpon springs to like Miami a thousand bucks lol do that twice a week and back in 92 that was good money
  • Xdqwerty @ Xdqwerty:
    @BigOnYa,
    @Psionic Roshambo what are you guys talking about?
  • Psionic Roshambo @ Psionic Roshambo:
    Blew it on women and muscle cars lol
    +1
  • BigOnYa @ BigOnYa:
    @Xdqwerty Hamster food, its pricey nowadays to keep PCs running.
    +2
  • Psionic Roshambo @ Psionic Roshambo:
    I don't do anything except cigarettes and gotta stop eventually lol
    +1
  • BigOnYa @ BigOnYa:
    I'd do shrooms again if could find, and I was outside camping/fishing, and had a cooler full of beer.
    +1
  • Psionic Roshambo @ Psionic Roshambo:
    I wouldn't mind some LSD, laughing until my face hurt sounds fun lol
    +1
  • BigOnYa @ BigOnYa:
    You ever try soaper powder/qauludes? I did once and like a dumbass drank beer on top of taking, I woke up laying in my backyard in the pouring rain, it knocked me out. I have not seen it around in many many years.
    +1
  • Psionic Roshambo @ Psionic Roshambo:
    No never tried a lot of things but never that lol
  • Psionic Roshambo @ Psionic Roshambo:
    I did pass out one time on a floor after taking a bunch of Ambien lol thought it would help me sleep and did it lol
  • Psionic Roshambo @ Psionic Roshambo:
    Girlfriend was working at a pharmacy and stole like 500 of them, was and still is the biggest pill bottle I have ever seen lol
  • K3Nv2 @ K3Nv2:
    Ativan is pretty legit
    +1
  • Psionic Roshambo @ Psionic Roshambo:
    The last time I had to take something to help me sleep, I was prescribed Trazadone it was pretty OK to be honest.
  • Psionic Roshambo @ Psionic Roshambo:
    Not something I need at all these days, doing a lot better lol
    Psionic Roshambo @ Psionic Roshambo: Not something I need at all these days, doing a lot better lol