Homebrew RELEASE NSZ Title Compression Results

godreborn

Welcome to the Machine
Member
Joined
Oct 10, 2009
Messages
38,471
Trophies
3
XP
29,180
Country
United States
@blawar , how do I know if something is verified? is there a txt file? must I compress, then decompress or is it also verified when an nsp is compressed?
 

godreborn

Welcome to the Machine
Member
Joined
Oct 10, 2009
Messages
38,471
Trophies
3
XP
29,180
Country
United States
for some reason, the compression window keeps crashing. it took over an hour to do 3GBs at level 22. I've tried doing this on another computer, but whenever I type in nsz.py, it shows an outline of a squirrel and says "fin."
 

Taorn

Well-Known Member
Member
Joined
May 27, 2017
Messages
257
Trophies
0
Age
53
XP
1,840
Country
United States
I can't get this to work. here's what happens:

Microsoft Windows [Version 10.0.17763.805]
(c) 2018 Microsoft Corporation. All rights reserved.

E:\Switch Games>nsz.py --level 22 - C "E:\Switch Games\Nsp DLC"
Traceback (most recent call last):
File "E:\Switch Games\nsz.py", line 17, in <module>
import Fs
File "E:\Switch Games\Fs\__init__.py", line 2, in <module>
from nut import Print
File "E:\Switch Games\nut\__init__.py", line 7
<!DOCTYPE html>
^
SyntaxError: invalid syntax

E:\Switch Games>

no matter what I do I can't execute the script.

--------------------- MERGED ---------------------------

here's what the folder looks like:

You didn't download the file but the web page it's one. Click on the "raw" button on the top left if you want to download files from Github directly.
 

godreborn

Welcome to the Machine
Member
Joined
Oct 10, 2009
Messages
38,471
Trophies
3
XP
29,180
Country
United States
I can get it to work on my computer, but my computer is too slow for it. my other computer keeps erroring on everything. same files, same version of python. it doesn't make any sense.
 

godreborn

Welcome to the Machine
Member
Joined
Oct 10, 2009
Messages
38,471
Trophies
3
XP
29,180
Country
United States
on that second computer, I get errors about modules being missing. I don't see how that can be, because it mirrors the computer that the scripts work on. it's way too slow on my computer. it would take weeks to compress 1TB, so I thought I'd use a different computer. nicoboss' nszip works well, and it's pretty fast, but I'm getting nspz, which I have no idea how it relates to nsz. I can't believe the compression, because with nszip, I get about 4KBs as opposed to 120KBs for the different costumes in contra. nsz was like 52KBs, so I don't know if something is wrong. I don't own a hacked switch, but I wanted to be prepared for it. suffice it to say, I can't test these things, only ask questions about them.
 
Last edited by godreborn,

JRoad

Developer
Developer
Joined
May 18, 2018
Messages
1,003
Trophies
0
XP
1,756
Country
Spain
on that second computer, I get errors about modules being missing. I don't see how that can be, because it mirrors the computer that the scripts work on. it's way too slow on my computer. it would take weeks to compress 1TB, so I thought I'd use a different computer. nicoboss' nszip works well, and it's pretty fast, but I'm getting nspz, which I have no idea how it relates to nsz. I can't believe the compression, because with nszip, I get about 4KBs as opposed to 120KBs for the different costumes in contra. nsz was like 52KBs, so I don't know if something is wrong. I don't own a hacked switch, but I wanted to be prepared for it. suffice it to say, I can't test these things, only ask questions about them.
If your issue are modules i added compression in option 8 of nsc_builder and there is a x86 and a x64 version compiled as exe:
https://github.com/julesontheroad/NSC_BUILDER/releases/tag/v0.93
Also if you want speed try the lower levels is where you get the most significant compression bump.
I saw you want verification too. I'll add something easier but for now you can decompress and use mode 4: File-Info, then option 8 "verify". That will verify the decompressed file.
 
Last edited by JRoad,
  • Like
Reactions: godreborn

godreborn

Welcome to the Machine
Member
Joined
Oct 10, 2009
Messages
38,471
Trophies
3
XP
29,180
Country
United States
If your issue are modules i added compression in option 8 of nsc_builder and there is a x86 and a x64 version compiled as exe:
https://github.com/julesontheroad/NSC_BUILDER/releases/tag/v0.93
Also if you want speed try the lower levels is where you get the most significant compression bump.

I'll try it. what exactly is an nspz/xciz? they don't appear to be the same as nsz. in the release thread of nszip, it says that it goes from nsz to nspz. nspz isn't compatible with something like sx os, is it? I think they added support recently for nsz. what's the point in taking it one step further if nothing supports it? the compression seems to be even more insane with nspz. I am very confused by these terms.
 

JRoad

Developer
Developer
Joined
May 18, 2018
Messages
1,003
Trophies
0
XP
1,756
Country
Spain
I'll try it. what exactly is an nspz/xciz? they don't appear to be the same as nsz. in the release thread of nszip, it says that it goes from nsz to nspz. nspz isn't compatible with something like sx os, is it? I think they added support recently for nsz. what's the point in taking it one step further if nothing supports it? the compression seems to be even more insane with nspz. I am very confused by these terms.
nspz was the old format from Nicoboss, nsz and xcz are normal nsp or xci files with compressed nca files called nsz. Only big nca types are compressed because that's where the gain and not compressing the control and meta nca files allows to keep it compatible with reading file information, for example i could add support to most of my file information functions quickly with nsz.
Nicoboss can probably give you more information about his standard since i only checked the code for his first revision. Either way i'll add the xcz format in NSC_Builder soon.
Either way this format thinks about xci and nsp files as a container modifying only part of the ncas inside.
 
  • Like
Reactions: godreborn

godreborn

Welcome to the Machine
Member
Joined
Oct 10, 2009
Messages
38,471
Trophies
3
XP
29,180
Country
United States
alright, I have them compressing. I just hope cmd doesn't crash. this happened the last couple times I used the python scripts. I was/am using 22 as the compression ratio. at this speed, I think it might take several days to compress over 100 games
 

JRoad

Developer
Developer
Joined
May 18, 2018
Messages
1,003
Trophies
0
XP
1,756
Country
Spain
alright, I have them compressing. I just hope cmd doesn't crash. this happened the last couple times I used the python scripts. I was/am using 22 as the compression ratio. at this speed, I think it might take several days to compress over 100 games
Yeah, it'll depend on your aim. Level22 is slow also don't use threads at level22 because it may give you memory errors, at least that happens for me with most of the files. I'd say threads are mostly good at lower levels even if they hurt compression a little.
 
  • Like
Reactions: godreborn

godreborn

Welcome to the Machine
Member
Joined
Oct 10, 2009
Messages
38,471
Trophies
3
XP
29,180
Country
United States
yeah, I put d. can this ever cause a game to become corrupted? that's my fear, especially when using level 22. I've spent a lot of time fixing everything, like those nsps that have part of the file cut off.
 

JRoad

Developer
Developer
Joined
May 18, 2018
Messages
1,003
Trophies
0
XP
1,756
Country
Spain
yeah, I put d. can this ever cause a game to become corrupted? that's my fear, especially when using level 22. I've spent a lot of time fixing everything, like those nsps that have part of the file cut off.
No, tinfoil decrypts it on the console. Either way i'll add my verification pre-compression and after. Basically what can make something compress badly is if the titlekey or masterkeys the user has have a wrong value which the verification will solve.
For decompression\installation i'd say blawar made it simple enough that it won't give issues.
 
  • Like
Reactions: godreborn

godreborn

Welcome to the Machine
Member
Joined
Oct 10, 2009
Messages
38,471
Trophies
3
XP
29,180
Country
United States
do you mean that the files are verified after compression? or, should I just decompress them and check if the files are the right size?
 

godreborn

Welcome to the Machine
Member
Joined
Oct 10, 2009
Messages
38,471
Trophies
3
XP
29,180
Country
United States
No, tinfoil decrypts it on the console. Either way i'll add my verification pre-compression and after. Basically what can make something compress badly is if the titlekey or masterkeys the user has have a wrong value which the verification will solve.
For decompression\installation i'd say blawar made it simple enough that it won't give issues.

for some reason, some of my nsz files are larger than their nsp counterparts, like the contra shirts. nsp = 120KBs; nsz = 155KBs. this only happens on really small nsp files.
 

JRoad

Developer
Developer
Joined
May 18, 2018
Messages
1,003
Trophies
0
XP
1,756
Country
Spain
for some reason, some of my nsz files are larger than their nsp counterparts, like the contra shirts. nsp = 120KBs; nsz = 155KBs. this only happens on really small nsp files.
DLCs maybe? I guess the zstandard adds some data to decompress the file. Also those really small dlcs are normally a txt file with some lines (txt,json,.data) I saw one that just said "unlock content number 4).
It was proposed to me to add an skip option for files smaller than X size or just dlcs smaller than that size, I'll do in next version.
 
  • Like
Reactions: godreborn

Site & Scene News

Popular threads in this forum

General chit-chat
Help Users
  • Psionic Roshambo @ Psionic Roshambo:
    I tell people I wrestled a 5 foot alligator and they get this smile like this guy is full of shit lol the reality is I am sad it got away.... I wanted a pet alligator lol
  • BigOnYa @ BigOnYa:
    You live in Florida, so I believe it, you guys are crazy.
  • Psionic Roshambo @ Psionic Roshambo:
    At the time I would have probably fed it people lol
  • Psionic Roshambo @ Psionic Roshambo:
    Seriously cocaine not even once lol
  • BigOnYa @ BigOnYa:
    Not even once, but 100's of times
    +2
  • Psionic Roshambo @ Psionic Roshambo:
    My girlfriend at the time, she had me stay up with her all night because some how the crazy bitch had spent like 12 hours snorting 2 8 balls, didn't use any water (gotta clean your nose) so she had so much crusted in her nose I was sure she was gonna blow up her heart. I mean this was the stuff right off the boat so absolutely pure. ugghh so annoying
  • Psionic Roshambo @ Psionic Roshambo:
    Also doing like 320 dollars worth of coke in half a day lol damn it
  • Psionic Roshambo @ Psionic Roshambo:
    hmmm 360 even lol
  • Psionic Roshambo @ Psionic Roshambo:
    Well I was getting a discount so 320 is probably right
  • BigOnYa @ BigOnYa:
    That is cheap, I used to pay $100 for a tine.
  • Psionic Roshambo @ Psionic Roshambo:
    Tine? One gram?
  • BigOnYa @ BigOnYa:
    Sixteenth
  • Psionic Roshambo @ Psionic Roshambo:
    Also it was literally out of a kilo when I got it off the boat so absolutely pure
  • Psionic Roshambo @ Psionic Roshambo:
    Holy shiz that's a lot
    +1
  • Psionic Roshambo @ Psionic Roshambo:
    I was getting 3.5 Grams for 320 could have stepped on it and doubled my money easy lol
    +1
  • BigOnYa @ BigOnYa:
    I'd be afraid to it nowdays, my heart would explode prob. I just stick beers n buds nowdays.
  • Psionic Roshambo @ Psionic Roshambo:
    I would get to drive from tarpon springs to like Miami a thousand bucks lol do that twice a week and back in 92 that was good money
  • Xdqwerty @ Xdqwerty:
    @BigOnYa,
    @Psionic Roshambo what are you guys talking about?
  • Psionic Roshambo @ Psionic Roshambo:
    Blew it on women and muscle cars lol
    +1
  • BigOnYa @ BigOnYa:
    @Xdqwerty Hamster food, its pricey nowadays to keep PCs running.
    +2
  • Psionic Roshambo @ Psionic Roshambo:
    I don't do anything except cigarettes and gotta stop eventually lol
    +1
  • BigOnYa @ BigOnYa:
    I'd do shrooms again if could find, and I was outside camping/fishing, and had a cooler full of beer.
    +1
  • Psionic Roshambo @ Psionic Roshambo:
    I wouldn't mind some LSD, laughing until my face hurt sounds fun lol
    +1
    Psionic Roshambo @ Psionic Roshambo: I wouldn't mind some LSD, laughing until my face hurt sounds fun lol +1