PS1/2 Emulator WiiStation - Another Fork of WiiSXRX released

[SaulFabre]

I tested the Zstandard compression using

chdman createcd -i input.cue -o output.chd -c zstd,cdzs

I think zstd and cdzs are exactly the same compression type, lol.
So it should be
chdman createcd -i input.cue -o output.chd -c cdzs

Have you tried also this for achieve a little more compression? (ZStandard+FLAC)
chdman createcd -i input.cue -o output.chd -c cdzs,cdfl

 

[_47iscool]

I think zstd and cdzs are exactly the same compression type, lol.
So it should be
chdman createcd -i input.cue -o output.chd -c cdzs

Have you tried also this for achieve a little more compression? (ZStandard+FLAC)
chdman createcd -i input.cue -o output.chd -c cdzs,cdfl

I would prefer using the "cdzs" cmd argument instead of the other, due to the last three letters.

 

[ssjkakaroto]

@SaulFabre from a quick test, Akumajou DraculaX and Final Fantasy 8 seem to be working fine with Zstd CHDs.
Thanks a lot for updating the lib!

 

[Hyllian]

Have you tried also this for achieve a little more compression? (ZStandard+FLAC)
chdman createcd -i input.cue -o output.chd -c cdzs,cdfl

Tested here this compression with SOTN and RE1DC. Both worked, though SOTN has stuttering issues since the last Jokkipo update.

 

[Ouaz]

I think zstd and cdzs are exactly the same compression type, lol.

Oh?

I followed chdman documentation, as i saw "data" for one and "audio data" for the other, and thinking that "zstd" has to be precised (as it is not default).

"
zstd – Zstandard
Compresses data using the Zstandard algorithm. This gives very good compression and decompression performance with better compression ratios than zlib deflate

cdzs – Zstandard for CD-ROM data
Compresses audio data and subchannel data from CD-ROM sectors separately using the Zstandard algorithm. This gives very good compression and decompression performance with better compression ratios than zlib deflate
"

Ah, yes, cdzs can be used alone:
"Zstandard is not enabled by default so new CHDs will not be incompatible by default.
Use zstd for regular Zstandard codec, and cdzs for Zstandard CD codec."

Have you tried also this for achieve a little more compression? (ZStandard+FLAC)
chdman createcd -i input.cue -o output.chd -c cdzs,cdfl

Won't cdfl impact performance (and possibly induce crash on Wiistation) as a part of it use zlib algorithm ?

"
cdfl – Free Lossless Audio Codec/zlib deflate for CD-ROM data
Compresses audio data and subchannel data from CD-ROM sectors separately using the Free Lossless Audio Codec (FLAC) for audio data and the zlib deflate algorithm for subchannel data.
"

 

[SaulFabre]

Oh?

I followed chdman documentation, as i saw "data" for one and "audio data" for the other, and thinking that "zstd" has to be precised (as it is not default).

"
zstd – Zstandard
Compresses data using the Zstandard algorithm. This gives very good compression and decompression performance with better compression ratios than zlib deflate

cdzs – Zstandard for CD-ROM data
Compresses audio data and subchannel data from CD-ROM sectors separately using the Zstandard algorithm. This gives very good compression and decompression performance with better compression ratios than zlib deflate
"

Ah, yes, cdzs can be used alone:
"Zstandard is not enabled by default so new CHDs will not be incompatible by default.
Use zstd for regular Zstandard codec, and cdzs for Zstandard CD codec."



Won't cdfl impact performance (and possibly induce crash on Wiistation) as a part of it use zlib algorithm ?

"
cdfl – Free Lossless Audio Codec/zlib deflate for CD-ROM data
Compresses audio data and subchannel data from CD-ROM sectors separately using the Free Lossless Audio Codec (FLAC) for audio data and the zlib deflate algorithm for subchannel data.
"

i don't see any performance impact when using cdzs (ZStandard) and cdfl (FLAC) at the same time.

 

[ssjkakaroto]

Oh?

I followed chdman documentation, as i saw "data" for one and "audio data" for the other, and thinking that "zstd" has to be precised (as it is not default).

"
zstd – Zstandard
Compresses data using the Zstandard algorithm. This gives very good compression and decompression performance with better compression ratios than zlib deflate

cdzs – Zstandard for CD-ROM data
Compresses audio data and subchannel data from CD-ROM sectors separately using the Zstandard algorithm. This gives very good compression and decompression performance with better compression ratios than zlib deflate
"

Ah, yes, cdzs can be used alone:
"Zstandard is not enabled by default so new CHDs will not be incompatible by default.
Use zstd for regular Zstandard codec, and cdzs for Zstandard CD codec."



Won't cdfl impact performance (and possibly induce crash on Wiistation) as a part of it use zlib algorithm ?

"
cdfl – Free Lossless Audio Codec/zlib deflate for CD-ROM data
Compresses audio data and subchannel data from CD-ROM sectors separately using the Free Lossless Audio Codec (FLAC) for audio data and the zlib deflate algorithm for subchannel data.
"

CHDs using only zlib and FLAC were already faster than the ones using LZMA. The real issue was and is LZMA compression. zlib is fine.
Here's an example:

chdman - MAME Compressed Hunks of Data (CHD) manager 0.262 (mame0262)
Input file:   Akumajou Dracula X - Gekka no Yasoukyoku (Japan) (Rev 2) (En).chd
File Version: 5
Logical size: 613,204,416 bytes
Hunk Size:    19,584 bytes
Total Hunks:  31,312
Unit Size:    2,448 bytes
Total Units:  250,492
Compression:  cdzs (CD Zstandard), cdfl (CD FLAC)
CHD size:     371,396,948 bytes
Ratio:        60.6%
SHA1:         2d50511893883c3e07daca4ba7cb47ebc0b65c2b
Data SHA1:    d4937772d34393553da6d12728b87b5c0e60e368
Metadata:     Tag='CHT2'  Index=0  Length=93 bytes
              TRACK:1 TYPE:MODE2_RAW SUBTYPE:NONE FRAMES:231905 PREGAP:0 PGTYPE:MODE1 PGSUB:NONE POSTGAP:0.
Metadata:     Tag='CHT2'  Index=1  Length=91 bytes
              TRACK:2 TYPE:AUDIO SUBTYPE:NONE FRAMES:18582 PREGAP:150 PGTYPE:VAUDIO PGSUB:NONE POSTGAP:0.

     Hunks  Percent  Name
----------  -------  ------------------------------------
        17     0.1%  Copy from self
    28,990    92.6%  CD Zstandard
     2,305     7.4%  CD FLAC

We need to test with a disc with actual subchannel data to see which algorithm will take precedence to compress it.

 

[GustavoReis]

 

[Ouaz]

CHDs using only zlib and FLAC were already faster than the ones using LZMA. The real issue was and is LZMA compression. zlib is fine.

I asked because I had crashes with chd compressed with cdzl + cdfl (still Colin Mc Rae PAL). Because of cdzl then, not cdfl ?

Have you tried also this for achieve a little more compression? (ZStandard+FLAC)
chdman createcd -i input.cue -o output.chd -c cdzs,cdfl

I tried.
And the size reduction is noticeable:

Colin Mc Rae PAL:

313Mo (cdzs only) -> 268Mo (cdzs + cdfl)

chdman - MAME Compressed Hunks of Data (CHD) manager 0.263 (mame0263)
Input file:   Colin McRae Rally (Europe) (En,Fr,De,Es) (Rev 1).chd
File Version: 5
Logical size: 511,024,896 bytes
Hunk Size:    19,584 bytes
Total Hunks:  26,094
Unit Size:    2,448 bytes
Total Units:  208,752
Compression:  cdzs (CD Zstandard), cdfl (CD FLAC)
CHD size:     275,336,932 bytes
Ratio:        53.9%
SHA1:         741067e01788665ff90b9bd10fa23fae8f7948de
Data SHA1:    cc1debc7f605e5bd864ad3350d56867e91e204a4
Metadata:     Tag='CHT2'  Index=0  Length=93 bytes
              TRACK:1 TYPE:MODE2_RAW SUBTYPE:NONE FRAMES:147897 PREGAP:0 PGTYPE:MODE1 PGSUB:NONE POSTGAP:0.
Metadata:     Tag='CHT2'  Index=1  Length=91 bytes
              TRACK:2 TYPE:AUDIO SUBTYPE:NONE FRAMES:23700 PREGAP:150 PGTYPE:VAUDIO PGSUB:NONE POSTGAP:0.
Metadata:     Tag='CHT2'  Index=2  Length=91 bytes
              TRACK:3 TYPE:AUDIO SUBTYPE:NONE FRAMES:13450 PREGAP:150 PGTYPE:VAUDIO PGSUB:NONE POSTGAP:0.
Metadata:     Tag='CHT2'  Index=3  Length=91 bytes
              TRACK:4 TYPE:AUDIO SUBTYPE:NONE FRAMES:23698 PREGAP:150 PGTYPE:VAUDIO PGSUB:NONE POSTGAP:0.

Hunks       Percent  Name
----------  -------  ------------------------------------
        53     0.2%  Copy from self
    18,489    70.9%  CD Zstandard
     7,552    28.9%  CD FLAC

I didn't test it yet, to see if crashes happen or not. (It shouldn't ? as there's no subchannel data, so no zlib anywhere ?)

 

[ssjkakaroto]

I asked because I had crashes with chd compressed with cdzl + cdfl (still Colin Mc Rae PAL). Because of cdzl then, not cdfl ?


I tried.
And the size reduction is noticeable:

Colin Mc Rae PAL:

313Mo (cdzs only) -> 268Mo (cdzs + cdfl)

chdman - MAME Compressed Hunks of Data (CHD) manager 0.263 (mame0263)
Input file:   Colin McRae Rally (Europe) (En,Fr,De,Es) (Rev 1).chd
File Version: 5
Logical size: 511,024,896 bytes
Hunk Size:    19,584 bytes
Total Hunks:  26,094
Unit Size:    2,448 bytes
Total Units:  208,752
Compression:  cdzs (CD Zstandard), cdfl (CD FLAC)
CHD size:     275,336,932 bytes
Ratio:        53.9%
SHA1:         741067e01788665ff90b9bd10fa23fae8f7948de
Data SHA1:    cc1debc7f605e5bd864ad3350d56867e91e204a4
Metadata:     Tag='CHT2'  Index=0  Length=93 bytes
              TRACK:1 TYPE:MODE2_RAW SUBTYPE:NONE FRAMES:147897 PREGAP:0 PGTYPE:MODE1 PGSUB:NONE POSTGAP:0.
Metadata:     Tag='CHT2'  Index=1  Length=91 bytes
              TRACK:2 TYPE:AUDIO SUBTYPE:NONE FRAMES:23700 PREGAP:150 PGTYPE:VAUDIO PGSUB:NONE POSTGAP:0.
Metadata:     Tag='CHT2'  Index=2  Length=91 bytes
              TRACK:3 TYPE:AUDIO SUBTYPE:NONE FRAMES:13450 PREGAP:150 PGTYPE:VAUDIO PGSUB:NONE POSTGAP:0.
Metadata:     Tag='CHT2'  Index=3  Length=91 bytes
              TRACK:4 TYPE:AUDIO SUBTYPE:NONE FRAMES:23698 PREGAP:150 PGTYPE:VAUDIO PGSUB:NONE POSTGAP:0.

Hunks       Percent  Name
----------  -------  ------------------------------------
        53     0.2%  Copy from self
    18,489    70.9%  CD Zstandard
     7,552    28.9%  CD FLAC

I didn't test it yet, to see if crashes happen or not. (It shouldn't ? as there's no subchannel data, so no zlib anywhere ?)

If I'm not mistaken, FLAC is even lighter than Zstandard and deflate (zlib) as it can be decoded on many DAP's with hardware even more restricted than the Wii.

Do the crashes also happen with uncompressed bin/cue?

 

[Ouaz]

Do the crashes also happen with uncompressed bin/cue?

Nope, all's fine with cue+bin.
(I use Cue+Bin for all games -including Colin McRae-, but I also use this game for CHD tests).

So far:

- CHD Zlib (cdzl) + LZMA (cdlz) + FLAC (cdfl): crash (chdman default compression)
- CHD Zlib (cdzl) + FLAC (cdfl) : crash
- CHD Zstandard (cdzs) : no crash \o/
- CHD Zstandard (cdzs) + FLAC (cdfl) : not fully tested yet (not played enough).

From what I understand, flac use zlib algorithm only for subchannel data. I wonder if this could induce crash.
As you said, it has to be tested with a game having subchannel data, to be 100% sure it's safe.

 

[ssjkakaroto]

Nope, all's fine with cue+bin.
(I use Cue+Bin for all games -including Colin McRae-, but I also use this game for CHD tests).

So far:

- CHD Zlib (cdzl) + LZMA (cdlz) + FLAC (cdfl): crash (chdman default compression)
- CHD Zlib (cdzl) + FLAC (cdfl) : crash
- CHD Zstandard (cdzs) : no crash \o/
- CHD Zstandard (cdzs) + FLAC (cdfl) : not fully tested yet (not played enough).

From what I understand, flac use zlib algorithm only for subchannel data. I wonder if this could induce crash.
As you said, it has to be tested with a game having subchannel data, to be 100% sure it's safe.

I don't think we should worry about subchannel data in CHD's, because chdman does not support MSD/MDF or CCD/IMG/SUB or SBI files. These are the main formats that have subchannel data. Even if you try to convert a game with BIN/CUE/SBI, the SBI file will get ignored by chdman.

Having said that, there's still some performance issue with Wiistation and CCD/IMG/SUB format which I reported a while ago. For people that are playing European games with libcrypt protection, that might be relevant.

 

[SaulFabre]

Latest WiiStation build until git 0a0ee9a
https://github.com/xjsxjs197/WiiSXRX_2022/commit/0a0ee9ad0c4ce57383603d03137432fbcb55ebb9

What's new:

• psxhw: adjust sio stat (notaz). This fixes a crash in the game Formula 1 (1996, Psygnosis).
• Update to latest libCHDr and include ZStandard support (present from previous build).
• Move Lightrec's 4 MB code buffer to MEM2 memory. This makes MEM1 have a little more free memory (6 MB), which means more CHD games can be loaded/decompressed without crashes (Rayman 2, i'm looking at you!)

Please test this build, thanks!

 

[Kirby6417]

Saul you’ve been a real awesome part of the Wii modding scene for a few years now. I’ve used all sorts of stuff you worked on. Did you teach yourself how to code to do this?

 

[SaulFabre]

Saul you’ve been a real awesome part of the Wii modding scene for a few years now. I’ve used all sorts of stuff you worked on. Did you teach yourself how to code to do this?

Thanks for your appreciation, let's be honest i learned many things about the Wii/vWii and somewhat of coding by myself.
Other things i also learned from other sites, but most of the time i learned by myself xD

Btw, anyone have tested CHDs with latest build?

 

[grandosegood]

hey all, just wanted to thank the community again for the awesome work. i tested super street fighter ii 2009 remix hack, with fast load on. it played really well and the fast load did help with the loading in between matches. amazing! please note that i play usually from wii u (overclocked vwii for homebrew) and it's amazing.

question about video settings though, it seems that for Wii, using 240p with dithering to auto and no other filters are recommended? on vwii, i'm stuck at 480p, but found the games to look a bit better with all 3 filters on - text in metal gear solid and castlevania are easier to read with them on. should i leave all the filters on? what would be ideal settings?

 

[Maeson]

Depends on your tastes and each game's resolution. SOTN is a rare case because it changes resolutions very often (title screen, intro section, main gameplay, ingame menu, etc) and that makes the video output blurrier if it's using a thinner horizontal resolution, as this emulator expects a 320x224 resolution which is the most used one.

I can't tell you about MGS1, I haven't played the PS1 release in maaany years.

I personally prefer unfiltered anything. FIlters, specially Bilinear just strains my eyes pretty hard, as it makes it very hard to see detail when everything is blurry, but again, it's a taste thing.

 

[mudrik]

Sorry if this has been asked before (I cannot find a way to search in a forum thread): can original playstation discs be used by directly inserting them into the Wii slot, or do they first need to be ripped?

(I don't have any, but I could consider buy some 2nd hand ones if this works)

 

[rexus_pl]

Sorry if this has been asked before (I cannot find a way to search in a forum thread): can original playstation discs be used by directly inserting them into the Wii slot, or do they first need to be ripped?

They has to be ripped. Wii read only Wii discs (some models read Gamecube discs too).

 

[ssjkakaroto]

WiiStation Ver 3.2:

• SPU: Correction for overflow of 16 digit numbers.
• psxbios: implement yet more memcard details.
• Fixes Formula 1 freezing at first loading screen.
• Update to latest libCHDr.
• To avoid errors where CHD games occupy too much memory, move Lightrec's 4M Buffer to MEM2 memory.

https://github.com/xjsxjs197/WiiSXRX_2022/releases/tag/WiiStation_Ver3.2