GCN way to automatically verify dumps for wii

MarioMasta64

hi. i make batch stuff and portable shiz
OP
Member
Joined
Dec 21, 2016
Messages
2,297
Trophies
0
Age
26
Website
github.com
XP
2,106
Country
United States
is there any way i can automate the verification of gamecube and wii disc dumps in mass on a headless server by their id

example: my copy of pokemon xd gales of darkness is GXXE01

i do not want to use a gui and its preferred to be a linux tool (or even if theres an api i can use)

i found redump which is nice but i dont know any way to turn something like GXXE01 into http://redump.org/disc/1845/ do they have any kind of api?

basically all i need is any way to get the hash that the dump is supposed to be

ive also tried seeing if quick searching could help as a middle but it doesnt appear that you can search things this way http://redump.org/discs/quicksearch/gxxe01/
 

EnterpriseFreak

Well-Known Member
Newcomer
Joined
Sep 2, 2021
Messages
92
Trophies
0
Age
22
XP
996
Country
Germany
I don't know if it's good enough for you but I've made a bash script for that just now (needs wget and sha1sum commands):
https://pastebin.com/haribGkc

script.jpg
 

MarioMasta64

hi. i make batch stuff and portable shiz
OP
Member
Joined
Dec 21, 2016
Messages
2,297
Trophies
0
Age
26
Website
github.com
XP
2,106
Country
United States
im just doing this: redump_url=$(curl -Ls -o /dev/null -w %{url_effective} "http://redump.org/discs/quicksearch/$redump_code")

it would be nice if there was a way i could query this stuff directly

i did it this way after remembering that i had to also take off the versioning for images off of gametdb

i also save these hashes instead of just taking them everytime i go so that i dont have to bug the site owners with my requests (that much)

so i got it sorted out already but thank you anyways
I don't know if it's good enough for you but I've made a bash script for that just now (needs wget and sha1sum commands):
https://pastebin.com/haribGkc

View attachment 324843
 

MarioMasta64

hi. i make batch stuff and portable shiz
OP
Member
Joined
Dec 21, 2016
Messages
2,297
Trophies
0
Age
26
Website
github.com
XP
2,106
Country
United States
unfortunately while it works 95% of the time you sometimes have moments where it goes:
rlee (ah yes the garfield game and this wii game right!?" no no lol
this also applies to things with multiple versions
i wish you could sort by console or search only for the games code but it seems like the filters on the site are lackluster
 
Last edited by MarioMasta64,

Sypherone

Gaming Ninja
Member
GBAtemp Patron
Joined
Apr 28, 2019
Messages
1,656
Trophies
2
Age
44
XP
2,839
Country
Germany
Wii backup manager implies directly hash codes to verify the integrity of a wbfs image. So maybe they are stored already. So basicly it needs to be read out and the image can be verified.
An MD5 Hash is calculated and stored in each disc transferred to a drive, so it's possible to verify the data integrity at a later date. The hash isn't calculated for ISO yet.
 

MarioMasta64

hi. i make batch stuff and portable shiz
OP
Member
Joined
Dec 21, 2016
Messages
2,297
Trophies
0
Age
26
Website
github.com
XP
2,106
Country
United States
Wii backup manager implies directly hash codes to verify the integrity of a wbfs image. So maybe they are stored already. So basicly it needs to be read out and the image can be verified.
wii backup manager neither runs headless nor is it for linux it also doesnt check gamecube games so in all three ways it is useless to me
 

EnterpriseFreak

Well-Known Member
Newcomer
Joined
Sep 2, 2021
Messages
92
Trophies
0
Age
22
XP
996
Country
Germany
wii backup manager neither runs headless nor is it for linux it also doesnt check gamecube games so in all three ways it is useless to me
You could calculate the CRC32 or SHA-1 of the ISO first and then use that hash instead of the game code for /quicksearch/. Maybe that helps you?
 
  • Like
Reactions: MarioMasta64

MarioMasta64

hi. i make batch stuff and portable shiz
OP
Member
Joined
Dec 21, 2016
Messages
2,297
Trophies
0
Age
26
Website
github.com
XP
2,106
Country
United States
You could calculate the CRC32 or SHA-1 of the ISO first and then use that hash instead of the game code for /quicksearch/. Maybe that helps you?
maybe? the main issue is that crc/md5 calculations are really slow

i could use it and store the value for the first time then get it from the server and then use the gameid as a fallback but i want to be able to copy en masse before doing a check so that i can fix bugs if they arise without having to wait for verification for 5 years

i have like 300+ dumps and its unfeasable to do it this way when i do this in big amounts
 

MarioMasta64

hi. i make batch stuff and portable shiz
OP
Member
Joined
Dec 21, 2016
Messages
2,297
Trophies
0
Age
26
Website
github.com
XP
2,106
Country
United States
it does appear that it is a method i can use but its on the back burner since id want something faster than calculating the hash before checking
 

Attachments

  • 16617666714923352976065540185863.jpg
    16617666714923352976065540185863.jpg
    5.8 MB · Views: 30

MarioMasta64

hi. i make batch stuff and portable shiz
OP
Member
Joined
Dec 21, 2016
Messages
2,297
Trophies
0
Age
26
Website
github.com
XP
2,106
Country
United States
the main reason is that i cant wait around for 1500 minutes because it updates a user accessible resource that should be made beforehand the calculations are done afterhand
 

Attachments

  • 1661767173871540972544289059187.jpg
    1661767173871540972544289059187.jpg
    2.3 MB · Views: 22

Sypherone

Gaming Ninja
Member
GBAtemp Patron
Joined
Apr 28, 2019
Messages
1,656
Trophies
2
Age
44
XP
2,839
Country
Germany
I didnt have used or tryed them on my own. So sorry, u need to dig and try by yourself.
On the first look, with Wimms ISO Tool can be verified WII and GC ISO`S.
And with Wimms WBFS Tool can wbfs images be verified.
 
  • Like
Reactions: MarioMasta64

MarioMasta64

hi. i make batch stuff and portable shiz
OP
Member
Joined
Dec 21, 2016
Messages
2,297
Trophies
0
Age
26
Website
github.com
XP
2,106
Country
United States
I don't know if it's good enough for you but I've made a bash script for that just now (needs wget and sha1sum commands):
https://pastebin.com/haribGkc

View attachment 324843
so i decided to take a hybrid approach to this by calculating the md5 only when it cant normally find the page and then searching it with that

and while it adds a little bit of overhead it isnt as bad since i only have to do it once and its somewhat rare that it happens

i can also try and assume anything not found is likely a bad dump
 

Site & Scene News

Popular threads in this forum

General chit-chat
Help Users
  • Psionic Roshambo @ Psionic Roshambo:
    I just want a Pokemon Hell Raiser fan game 😭
  • K3Nv2 @ K3Nv2:
    Anyone wanna play with my joydock
  • BigOnYa @ BigOnYa:
    Biomutant looks cool tho, may have to try that
  • Quincy @ Quincy:
    Usually when such a big title leaks the Temp will be the first to report about it (going off of historical reports here, Pokemon SV being the latest one I can recall seeing pop up here)
  • K3Nv2 @ K3Nv2:
    I still like how a freaking mp3 file hacks webos all that security defeated by text yet again
  • BigOnYa @ BigOnYa:
    They have simulators for everything nowdays, cray cray. How about a sim that shows you playing the Switch.
  • K3Nv2 @ K3Nv2:
    That's called yuzu
    +1
  • BigOnYa @ BigOnYa:
    I want a 120hz 4k tv but crazy how more expensive the 120hz over the 60hz are. Or even more crazy is the price of 8k's.
  • K3Nv2 @ K3Nv2:
    No real point since movies are 30fps
  • BigOnYa @ BigOnYa:
    Not a big movie buff, more of a gamer tbh. And Series X is 120hz 8k ready, but yea only 120hz 4k games out right now, but thinking of in the future.
  • K3Nv2 @ K3Nv2:
    Mostly why you never see TV manufacturers going post 60hz
  • BigOnYa @ BigOnYa:
    I only watch tv when i goto bed, it puts me to sleep, and I have a nas drive filled w my fav shows so i can watch them in order, commercial free. I usually watch Married w Children, or South Park
  • K3Nv2 @ K3Nv2:
    Stremio ruined my need for nas
  • BigOnYa @ BigOnYa:
    I stream from Nas to firestick, one on every tv, and use Kodi. I'm happy w it, plays everything. (I pirate/torrent shows/movies on pc, and put on nas)
  • K3Nv2 @ K3Nv2:
    Kodi repost are still pretty popular
  • BigOnYa @ BigOnYa:
    What the hell is Kodi reposts? what do you mean, or "Wut?" -xdqwerty
  • K3Nv2 @ K3Nv2:
    Google them basically web crawlers to movie sites
  • BigOnYa @ BigOnYa:
    oh you mean the 3rd party apps on Kodi, yea i know what you mean, yea there are still a few cool ones, in fact watched the new planet of the apes movie other night w wifey thru one, was good pic surprisingly, not a cam
  • BigOnYa @ BigOnYa:
    Damn, only $2.06 and free shipping. Gotta cost more for them to ship than $2.06
  • BigOnYa @ BigOnYa:
    I got my Dad a firestick for Xmas and showed him those 3rd party sites on Kodi, he loves it, all he watches anymore. He said he has got 3 letters from AT&T already about pirating, but he says f them, let them shut my internet off (He wants out of his AT&T contract anyways)
  • K3Nv2 @ K3Nv2:
    That's where stremio comes to play never got a letter about it
  • BigOnYa @ BigOnYa:
    I just use a VPN, even give him my login and password so can use it also, and he refuses, he's funny.
  • BigOnYa @ BigOnYa:
    I had to find and get him an old style flip phone even without text, cause thats what he wanted. No text, no internet, only phone calls. Old, old school.
    BigOnYa @ BigOnYa: I had to find and get him an old style flip phone even without text, cause thats what he wanted...