ROM Hack sky3ds diskwriter python clone (for linux & osx)

[lukas_2511]

Bytearray definitely doesnt work for me in python3, but passing the plist string directly to loads() does.

https://docs.python.org/3/library/plistlib.html#plistlib.loads "Loads a plist from a bytes object"

Python 3.4.2 (default, Jan 12 2015, 11:38:40) 
[GCC 4.9.2 20141224 (prerelease)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import plistlib
>>> plistlib.loads("")
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/lib/python3.4/plistlib.py", line 1004, in loads
    fp = BytesIO(value)
TypeError: 'str' does not support the buffer interface

Should really be a bytearray.

And python2 equivalent function takes a string:

https://docs.python.org/2/library/plistlib.html#plistlib.readPlistFromString "Read a plist from a string."

 

[lukas_2511]

Or wait... mh... maybe diskutil_output already is a bytearray... mh... no idea.

 

[NoSmokingBandit]

All I know is that with loads(bytarray(output)) I get errors. With loads(output) everything works. I won't pretend I understand why.

 

[lukas_2511]

All I know is that with loads(bytarray(output)) I get errors. With loads(output) everything works. I won't pretend I understand why.

Mhkay, i'll write it on the list of things i have to check.

 

[NoSmokingBandit]

In disk.py, line 94 (at least in the version I have)

diskutil_output = subprocess.check_output(["diskutil", "list", "-plist", self.disk_path])
print(type(diskutil_output))

prints <class 'bytes'>

So thats good to know.

In python 2.7 it prints <type 'str'> as expected.

 

[benseab23]

Clie, try my latest update. It seems to be working for me.


Benseab, it pretty much is done. Lukas got all of the functional parts done a while ago, I've just been playing around making it pretty (and testing a few mac things for him). Its super simple to use, but if you've never heard of python I can understand that it would be confusing. I'll make a mini-guide some day soon.



OK great thank you I await patiently. Cheers

 

[benseab23]

Hi guys,

I'm really, really close to figuring this out for myself. The problem for me now seems to be even after I manually unmount the SD card so python can get at it, my SD card isn't formatted in a way SKY3DS is happy with - I'm getting this message:

This is not a sky3ds disk. Aborting.

Anyone able to help me with this? Whether in terminal or with the GUI I get the same problem.

 

[Cliemacfr]

Use the GUI to format the card. It's in the menu.

 

[Cliemacfr]

NoSmokingBandit : Works in python3 with the change in disk.py

I have to say that the writing process is way faster under python3...

EDIT : Thanks again, I think that your fantastic job, Lukas_2511 and NoSmokingBandit, is making our Sky3ds life a nice dream.... Thanks you both.

 

[NoSmokingBandit]

Hi guys,

I'm really, really close to figuring this out for myself. The problem for me now seems to be even after I manually unmount the SD card so python can get at it, my SD card isn't formatted in a way SKY3DS is happy with - I'm getting this message:

This is not a sky3ds disk. Aborting.

Anyone able to help me with this? Whether in terminal or with the GUI I get the same problem.

You shouldn't need to do anything outside of the diskwriter program. It will unmount anything necessary, format everything correctly, and mostly take care of itself.

Once the disk is formatted the disk gets mounted, but no volumes on it are since everything is basically Raw at that point and no operating system will read it directly. The code Lukas made very specifically finds out what is on the card and where, which is what allows reading/writing.

Did you get it working after Clie's suggestion?


And Clie, did you ever get any save backups working? I read somewhere that you need to cycle through all of the games on your card before it reloads the saves from the sd card correctly.

 

[lukas_2511]

I suggest adding a very small game as first game on the sdcard, and every time you want to change something about games or savegames on the card switch to that game before pulling the sdcard out of the sky3ds. I have lost so many savegames because I didn't switch the game first (it seems to write it to sdcard - at least for card1 games - only when switching the game)...

 

[Cliemacfr]

i had a save backup working, yes with yoshi's island for example but I was unable to do it with zelda MM.
I'm not trying now because I'm to deep into the game to lose it. But I will try Lukas_2511 trick next time. I didn't try the switch thing.

 

[cearp]

lukas_2511 - very cool, thanks for this
i'm on a mac and so this will be useful, i was thinking of doing something similar, so i appreciate it.
so this will work fine for a complete replacement? and apart from it doesn't check for a disk limit (no real problem for me)
i can give it new template files and things? and can i give it my header for it to inject in the template?

 

[lukas_2511]

lukas_2511 - very cool, thanks for this
i'm on a mac and so this will be useful, i was thinking of doing something similar, so i appreciate it.
so this will work fine for a complete replacement? and apart from it doesn't check for a disk limit (no real problem for me)
i can give it new template files and things? and can i give it my header for it to inject in the template?

Hey,

no problem
Yea this thing can work as a complete replacement for the normal DiskWriter utility.

You can place a new template file and it will convert it to its own format automatically (still needs to be directly from sky3ds because of the unknown 16 bytes - that i assume are a cryptographic hash of some kind...).

It should now actually also check for the disk limit, both in size and number of games.

The easiest way to inject headers or at least unique ids is to use 3dz files, if the script detects that you are using a 3dz file it will automatically use the data from that file. Other than that you can create a header.bin with a unique id, but that stuff is kinda untested, and i probably won't do anything more with it.

Next to the cli interface there is also a gui version by NoSmokingBandit that I still didn't get around to merge into the repository...

Development of this thing will from now on be a lot slower since I switched to Gateway for various reasons (those freezes and savegame fuckups on sky3ds... it was enough... lost hours of gameplay... also homebrew, fuck yea).
Still want to fix (at least some) bugs (if reported properly... DON'T SEND ME EMAILS PEOPLE, USE GITHUB ISSUES!!11 ), but won't add new features from now on.
If anybody wants to maintain this project, and can prove that they know what they are doing (some pull requests or something), I may add them as contributors to the repository, or even transfer the whole thing over.

 

[cearp]

that sounds good, cool that it can use .3dz
i have a gw for my old3ds, the sky3ds is just for my n3ds until gw release their update
thanks for all the hard work!

 

[Chaldron]

Hey,

no problem
Yea this thing can work as a complete replacement for the normal DiskWriter utility.

You can place a new template file and it will convert it to its own format automatically (still needs to be directly from sky3ds because of the unknown 16 bytes - that i assume are a cryptographic hash of some kind...).

It should now actually also check for the disk limit, both in size and number of games.

The easiest way to inject headers or at least unique ids is to use 3dz files, if the script detects that you are using a 3dz file it will automatically use the data from that file. Other than that you can create a header.bin with a unique id, but that stuff is kinda untested, and i probably won't do anything more with it.

Next to the cli interface there is also a gui version by NoSmokingBandit that I still didn't get around to merge into the repository...

Development of this thing will from now on be a lot slower since I switched to Gateway for various reasons (those freezes and savegame fuckups on sky3ds... it was enough... lost hours of gameplay... also homebrew, fuck yea).
Still want to fix (at least some) bugs (if reported properly... DON'T SEND ME EMAILS PEOPLE, USE GITHUB ISSUES!!11 ), but won't add new features from now on.
If anybody wants to maintain this project, and can prove that they know what they are doing (some pull requests or something), I may add them as contributors to the repository, or even transfer the whole thing over.

Just one question: If I've already injected the headers into my template.txt using No Ban No Sky (Windows program), will your program function normally and use those headers in the file I gave it, and thus nullify the risk of being banned? Or does it work differently?

But also, thank you very much for writing this. I've got a desktop Mac and a Windows laptop and I hate copying over GBs worth of ROMs so I can use DiskWriter on the laptop. Thanks again!

 

[newbcake]

Damn, wish this would get a Cocoa-esque or JAVA GUI to streamline things

 

[NoSmokingBandit]

There's a gui script floating somewhere around here. Its just done with Tkinter because its easy and ubiquitous.

 

[lukas_2511]

There's a gui script floating somewhere around here. Its just done with Tkinter because its easy and ubiquitous.

I just pushed your gui code to the git repository.

 

[NoSmokingBandit]

Wooo cool thanks. I had played around with a wx interface since it looks much more native on linux window managers, but I got everything working correctly in osx, rebooted to linux to try it out and nothing worked. Its like writing html for webkit then trying to figure out why IE8 renders it like hell.

Tk works. If anyone wants to improve, go for it.