[Release] MSBT Editor Reloaded

Discussion in '3DS - ROM Hacking, Translations and Utilities' started by IcySon55, Dec 18, 2015.

  1. IcySon55
    OP

    IcySon55 GBAtemp Fan

    Member
    335
    301
    Mar 18, 2008
    Canada
    Hey there gbatemp,

    Notice: For a more advanced and complete MSBT solution, check out Kuriimu.

    I created this editor a while ago to support a translation project I was planning; Which is now cancelled since Picross 3D 2 is slated for a North American release. It has since grown beyond anything I could have imagined and is now used by many in the modding community on all sorts of projects. I hope you find it useful in your own projects!

    Credit is welcome. ;)

    [​IMG]

    Releases

    MSBT Editor Reloaded v0.9.8
    • Fixed CSV exporting.
    Older Changelog Entries:
    Warning: Spoilers inside!

    Planned Feature(s)
    • Creating MSBT files from scratch.
    Supported MSBT Sections
    • LBL1 - Full support.
    • NLI1 - Preliminary support. Most content is unknown.
    • ATO1 - Preliminary support. Content is all 0xFF without padding.
    • ATR1 - Preliminary support. Content is usually blank.
    • TSY1 - Preliminary support. Content is unknown.
    • TXT2 - Full support.
    Supported Games
    • Super Mario 3D Land - Not tested.
    • Mario Kart 7 - Supported.
    • Super Mario Galaxy 2 - Partially tested.
    • Super Smash Bros. 3DS - Supported.
    • Super Smash Bros. WiiU - Supported.
    • Mario & Luigi Paper Jam - Supported.
    • Art Academy - Partially tested.
    • Detective Pikachu - Supported.
    • Miitomo - Partially tested.
    • Animal Crossing: New Leaf - Supported.
    • Tokyo Mirage Sessions #FE - Supported.
    • Paper Mario: Sticker Star - Not tested.
    • Paper Mario: Color Splash - Supported.
    • Others may be supported, need feedback.
    XMSBT Translation Tools
    • This is the MSBT translator's dream feature! This format allows translators to work together and collaborate on the same file(s) without losing any work due to files being overwritten or files being impossible to merge easily.
    • Export an open MSBT file to the human readable XMSBT (XML) format.
    • Import XMSBT files into an open MSBT file. Text is imported by matching the label names.
    • Batch Export and Batch Import support all of the same features as the single file tools.
    • To use the batch tools, keep the MSBT and XMSBT files in the same directory. (Export does this automatically, and Import expects it.)
    • Export only the differences between two MSBT files to an XMSBT delta file using the new Export Mod feature!
    Other Features
    • Add and Remove labels. (Limited to files with an LBL1 section which is 99% of them.)
    • Find - I've added the ability to search for strings in the file making translation that much easier.
    • Search Directory - Works like Find except that it searches all MSBT files in a directory. (Subdirectories supported)
    • Export CSV - Exports the currently open file and any changes made to a CSV file.
    • BG4 Extraction - Extract files from within BG4 archives found in games like Mario & Luigi Paper Jam.
    • LZ11 De/Compression - Compress and Decompress files using LZ11. Held onto this feature from Exelix11's original version.
    • UMSBT Extraction & Packing - Extract MSBT files from UMSBT archives and repack them into UMSBT archives.
    • v0.9.7 will correct broken files that were previously broken by v0.9.6 and v0.9.5b. Just open the broken file and then click save to fix it. Broken files created by v0.9.5 and below can not currently be fixed with the program. Contact me directly if you need your heavily modified file fixed so you don't lose any work.
    Known Issues
    • v0.8.6 - LZ11 Compression windows do not appear. Update to v0.9.0+.
    • v0.9.6 and below - Label renaming is broken. Update to v0.9.7+.
     
    Last edited by IcySon55, Jun 15, 2017


  2. Ridge

    Ridge The Queen Anemone

    Member
    373
    289
    Sep 10, 2015
    Norway
    Lunatea
    Wow, this is really helpful! Nice work :D
     
  3. IcySon55
    OP

    IcySon55 GBAtemp Fan

    Member
    335
    301
    Mar 18, 2008
    Canada
    MSBT Editor Reloaded v0.5 Beta
    • Added support for sub strings. Certain MSBT files contain null bytes in between string offsets.
    • Added new shortcut keys. When focus is given to the Edit text box:
      • Ctrl+A selects all text
      • Tab cycles down through the strings. Shift+Tab cycles up.
    • Added a preview text box that shows all sub strings concatenated together.
    • Patched saving so that the section size is correctly written to the file.
     
    Last edited by IcySon55, Dec 21, 2015
    I pwned U! and hippy dave like this.
  4. DarkFlare69

    DarkFlare69 GBAtemp Psycho!

    Member
    4,710
    2,563
    Dec 8, 2014
    United States
    Ohio
    What does this provide over the other one?
     
  5. IcySon55
    OP

    IcySon55 GBAtemp Fan

    Member
    335
    301
    Mar 18, 2008
    Canada
    1. Accuracy (I hope... With v0.6+, full accuracy has been achieved!)
      • If you open a file in the previous editor and save it, the contents will be different. (At least for the files I was working with. This may not be the case for Mario Kart 7 MSBT files.)
      • My program can open an MSBT and when you save it as another file, the two are identical. This was an important goal of mine since I needed an MSBT tool to translate a game.
      • There is currently only one file I tested where it doesn't output the exact same file. Still investigating that one. Fixed!
    2. Features
      • Sub-string support. The MSBT files I'm working with seem to have more than one string in each entry. The previous editor was actually missing all but the first string. Data was being lost resulting in incomplete translations and nobody would even know it was happening!
      • Use-able hex view. The hex view in Reloaded can actually be used to edit the strings instead of just showing the bytes. It also displays them neatly in a standard hex grid.
    3. More Supported Games
      • Super Mario 3D Land
      • Mario Kart 7
      • Super Mario Galaxy 2
      • Mario & Luigi Paper Jam
      • and one other I'm not going to mention yet. ;)
    ...and I guess, it has a bit more polish? Shortcut keys, icons, etc... :P

    P.S. I'm not mentioning the game I'm translating in this explanation because I want it to be a surprise for everyone here.
     
    Last edited by IcySon55, Dec 24, 2015
    I pwned U! likes this.
  6. IcySon55
    OP

    IcySon55 GBAtemp Fan

    Member
    335
    301
    Mar 18, 2008
    Canada
    MSBT Editor Reloaded v0.6

    Read and Write accuracy is now 100%
    • Added support for BigEndian files which includes Super Mario Galaxy 2 support.
    • The last major action will now be displayed in the center at the bottom.
    • File changes will now be tracked and the user will be prompted to save changes when opening another file or quitting the program.
    • Patched sub string support to properly read in the last set of strings in the file.
    • Fixed text boxes not updating when text is changed in the edit and hex views.
    • The tab key now also cycles through sub strings and doesn't depend on focus being given to the Edit text box to function.
    • Ctrl+A now works on all text boxes including the hex view.
    MSBT Editor Reloaded v0.7
    • Added some error handling to correct files that were edited with v0.4.
    • Patched a few UI bugs that prevented some features from working properly.
    • When saving, the Original entries now get updated without reloading the file.
     
    Last edited by IcySon55, Dec 21, 2015
    hippy dave and I pwned U! like this.
  7. IcySon55
    OP

    IcySon55 GBAtemp Fan

    Member
    335
    301
    Mar 18, 2008
    Canada
    MSBT Editor Reloaded v0.8
    • Added support for Mario & Luigi Paper Jam MSBT files.
    • Added a tool to extract files from BG4 archives. An M&LPJ archive format containing MSBT files.
     
    I pwned U! and SomeGamer like this.
  8. aldelaro5

    aldelaro5 Newbie

    Newcomer
    8
    3
    Jan 16, 2015
    Canada
    I actually just tried and it's really weird.

    Some file just tells me the program couldn;t read until the end of the stream (while the files clearly has a BG4 header) others extracts, but it;s just .bin files with appropriate file names and 0 bytes in them (so empty)

    Did I do something wrong?
     
    CaptainSwag101 likes this.
  9. caprathebest

    caprathebest GBAtemp Regular

    Member
    113
    32
    May 15, 2014
    Italy
    I was working on a python parser yesterday, but you beated me on time lol. Btw some MSBT files from the FMsg.dat aren't working, since they use a different struct (like they have the standard MsgStdBn header, but then the next "magic" value changes to a BL1 instead of a LBL1). If you want some of them feel free to ask, or I'll need to learn C# lol
     
  10. IcySon55
    OP

    IcySon55 GBAtemp Fan

    Member
    335
    301
    Mar 18, 2008
    Canada
    Can you provide an example file that isn't working? PM would be fine.

    Which of the files in FMsg is not loading in the editor? There are many... I have FMsg at hand, I would only need to know the filename so I can extract and test the file.

    You guys need to be more specific and provide example files. I can't magic the data off your hard drives. :P
     
  11. caprathebest

    caprathebest GBAtemp Regular

    Member
    113
    32
    May 15, 2014
    Italy
    Sorry, but I wrote it quickly so I forgot to quote the files.
    Every file inside FMsg doesn't work with the editor, except f_desert_1
     
  12. IcySon55
    OP

    IcySon55 GBAtemp Fan

    Member
    335
    301
    Mar 18, 2008
    Canada
    Really? I just extracted all 311 files, and basically all of them work in the editor. Are you extracting the FMsg.bin from Mario & Luigi Paper Jam Bros.? If it's from another game, then I'm not sure it'll work 100%.
     
  13. caprathebest

    caprathebest GBAtemp Regular

    Member
    113
    32
    May 15, 2014
    Italy
    Yeah I'm working with Paper Jam (I'm documenting the unused stuff inside the game, check this out).
    Btw the non-working files are inside the EU_it folder. The EU_en ones are working perfectly. Just wanted to let you know
     
  14. IcySon55
    OP

    IcySon55 GBAtemp Fan

    Member
    335
    301
    Mar 18, 2008
    Canada
    That's a very important detail! I'll give those files a once over. See what's different.

    Edit: Aaaand it works just fine... All files are working. See all the Italian text in the editor. Try re-downloading the v0.8 archive and trying it again.
     
    Last edited by IcySon55, Dec 28, 2015
  15. caprathebest

    caprathebest GBAtemp Regular

    Member
    113
    32
    May 15, 2014
    Italy
    Found a lot of E3 leftovers inside Paper Jam thanks to your tool :D
    You're awesome!
     
  16. IcySon55
    OP

    IcySon55 GBAtemp Fan

    Member
    335
    301
    Mar 18, 2008
    Canada
    Many thanks! Did re-downloading solve the problem?
     
  17. caprathebest

    caprathebest GBAtemp Regular

    Member
    113
    32
    May 15, 2014
    Italy
    Yup.
     
  18. mustafag32g

    mustafag32g GBAtemp Advanced Fan

    Member
    640
    439
    Jul 30, 2014
    Argentina
    will we ever get a 3d land level editor :((
     
  19. IcySon55
    OP

    IcySon55 GBAtemp Fan

    Member
    335
    301
    Mar 18, 2008
    Canada
    I imagine somebody would have to do something like:

    Steps to get a working 3D Land Level Editor
    1. Reverse engineer the level file format.
    2. Create conversion tools that convert 3D Studio Max, Maya, Blender, etc. models into 3D Land Level format models. This may include collision meshes, enemies, items, and more.
    3. Create a level viewer/editor that allows you to view the level and potentially place objects, like coins, enemies, the goal post, your starting location, etc., and to set options like the music, level time, etc.
    All quite a bit of work that would take a lot of time.
     
    Last edited by IcySon55, Dec 29, 2015
  20. IcySon55
    OP

    IcySon55 GBAtemp Fan

    Member
    335
    301
    Mar 18, 2008
    Canada
    MSBT Editor Reloaded v0.8.1
    • More fully reverse engineered the BG4 format. BG4 extraction success is basically 100% now.
    • Some files inside BG4 archives without extensions now extract with their expected extensions.
      • Only MSBT, BCH, and PTX for now.
      • If the extension is in the BG4 already, it will be used.
    • Cleaned up some UI handling code. Used directories are now remembered properly.
    • Added some minor exception handling checks.
     
    Last edited by IcySon55, Dec 29, 2015