If you can use the browser, I suggest that you use the new browserhax (up to 11.0.0-33!) in the meantime.

Try out Ubuntu 15.04: http://old-releases.ubuntu.com/releases/15.04/

This requires a New 3DS. The demo version doesn't work and is patched. If you have 1.1.3 or newer delete/disable the update data.
officially called smashbroshax sometimes smashax
Here is a new tool I call smashbroshax-helper. It is a graphical interface for the exploit which simplifies most of the process of broadcasting the packet. It requires almost no setup outside of creating a bootable Linux USB/DVD.

Important notes:

• This does not work on Fedora or Red Hat-based distributions because aircrack-ng needs to be compiled on it (and I can't figure out how to install the needed things).
  
• Don't use a virtual machine!
• This probably will never work on Old 3DS.

Download smashbroshax-helper beta

It is recommended that you use a live Ubuntu 15.04 image. Versions 15.10+ have issues. http://old-releases.ubuntu.com/releases/15.04/

1. Create a bootable USB/DVD with a Linux distribution (there are various guides online).
2. If possible, get a second USB/SD card/storage device, download and save the above .zip to it.
   • Don't extract the contents of it to the USB device, as it might cause problems. Just save the .zip file to it.
   • If you can't do this, you'll have to connect to the Internet while in Linux to download it.
   • If using a bootable USB, make sure you can use two ports at a time. Don't take out the Linux USB while it is being used!
3. Restart your computer and run the bootable USB/DVD you created.
4. Extract the contents of the .zip to the Desktop.
5. Open the smashbroshax-helper folder and double click "smashbroshax.sh".
6. Follow the on-screen prompts.
7. If everything goes well, you should now have homebrew!

Video demonstration, from boot to shutdown:

from https://gbatemp.net/threads/tutorial-using-smashhax-with-linux.397194/page-9#post-5842512

---

If you would like the full tutorial, involving terminal usage and compiling:

Spoiler: Everything

To reverse the changes to your wireless interface and remove issues connecting to networks after, rebooting your system or changing it to "Managed" instead of "monitor" should fix it. How to do that is in the second to last section.

---

@Cydget made a script that condenses most of this into a script. I have not tried it myself yet but it seems to work for others.

Spoiler

So, I made a little script for this. If anybody wants it, then unzip this file and read the readme. And yes, I like to pipe things. http://www.mediafire.com/download/oulnubnzkk9g3i0/smashhaxEZ.zip

---

Requirements

• Any Linux distribution should do (this has only been tested with Debian-based distributions). Windows and OS X users should wait or find a method for now, sorry!
  • Please do not use Linux in a virtual machine, it likely won't give direct access to your wireless card. Dual boot or use a live USB/disk.
  • The recommended distro to use is Ubuntu 15.04 (link to Ubuntu MATE 15.04).
• A Wi-Fi-capable wireless card.
• Super Smash Bros. for Nintendo 3DS Full or Demo.
• New 3DS. This does not work on Old 3DS.
• Patience. The hax is sort-of unreliable so your game will most likely crash a few times.
• Recommended: Another device to access the internet (phone, tablet, computer, console).

Preparing

• Install these packages using your package manager. For example, "apt-get" for Debian-based distributions (including Ubuntu).

  openssl libssl-dev libnl-genl-3-200 libnl-genl-3-dev libnl-3-200 libnl-3-dev pkg-config

• Find your wireless card's interface by opening a terminal and using the command "ip link". It would be something like wlan0 or wlp3s0.

  ian@ian-VPCEG34FX:~/Desktop/aircrack-ng-1.2-rc2/src$ ip link
  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default 
      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
  2: eth0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc pfifo_fast state DOWN mode DEFAULT group default qlen 1000
      link/ether xx:xx:xx:xx:xx:xx brd ff:ff:ff:ff:ff:ff
  3: wlan0: <NO-CARRIER,BROADCAST,ALLMULTI,PROMISC,NOTRAILERS,UP,LOWER_UP> mtu 1500 qdisc mq state DORMANT mode DORMANT group default qlen 1000
      link/ieee802.11/radiotap xx:xx:xx:xx:xx:xx brd ff:ff:ff:ff:ff:ff

• You probably already have it, but get the homebrew starter kit and place it on your SD card.
• Download the smashhax .pcap files from the releases section of the smashbroshax repository.
• Determine the .pcap file to use. This should be straightforward using the file names.

  The built beacon-hax pcaps are located under "pcap_out/". In the filenames, "vXYZ" means game-version "vX.Y.Z". Full-game filenames for USA include "gameusa", while the other regions filenames include "gameother".

• Get the "Otherapp payload" from the Homebrew Launcher site and save it to "smashpayload.bin" at the root of your SD card.
  
• Download and extract aircrack-ng's latest release source.
• Save aireplay-ng.patch from the smashbroshax repository in the folder "aircrack-ng-1.2-rc2".

Compiling aircrack-ng/aireplay-ng

• Open a terminal and go to the "aircrack-ng-1.2-rc2" folder.
• Use the command "patch src/aireplay-ng.c < aireplay-ng.patch". If you get the following then it has succeeded.

  patching file src/aireplay-ng.c
  Hunk #1 succeeded at 560 (offset 1 line).
  Hunk #2 succeeded at 573 (offset 1 line).

• Run "make" and wait. The program should be compiled with the patch now. If you get the following as the last line then it has succeeded.

  make[1]: Leaving directory '/path/to/aircrack-ng-1.2-rc2/src'

The moment of truth

• Run these 3 terminal commands in order, using the wireless interface (from "ip link") you found earlier.
  
  sudo ifconfig wireless_interface down
  sudo iwconfig wireless_interface mode monitor
  sudo ifconfig wireless_interface up
  sudo iwconfig wireless_interface channel 6​
  (the last line was suggested by @difool. and might make the payload trigger faster)
• Enter the "src" folder in your terminal.
• Run the following command to start broadcasting the packet: "sudo ./aireplay-ng --interactive -r /path/to/smashbros_version_beaconhax.pcap -h 59:ee:3f:2a:37:e0 -x 10 wireless_interface"
  Use the .pcap file and wireless interface you found out earlier.
• On the 3DS system, start the game, then choose Smash and Group. Wait for the magic to happen.

Encountering errors? Something confusing?

• Does running aireplay-ng end with "End of file"? You might be running your installed version of aircrack-ng. Don't forget the ./ for "sudo ./aireplay-ng ..."!
• Please tell me the distribution you are using and the error you've encountered. This will help me fix your issue faster.
• If you don't get something, don't hesitate to point it out! I want to help anyone I can.
• Did you spot an inaccuracy or mistake I made? It would be great if you can tell me that too.
• This was before the Otherapp payload selector was added to the HBL site. This is kept here for legacy reasons or something.
  Spoiler

  • Determine what file you need to get from the Homebrew Launcher Payload section:
    
    Spoiler: Homebrew Launcher Payload

    With the release builds, the hax loads the payload from SD "/smashpayload.bin". This should contain the hb-launcher(https://smealum.github.io/3ds/) otherapp payload. Until there's a proper otherapp payload selector on the hb-launcher site, the payload can be downloaded from the following URL(see also https://github.com/smealum/sploit_installer):
    

    • "https://smealum.github.io/ninjhax2/Pvl9iD2Im5/otherapp/{PAYLOADNAME}.bin" Where {PAYLOADNAME} is: "FIRMVER_REGION_MENUVER_MSETVER".

    FIRMVER values(without quotes):
    

    • "POST5" = non-New3DS
    • "N3DS" = New3DS

    REGION values(without quotes):
    

    • "U" = USA
    • "E" = EUR
    • "J" = JPN

    MENUVER values(without quotes):
    

    • "11272": Non-JPN, system-version v9.0.
    • "12288": System-version v9.2.
    • "13330": System-version v9.3.
    • "14336": System-version v9.4.
    • "15360": System-version v9.5.
    • "16404": System-version v9.6.
    • "17415": System-version v9.7.
    • "20480_usa": USA, system-versions v9.9-v10.0.
    • "19456": Non-USA, system-versions v9.8-v10.0.

    MSETVER values(without quotes):
    

    • "8203": System-versions below v9.6.
    • "9221": System-versions starting with v9.6.

    For example, the payload URL for New3DS USA 9.9.0-X - 10.0.0-X is:https://smealum.github.io/ninjhax2/Pvl9iD2Im5/otherapp/N3DS_U_20480_usa_9221.bin
    The end result is a file named "smashpayload.bin" at the root of your SD card.

You are allowed to reproduce/reprint this tutorial, as long as a link back to this page (https://gbatemp.net/threads/tutorial-using-smashhax-with-linux.397194/) is included.

 

[Woodigel]

But yours is eshop? Because, I've deleted the updates as well and mine stays on 1.0.4
Well, I've given up trying to enter through smash. I get payed in a few days, and I'll buy the powersaves and OoT.

no mine is a cartridge game Have you deleted the right data? It is tagged as [Update Data].

 

[Guriam]

I've even formated the sd card. And it was on 1.0.4
Am I doing something wrong?

 

[Woodigel]

I've even formated the sd card. And it was on 1.0.4
Am I doing something wrong?

pm me ill try to help

 

[mollymax]

anyway to do this on windows?

 

[mollymax]

on 1.0.1 is it normal to keep getting the error message that reboots you to the home menu?

 

[pancakes077]

I've even formated the sd card. And it was on 1.0.4
Am I doing something wrong?

Different cartridges are of different default versions. Your cartridge was made in 1.0.4. His cartridge is probably much older, being 1.0.0 by default.

Question: does anyone know how to make a pcap file? I have a 1.1.0 cartridge and would like to make a pcap file for it. Not for me, my 3DS already has a CFW installed, but for anyone else who also ends up buying a 1.1.0 cartridge.

--------------------- MERGED ---------------------------

on 1.0.1 is it normal to keep getting the error message that reboots you to the home menu?

If you're getting rebooted to the home menu, that usually means that you're using the wrong pcap.

 

[mollymax]

Different cartridges are of different default versions. Your cartridge was made in 1.0.4. His cartridge is probably much older, being 1.0.0 by default.

Question: does anyone know how to make a pcap file? I have a 1.1.0 cartridge and would like to make a pcap file for it. Not for me, my 3DS already has a CFW installed, but for anyone else who also ends up buying a 1.1.0 cartridge.

--------------------- MERGED ---------------------------


If you're getting rebooted to the home menu, that usually means that you're using the wrong pcap.

What pcpap would i have to use for 1.0.1 1.0.0. or 1.0.2. or do i have to make my own?

 

[pancakes077]

What pcpap would i have to use for 1.0.1 1.0.0. or 1.0.2. or do i have to make my own?

What Region?

 

[mollymax]

What Region?

USA

 

[pancakes077]

USA

Do you have a cartridge that came with 1.0.1?

 

[mollymax]

Do you have a cartridge that came with 1.0.1?

It came with 1.0.0 but i deleted the update which gave it 1.0.1

 

[pancakes077]

If it came with 1.0.0 deleting the update should go back to 1.0.0, I'm pretty sure. Are you sure that you deleted it?

 

[mollymax]

Yup im sure for whatever reason it just sends it to 1.0.1 i even formatted my system the other day

 

[pancakes077]

And you're also sure that it came with 1.0.0? That would imply that it install the update to the cartridge itself, which I don't think ever happens.

--------------------- MERGED ---------------------------

Yup im sure for whatever reason it just sends it to 1.0.1 i even formatted my system the other day

Try this one.

https://www.dropbox.com/s/syp1x1itbm1vxw2/sbh.pcap?dl=0

 

[mollymax]

And you're also sure that it came with 1.0.0? That would imply that it install the update to the cartridge itself, which I don't think ever happens.

--------------------- MERGED ---------------------------


Try this one.

https://www.dropbox.com/s/syp1x1itbm1vxw2/sbh.pcap?dl=0

do i just put into the pcap_out folder? sorry im kinda new to this stuff

 

[pancakes077]

do i just put into the pcap_out folder? sorry im kinda new to this stuff

Are you using the script from the main post? If so then adding it won't work I think. If you replace it with a preexisting pcap file, that should work though.

So choose any of the preexisting pcaps, delete it, rename the new pcap to the same name, and put it in the folder. Select that one.

 

[mollymax]

Are you using the script from the main post? If so then adding it won't work I think. If you replace it with a preexisting pcap file, that should work though.

So choose any of the preexisting pcaps, delete it, rename the new pcap to the same name, and put it in the folder. Select that one.

OK thankyou will try

 

[pancakes077]

OK thankyou will try

That pcap works for the 1.0.1 digital version. I used it myself. If it doesn't work (sends you back to the home screen), then I'm pretty sure you're out of luck.

 

[mollymax]

That pcap works for the 1.0.1 digital version. I used it myself. If it doesn't work (sends you back to the home screen), then I'm pretty sure you're out of luck.

booted me back to home menu.... gg

 

[pancakes077]

booted me back to home menu.... gg

That's really something that should be made more clear in the guide I think. The pcaps were made for the eShop versions/update versions of the game (apart from 1.0.0, which doesn't have an eShop version).