Homebrew [Release] FBI - Open source CIA installer

[Deleted User]

If that's the case, why does SocketPunch have an option to use either Legacy Mode or Newest Mode... and why the drastic decrease in speed ever since 2.x? Sorry man, I just can't believe that. Everyone who uses FBI has experienced the massive slowdown since 2.x. It's quite obvious something changed in the way data is being sent.



QR is really no different than "Network Install". Install Python, "pip install" the other things mentioned in the readme file via command prompt, then it's a simple drag and drop to get the QR code. What we need is a fix once and for all for the crummy speeds since 2.x. Love FBI but this seriously needs a fix.

The protocol was changed to improve multi-file support, hence the two modes. However, the actual part where it sends a file's data is the same; only the before and after were changed.

The only thing I can think of is a difference in speed between performing the install on the main CPU core in the main thread versus on the syscore in a thread. However, that would then also impact installations from the SD card, plus I'm not particularly willing to compromise on that design.

 

[Christian jensen]

Here's a pack with all the necessary files along with a readme on how to install. Takes no more than 30-60 seconds after Python is installed and is only a one time deal. After that it's just drag and drop. Although if you want 2x or more faster speeds I recommend using 1.4.17.

https://docs.google.com/uc?id=0ByDqcsw8nd6VYlNLMHlkRmxvbjg

well think you missed my point of why do all these extra steps when socketpunch was all i needed. im back on 2.4.2 as install speed havent been an issue for me personally. And yes i just like the ease of using socketpunch to install my cia's over network since i dont have to be messing with generating QR codes and all that

 

[hellionz]

i will back to 2.4.2 too...the improvement wont be better than lose socket punch install . when the old network install back or QR process be better optimized, i will upgrade up to 2.4.4 ....

its a shame @Steveice10

thx

 

[D34DL1N3R]

well think you missed my point of why do all these extra steps when socketpunch was all i needed. im back on 2.4.2 as install speed havent been an issue for me personally. And yes i just like the ease of using socketpunch to install my cia's over network since i dont have to be messing with generating QR codes and all that

I think you missed a few points. 1) I was trying to be helpful for those who may have difficulties understanding how to set it up 2) Extra steps? You drag and drop your cia then point your 3ds at the code. Once you take the 30 seconds out of your life, it is no more or less steps than SocketPunch 3) It's not possible for you to not have the speed issue, unless you were given a magical version of 2.x that no one else has. The near twice as slow speed is something that effects everyone. You're not exempt.

 

[Deleted User]

FBI v2.4.5 has been released.

• Add warning when opening the NAND.
  
• Decrease buffer size of transfers over HTTP. Should help with speed.
• Display transfer speed in copy operations.
• Enable N3DS speed-up.
• Revise remote installation into a list of methods for receiving URLs.
  • "Receive URLs over the network" - Listens on port 5000 for a length followed by a list of URLs, separated by new-line characters. Installs from the provided list of URLs, and sends a confirmation byte back when the installation has completed.
  • "Scan QR Code" - Turns on the camera and scans for QR codes.
  • "Manually enter URLs" - Opens up the software keyboard for manually typing URLs, separated by new-line characters.
  • "Repeat last request" - Repeats the last set of URLs used in an installation request.
  • "Forget last request" - Forgets the last set of URLs used in an installation request.
• servefiles: Adapt to "Receive URLs over the network" method of remote installation. Now only requires Python and no additional dependencies. Run with "python servefiles.py (ip) (file/directory)".

The change of being able to receive URLs over the network instead of through a QR code should provide an experience nearly identical to the old network installer, except through the standard HTTP protocol as was intended by the original move to the QR code installer.

I thought it was a pretty well known fact that network installs with 2.x versions are a great deal slower than they were on 1.4.17. For an example Re: Revelations took nearly 2 hours to install on 2.4.4 vs. an hour with 1.4.17. Sure you may not have any hiccups... but it's slow as molasses. Install the version recommended in the OP of the SocketPunch thread & see for yourself.

I've added the transfer speed to the progress UI. Can you try an installation over the network on the latest version and report what speeds you're getting? The expected should be around 500-600KiB/s for an old 3DS and 1MiB/s for a new 3DS.

 

[Pacman`]

Getting over 1.3 MiB/sec using the QR code with latest nightly (but older servefiles.py) and Python 2.7.
Having trouble using latest servefiles.py with url though...

EDIT:

c:\servefiles>servefiles.py 192.168.0.134 00514.cia
Preparing data...

URLS:
192.168.0.100:8080/00514.cia

Opening HTTP server on port 8080...
Sending URL(s) to 192.168.0.134:5000...
Error: [Errno 10061] No connection could be made because the target machine acti
vely refused it
Shutting down HTTP server...

--------------------- MERGED ---------------------------

Should it be using port 8080 or port 5000?

 

[Deleted User]

Getting over 1.3 MiB/sec using the QR code with latest nightly (but older servefiles.py) and Python 2.7.
Having trouble using latest servefiles.py with url though...

EDIT:

c:\servefiles>servefiles.py 192.168.0.134 00514.cia
Preparing data...

URLS:
192.168.0.100:8080/00514.cia

Opening HTTP server on port 8080...
Sending URL(s) to 192.168.0.134:5000...
Error: [Errno 10061] No connection could be made because the target machine acti
vely refused it
Shutting down HTTP server...

--------------------- MERGED ---------------------------

Should it be using port 8080 or port 5000?

Did you open the "Receive URLs over the network" screen on your 3DS?

 

[Pacman`]

Did you open the "Receive URLs over the network" screen on your 3DS?

yes

--------------------- MERGED ---------------------------

e:\Consoles\Nintendo\1a-3DS XL (Red)\Utilities\[CIA]\FBI - Open Source CIA Insta
ller\servefiles>servefiles_url.py 192.168.0.134 00514.cia
Preparing data...

URLS:
192.168.0.100:8080/00514.cia

Opening HTTP server on port 8080...
Sending URL(s) to 192.168.0.134:5000...
192.168.0.134 - - [24/Dec/2016 11:59:14] code 404, message File not found
192.168.0.134 - - [24/Dec/2016 11:59:14] "GET /00514.cia▒ HTTP/1.1" 404 -
Shutting down HTTP server...

--------------------- MERGED ---------------------------

Now using scan qr code method:

e:\Consoles\Nintendo\1a-3DS XL (Red)\Utilities\[CIA]\FBI - Open Source CIA Insta
ller\servefiles>servefiles_qr.py 00514.cia
Preparing data...

URLS:
192.168.0.100:8080/00514.cia

Generating QR code...
Opening HTTP server on port 8080...
Displaying QR code...
192.168.0.134 - - [24/Dec/2016 12:04:08] "GET /00514.cia HTTP/1.1" 200 -


That works

 

[Pacman`]

with Latest commit 9182ebf
I have to precede command with python now, but still get error:

e:\Consoles\Nintendo\1a-3DS XL (Red)\Utilities\[CIA]\FBI - Open Source CIA Insta
ller\servefiles>python servefiles.py 192.168.0.134 00514.cia
Preparing data...

URLS:
192.168.0.100:8080/00514.cia

Opening HTTP server on port 8080...
Sending URL(s) to 192.168.0.134:5000...
192.168.0.134 - - [24/Dec/2016 12:22:42] code 404, message File not found
192.168.0.134 - - [24/Dec/2016 12:22:42] "GET /00514.cia╣ HTTP/1.1" 404 -
Shutting down HTTP server...

 

[tiduscrying]

Using the servefiles.py script and sending the URL over the network is working perfectly for me. Currently sending over a ~400MB file at 1.50MiB/s, very nice!

 

[Deleted User]

with Latest commit 9182ebf
I have to precede command with python now, but still get error:

e:\Consoles\Nintendo\1a-3DS XL (Red)\Utilities\[CIA]\FBI - Open Source CIA Insta
ller\servefiles>python servefiles.py 192.168.0.134 00514.cia
Preparing data...

URLS:
192.168.0.100:8080/00514.cia

Opening HTTP server on port 8080...
Sending URL(s) to 192.168.0.134:5000...
192.168.0.134 - - [24/Dec/2016 12:22:42] code 404, message File not found
192.168.0.134 - - [24/Dec/2016 12:22:42] "GET /00514.cia╣ HTTP/1.1" 404 -
Shutting down HTTP server...

For curiosity's sake, can you try using Python 3?

 

[Pacman`]

just did, same thing with python 3.51 (python-3.5.1-amd64 (Windows x86-64 executable installer))

--------------------- MERGED ---------------------------

c:\TMP>pip install Pillow-3.4.2-cp35-cp35m-win_amd64.whl
Processing c:\tmp\pillow-3.4.2-cp35-cp35m-win_amd64.whl
Installing collected packages: Pillow
Successfully installed Pillow-3.4.2

c:\TMP>pip install netifaces-0.10.5-cp35-cp35m-win_amd64.whl
Processing c:\tmp\netifaces-0.10.5-cp35-cp35m-win_amd64.whl
Installing collected packages: netifaces
Successfully installed netifaces-0.10.5

c:\TMP>pip install qrcode-5.3-py2.py3-none-any.whl
Processing c:\tmp\qrcode-5.3-py2.py3-none-any.whl
Collecting six (from qrcode==5.3)
Downloading six-1.10.0-py2.py3-none-any.whl
Installing collected packages: six, qrcode
Successfully installed qrcode-5.3 six-1.10.0

--------------------- MERGED ---------------------------

With python 3.5.1, latest nightly and QR code install, it works:

Preparing data...

URLS:
192.168.0.100:8080/00514.cia

Generating QR code...
Opening HTTP server on port 8080...
Displaying QR code...
192.168.0.134 - - [24/Dec/2016 13:08:30] "GET /00514.cia HTTP/1.1" 200 -

--------------------- MERGED ---------------------------

getting fast speeds like 1.38 MiB/s

--------------------- MERGED ---------------------------

I will stick with QR Code Install
Thanks for all your efforts

 

[Deleted User]

just did, same thing with python 3.51 (python-3.5.1-amd64 (Windows x86-64 executable installer))

--------------------- MERGED ---------------------------

c:\TMP>pip install Pillow-3.4.2-cp35-cp35m-win_amd64.whl
Processing c:\tmp\pillow-3.4.2-cp35-cp35m-win_amd64.whl
Installing collected packages: Pillow
Successfully installed Pillow-3.4.2

c:\TMP>pip install netifaces-0.10.5-cp35-cp35m-win_amd64.whl
Processing c:\tmp\netifaces-0.10.5-cp35-cp35m-win_amd64.whl
Installing collected packages: netifaces
Successfully installed netifaces-0.10.5

c:\TMP>pip install qrcode-5.3-py2.py3-none-any.whl
Processing c:\tmp\qrcode-5.3-py2.py3-none-any.whl
Collecting six (from qrcode==5.3)
Downloading six-1.10.0-py2.py3-none-any.whl
Installing collected packages: six, qrcode
Successfully installed qrcode-5.3 six-1.10.0

--------------------- MERGED ---------------------------

With python 3.5.1, latest nightly and QR code install, it works:

Preparing data...

URLS:
192.168.0.100:8080/00514.cia

Generating QR code...
Opening HTTP server on port 8080...
Displaying QR code...
192.168.0.134 - - [24/Dec/2016 13:08:30] "GET /00514.cia HTTP/1.1" 200 -

--------------------- MERGED ---------------------------

getting fast speeds like 1.38 MiB/s

--------------------- MERGED ---------------------------

I will stick with QR Code Install
Thanks for all your efforts

Does this version of the new script work any better for you? https://www.dropbox.com/s/0joj8ko315iophe/servefiles.py?dl=1

 

[Joto007]

Quick question for someone more knowledgeable than me:

Is it possible to use FBI with 11.2 even if I have primary Homebrew access? I was planning on using FBI with Shameless to download games to my SD card.

Thank you for your help!

 

[McWhiters9511]

Quick question for someone more knowledgeable than me:

Is it possible to use FBI with 11.2 even if I have primary Homebrew access? I was planning on using FBI with Shameless to download games to my SD card.

Thank you for your help!

nope

 

[Pacman`]

Does this version of the new script work any better for you? https://www.dropbox.com/s/0joj8ko315iophe/servefiles.py?dl=1

Nope

Tried latest 340278e : same thing

c:\servefiles>python servefiles.py 192.168.0.134 00514.cia
Preparing data...

URLS:
192.168.0.100:8080/00514.cia

Opening HTTP server on port 8080...
Sending URL(s) to 192.168.0.134:5000...
192.168.0.134 - - [24/Dec/2016 13:46:05] code 404, message File not found
192.168.0.134 - - [24/Dec/2016 13:46:05] "GET /00514.cia\xb9 HTTP/1.1" 404 -
Shutting down HTTP server...

 

[KunoichiZ]

Quick question for someone more knowledgeable than me:

Is it possible to use FBI with 11.2 even if I have primary Homebrew access? I was planning on using FBI with Shameless to download games to my SD card.

Thank you for your help!

No it's not possible. You need CFW.

 

[Pacman`]

Using FBI_v2.4.5.340278e with QR Code Install, I was able to install Resident Evil Revelations
a 3222MB cia in 41 min => 1.31 MB/s average

That's amazing and faster than SocketPunch-v1.2.5.c3d79fb + FBI-chen-fix4 in Legacy Mode!
and without ever crashing

 

[D34DL1N3R]

FBI v2.4.5 has been released.

• Add warning when opening the NAND.
  
• Decrease buffer size of transfers over HTTP. Should help with speed.
• Display transfer speed in copy operations.
• Enable N3DS speed-up.
• Revise remote installation into a list of methods for receiving URLs.
  • "Receive URLs over the network" - Listens on port 5000 for a length followed by a list of URLs, separated by new-line characters. Installs from the provided list of URLs, and sends a confirmation byte back when the installation has completed.
  • "Scan QR Code" - Turns on the camera and scans for QR codes.
  • "Manually enter URLs" - Opens up the software keyboard for manually typing URLs, separated by new-line characters.
  • "Repeat last request" - Repeats the last set of URLs used in an installation request.
  • "Forget last request" - Forgets the last set of URLs used in an installation request.
• servefiles: Adapt to "Receive URLs over the network" method of remote installation. Now only requires Python and no additional dependencies. Run with "python servefiles.py (ip) (file/directory)".

The change of being able to receive URLs over the network instead of through a QR code should provide an experience nearly identical to the old network installer, except through the standard HTTP protocol as was intended by the original move to the QR code installer.

I've added the transfer speed to the progress UI. Can you try an installation over the network on the latest version and report what speeds you're getting? The expected should be around 500-600KiB/s for an old 3DS and 1MiB/s for a new 3DS.

Wil be able to test Monday.

 

[Deleted User]

Nope

Tried latest 340278e : same thing

c:\servefiles>python servefiles.py 192.168.0.134 00514.cia
Preparing data...

URLS:
192.168.0.100:8080/00514.cia

Opening HTTP server on port 8080...
Sending URL(s) to 192.168.0.134:5000...
192.168.0.134 - - [24/Dec/2016 13:46:05] code 404, message File not found
192.168.0.134 - - [24/Dec/2016 13:46:05] "GET /00514.cia\xb9 HTTP/1.1" 404 -
Shutting down HTTP server...

Can you try this, then? I don't expect it to work, but I added some debug output that would be helpful to have.

https://www.dropbox.com/s/0joj8ko315iophe/servefiles.py?dl=1