Infrared (night vision) and thermal imaging camera home-brew?

Discussion in 'Switch - Exploits, Custom Firmwares & Soft Mods' started by Nincompoopdo, Apr 14, 2018.

  1. Nincompoopdo
    OP

    Nincompoopdo GBAtemp Fan

    Member
    7
    May 20, 2017
    United States
    People have recently found out that the Switch has an infrared and thermal camera in the right joy-con. Is it possible to make a home-brew app to enable the camera? There's a LABO app that uses the Infrared and thermal camera functions, but it displays the image in a very small frame. It will be cool to use the joycon as a remote night vision camera.

    [​IMG]

    [​IMG]
     
    Last edited by Nincompoopdo, Apr 14, 2018
  2. KiiWii

    KiiWii Contributor

    pip Contributor
    18
    Nov 17, 2008
    United Kingdom
    IR: yes
    Thermal: rly?
     
    TotalInsanity4 likes this.
  3. Nincompoopdo
    OP

    Nincompoopdo GBAtemp Fan

    Member
    7
    May 20, 2017
    United States
    Yes there's a thermal sensor, I didn't know until recently. They demo a LABO app that makes the drone follow the heat source (hand):

    [​IMG]
     
    Slackot, cearp, KiiWii and 1 other person like this.
  4. Alex119098

    Alex119098 GBAtemp Regular

    Member
    2
    Dec 6, 2015
    United States
    Deep Space
    I would hope so. It seems like a cool thing to mess around with
     
  5. jurai

    jurai GBAtemp Fan

    Member
    4
    Dec 23, 2005
    are you sure that is actually a thermal sensor and not just a thermal looking rendering of the IR depth
     
    Chuardo, x65943, Ericthegreat and 2 others like this.
  6. KiiWii

    KiiWii Contributor

    pip Contributor
    18
    Nov 17, 2008
    United Kingdom
    Wow, thats a really odd thing for ninty to include :blink:
     
    x65943 likes this.
  7. Technicmaster0

    Technicmaster0 GBAtemp Psycho!

    Member
    10
    Oct 22, 2011
    Gambia, The
    x65943 likes this.
  8. notimp

    notimp Well-Known Member

    Member
    11
    Sep 18, 2007
    United States
    1st order of business - please get those full frame animated gifs out of this thread.

    2nd: It wasn't recently found out.

    3rd: Read this: https://gbatemp.net/threads/can-som...ndo-not-enabled-it-in-the-firmware-ye.499335/

    The nro in there gives you a webcam like video stream, and the Switch screenshot function works in it as well. So you can already use it to take images - today. (Currently 3.0.0 users only. Because those are the only ones that can run homebrew apps.)

    edit: Afair, you have to detach the controllers for the app to "start working".
     
    Last edited by notimp, Apr 14, 2018
  9. Mnecraft368

    Mnecraft368 I hate my name.

    Member
    8
    Aug 8, 2015
    United Kingdom
    If you sync the joycon R to a pc and download Joycon-Toolkit, you can see through the IR camera, although its pretty slow (that might just be my crap bluetooth connection though.
     
  10. Nincompoopdo
    OP

    Nincompoopdo GBAtemp Fan

    Member
    7
    May 20, 2017
    United States
    I didn't know there's a thread about this already. Glad to see someone doing it!

    — Posts automatically merged - Please don't double post! —

    According to this article at Kotaku, the camera can be switched to a heat-sensing mode:

    https://www.kotaku.com.au/2018/02/the-switch-joy-cons-infrared-sensor-is-cooler-than-we-thought/
     
  11. notimp

    notimp Well-Known Member

    Member
    11
    Sep 18, 2007
    United States
    x65943 likes this.
  12. Nincompoopdo
    OP

    Nincompoopdo GBAtemp Fan

    Member
    7
    May 20, 2017
    United States
    I use a Mac, can't try it. :(
     
  13. notimp

    notimp Well-Known Member

    Member
    11
    Sep 18, 2007
    United States
    Framerate on the (Switch "native") homebrew app isn't great either. Also - did you expect your bluetooth video streams to rival the crappy audio you get from your airpods? Because one of the two doesnt even have to stream video feeds, and still is pretty lackluster... ;)

    I extend my "not good at basic physics" description to also include gbatemp. ;)
     
  14. Nincompoopdo
    OP

    Nincompoopdo GBAtemp Fan

    Member
    7
    May 20, 2017
    United States
    I think it's either Nintendo misleading the journalists who attended the demo or there really is a heat-sensor in the joy-con. Nintendo uses thermal stickers to guide the drone around the table.

    We'll just have to wait until next week when LABO is released to find out.
     
  15. Mnecraft368

    Mnecraft368 I hate my name.

    Member
    8
    Aug 8, 2015
    United Kingdom
    Does it work using Wine (if macs have Wine)
     
  16. notimp

    notimp Well-Known Member

    Member
    11
    Sep 18, 2007
    United States
    And what I meant is, that its obvious, that this thing only has an IR camera in it, which does record light in the same wavelength spectrum, you'd be interested, in to do thermal imaging - if your baseline is room temperature.

    Take the camera. Put it close to your face, or another warm object. It shows it bright and blown out - without external light in the room.

    Or the other way around - it doesnt take a genius to extrapolate that Nintendo is probably not doing low light amplification, because by then they would produce professional night vision devices for 15k USD a pop.

    You can also read the wikipedia Article about nightvision and count how often "infrared" can be found in there:
    https://en.wikipedia.org/wiki/Night_vision_device

    Or guesstimate how much this statement makes sense to you "any manufacturer of consumer goods in this age is just visiting chinese manufacturing lines, and ticking off boxes on a pre-existing sheet of paper, regarding that factory lines usual capabilities, and in the end "their" product comes out".

    Likelyhood of N shoving a cheap sensor in there to enable "creative use cases": 100%
    Likelyhood of this being anything else than a cheap 3-5 USD implementation of a CMOS sensor without an IR filter: 0%

    (On the other hand, ... those marketing folks sound so trustworthy.. ;) )

    I'd say every tech journalist should know that. But what do I know..
     
    Last edited by notimp, Apr 14, 2018
  17. Mnecraft368

    Mnecraft368 I hate my name.

    Member
    8
    Aug 8, 2015
    United Kingdom
    12 times if anybody was wondering
     
  18. Nincompoopdo
    OP

    Nincompoopdo GBAtemp Fan

    Member
    7
    May 20, 2017
    United States
    I doubt it will work, WINE is very unreliable especially for driver related softwares.

    — Posts automatically merged - Please don't double post! —

    LOL, I don't think anyone is expecting a high grade night vision/thermal device from Nintendo. Of all companies, Nintendo is known for using cheap components. I think they are using toy-grade components - not amazing but they serve their purpose. Just like PSVR, it's not as good as Vive or Rift but it's good enough - to remain cheap for consumers.
     
  19. TotalInsanity4

    TotalInsanity4 GBAtemp Supreme Overlord

    Member
    20
    Dec 1, 2014
    United States
    Under a rock
    No they don't, they use reflective stickers that the IR camera is sensitive to
     
    Mnecraft368 likes this.
  20. guily6669

    guily6669 GbaTemp is my Drug

    Member
    7
    Jun 3, 2013
    United States
    Doomed Island
    Thermal camera costs quite a damn lot even without any quality, even a cheap crap from China I bet would cost more than the whole joy-cons...

    There's a caterpillar phone with it now, which is more aimed for workers to check electricity or heat pipes or whatever...
     
    Last edited by guily6669, Apr 14, 2018
Quick Reply
Draft saved Draft deleted
Loading...