Open-source AR device, Monocle, launches arGPT app

monocleAR.jpg

The extended reality (XR) market has been experiencing a boom as of late, with companies like XREAL, Rokid and even Apple launching new XR-related products. While hailing from different companies, these devices are similar in that they are closed source and can get quite pricey; but Brilliant Labs is taking a new approach with their AR device, the Monocle, as is open source and more affordable than competitors.

In addition, the device packs a different form factor than what we've been used to. Rather than being a whole headset, the Monocle works by clipping it onto your own glasses (like its namesake) to provide a heads-up display. Enclosed in the device is a host of sensors and components, including a 720p camera, touch sensor and micro OLED display, all weighing 15g. The display output is at 640x400 resolution with a 20° FOV and can be programmed through a web interface.

Currently, the Monocle needs to be paired to a smartphone to activate some cloud-based apps but Brilliant Labs aims to eventually do away with a phone host. The company has also recently received new investments to further pursue its AR goals.

monocle specs.jpg


monocle 1.jpg monocle 2.jpg

Costing $349, the Monocle has already started shipping to consumers, but the target is mainly developers, tinkerers and early adopters who already amount to 2,000 in the Discord community. The device can thus be mostly considered as a dev kit but some interesting applications have been developed, with the latest being from Brilliant Labs itself. The company has launched arGPT for the Monocle, a ChatGPT integration that enables users to interact with and experience ChatGPT commands right from their eyes. The video below shows the new app in action:



It would be interesting to see further gaming and general uses of this tech, as devices like the Nreal Air have become popular for mirroring game consoles' display on a larger, virtual screen. As commands on arGPT can range from games recommendations to game walkthroughs, the Monocle could become a gaming companion for such use cases; or maybe even have dedicated text-based games. As this is an open-source device, its potential lies within the community input and we'll likely come across more software for the Monocle in the near future.

:arrow: SOURCE
 

TiredNModding7

Member
Newcomer
Joined
Sep 3, 2023
Messages
20
Trophies
0
XP
66
Country
United States
Intriguing. Wonder how this would work with how the human brain handles vision overlap, like would you see the displayed text closer to the side, or center of your vision? Still pretty cool, though.
 

Site & Scene News

Popular threads in this forum

General chit-chat
Help Users
  • K3Nv2 @ K3Nv2:
    How do you know if the night will be good when you're asleep
  • BakerMan @ BakerMan:
    because i didn't say i was asleep
  • BakerMan @ BakerMan:
    i said i was sleeping...
  • BakerMan @ BakerMan:
    sleeping with uremum
  • K3Nv2 @ K3Nv2:
    Even my mum slept on that uremum
  • TwoSpikedHands @ TwoSpikedHands:
    yall im torn... ive been hacking away at tales of phantasia GBA (the USA version) and have so many documents of reverse engineering i've done
  • TwoSpikedHands @ TwoSpikedHands:
    I just found out that the EU version is better in literally every way, better sound quality, better lighting, and there's even a patch someone made to make the text look nicer
  • TwoSpikedHands @ TwoSpikedHands:
    Do I restart now using what i've learned on the EU version since it's a better overall experience? or do I continue with the US version since that is what ive been using, and if someone decides to play my hack, it would most likely be that version?
  • Sicklyboy @ Sicklyboy:
    @TwoSpikedHands, I'll preface this with the fact that I know nothing about the game, but, I think it depends on what your goals are. Are you trying to make a definitive version of the game? You may want to refocus your efforts on the EU version then. Or, are you trying to make a better US version? In which case, the only way to make a better US version is to keep on plugging away at that one ;)
  • Sicklyboy @ Sicklyboy:
    I'm not familiar with the technicalities of the differences between the two versions, but I'm wondering if at least some of those differences are things that you could port over to the US version in your patch without having to include copyrighted assets from the EU version
  • TwoSpikedHands @ TwoSpikedHands:
    @Sicklyboy I am wanting to fully change the game and bend it to my will lol. I would like to eventually have the ability to add more characters, enemies, even have a completely different story if i wanted. I already have the ability to change the tilemaps in the US version, so I can basically make my own map and warp to it in game - so I'm pretty far into it!
  • TwoSpikedHands @ TwoSpikedHands:
    I really would like to make a hack that I would enjoy playing, and maybe other people would too. swapping to the EU version would also mean my US friends could not legally play it
  • TwoSpikedHands @ TwoSpikedHands:
    I am definitely considering porting over some of the EU features without using the actual ROM itself, tbh that would probably be the best way to go about it... but i'm sad that the voice acting is so.... not good on the US version. May not be a way around that though
  • TwoSpikedHands @ TwoSpikedHands:
    I appreciate the insight!
  • The Real Jdbye @ The Real Jdbye:
    @TwoSpikedHands just switch, all the knowledge you learned still applies and most of the code and assets should be the same anyway
  • The Real Jdbye @ The Real Jdbye:
    and realistically they wouldn't

    be able to play it legally anyway since they need a ROM and they probably don't have the means to dump it themselves
  • The Real Jdbye @ The Real Jdbye:
    why the shit does the shitbox randomly insert newlines in my messages
  • Veho @ Veho:
    It does that when I edit a post.
  • Veho @ Veho:
    It inserts a newline in a random spot.
  • The Real Jdbye @ The Real Jdbye:
    never had that i don't think
  • Karma177 @ Karma177:
    do y'all think having an sd card that has a write speed of 700kb/s is a bad idea?
    trying to restore emunand rn but it's taking ages... (also when I finished the first time hekate decided to delete all my fucking files :wacko:)
  • The Real Jdbye @ The Real Jdbye:
    @Karma177 that sd card is 100% faulty so yes, its a bad idea
  • The Real Jdbye @ The Real Jdbye:
    even the slowest non-sdhc sd cards are a few MB/s
  • Karma177 @ Karma177:
    @The Real Jdbye it hasn't given me any error trying to write things on it so I don't really think it's faulty (pasted 40/50gb+ folders and no write errors)
    Karma177 @ Karma177: @The Real Jdbye it hasn't given me any error trying to write things on it so I don't really...