Open-source AR device, Monocle, launches arGPT app

monocleAR.jpg

The extended reality (XR) market has been experiencing a boom as of late, with companies like XREAL, Rokid and even Apple launching new XR-related products. While hailing from different companies, these devices are similar in that they are closed source and can get quite pricey; but Brilliant Labs is taking a new approach with their AR device, the Monocle, as is open source and more affordable than competitors.

In addition, the device packs a different form factor than what we've been used to. Rather than being a whole headset, the Monocle works by clipping it onto your own glasses (like its namesake) to provide a heads-up display. Enclosed in the device is a host of sensors and components, including a 720p camera, touch sensor and micro OLED display, all weighing 15g. The display output is at 640x400 resolution with a 20° FOV and can be programmed through a web interface.

Currently, the Monocle needs to be paired to a smartphone to activate some cloud-based apps but Brilliant Labs aims to eventually do away with a phone host. The company has also recently received new investments to further pursue its AR goals.

monocle specs.jpg


monocle 1.jpg monocle 2.jpg

Costing $349, the Monocle has already started shipping to consumers, but the target is mainly developers, tinkerers and early adopters who already amount to 2,000 in the Discord community. The device can thus be mostly considered as a dev kit but some interesting applications have been developed, with the latest being from Brilliant Labs itself. The company has launched arGPT for the Monocle, a ChatGPT integration that enables users to interact with and experience ChatGPT commands right from their eyes. The video below shows the new app in action:



It would be interesting to see further gaming and general uses of this tech, as devices like the Nreal Air have become popular for mirroring game consoles' display on a larger, virtual screen. As commands on arGPT can range from games recommendations to game walkthroughs, the Monocle could become a gaming companion for such use cases; or maybe even have dedicated text-based games. As this is an open-source device, its potential lies within the community input and we'll likely come across more software for the Monocle in the near future.

:arrow: SOURCE
 

rcpd

Well-Known Member
Member
Joined
Jan 31, 2023
Messages
617
Trophies
0
Age
55
XP
1,385
Country
United States
As someone who cannot see near objects very well at all, this absolutely pains me to say that it will be utterly useless to people like myself. Especially because, being born with only one working eye, traditional VR/XR/AR headsets also don’t work for me. This is the first one I was excited about because… Well because it doesn’t require two eyes and depth perception.

Fuck my life, man.
 

Djidane

Member
Newcomer
Joined
Sep 13, 2009
Messages
7
Trophies
1
XP
566
Country
Belgium
I wouldn't mind nice/stylish glasses (even if it is use as display only) for that price. Almost convinced myself to buy google one if cheaper.
That thing is way to big.
 

Metoroid0

Samus Aran
Member
Joined
Nov 2, 2012
Messages
2,260
Trophies
1
Location
Unknown region of space
Website
www.metroidwiki.org
XP
2,214
Country
Japan
OMG enough with the VR, AR bullshit already...Jesus!
Post automatically merged:

But can it display crysis? No crysis, no buy.
It can play DooM 95...
Post automatically merged:

You don't see it because it's over 9000.
Will that meme ever die? (i don't think so)
 
  • Like
Reactions: Kevbo

pinbi7

Well-Known Member
Member
Joined
Apr 4, 2004
Messages
611
Trophies
2
XP
2,097
Country
Canada
what bugs me the most is the form factor, why not make glasses and hide some of the components inside the frame, they even show the darn thing being mounted onto glasses! oh right! it's because everybody and their mothers are making AR glasses these days!
 

Redhorse

Warehouse 13 Curator
Member
Joined
Apr 11, 2011
Messages
608
Trophies
1
Location
Between a Rock and a Hard Place for now
XP
1,142
Country
United States
great for spies being fed info..

Futurama episode where Lila and Fry are hiding in a 3d theatre on an all-robot planet

Watching a 3d movie with glasses: Fry (wearing blue and red specs) says this 3d is great... Lila ( with one eye) moves the glasses from the red to the blue lenses and back repeatedly saying..
" Mine's not working"
 

MikaDubbz

Well-Known Member
Member
Joined
Dec 12, 2017
Messages
3,850
Trophies
1
Age
36
XP
7,313
Country
United States
great for spies being fed info..

Futurama episode where Lila and Fry are hiding in a 3d theatre on an all-robot planet

Watching a 3d movie with glasses: Fry (wearing blue and red specs) says this 3d is great... Lila ( with one eye) moves the glasses from the red to the blue lenses and back repeatedly saying..
" Mine's not working"
With only one eye though Leela would never be able to properly recognize depth to begin with. 3D vision both in movies and in reality would be a concept beyond her grasp of comprehension to begin with. Which totally makes it all the more concerning that she was named captain/pilot of Planet Express.
 

Veho

The man who cried "Ni".
Former Staff
Joined
Apr 4, 2006
Messages
11,389
Trophies
3
Age
42
Location
Zagreb
XP
41,337
Country
Croatia
With only one eye though Leela would never be able to properly recognize depth to begin with. 3D vision both in movies and in reality would be a concept beyond her grasp of comprehension to begin with. Which totally makes it all the more concerning that she was named captain/pilot of Planet Express.
She compensates for a lack of binocular vision with increased acuity for monocular depth cues, thanks to the freakishly oversized eyeball.

Also there's plenty of one-eyed pilots out there.

And also she's the only member of the crew who isn't a complete moron.

She's just annoying.
 

MikaDubbz

Well-Known Member
Member
Joined
Dec 12, 2017
Messages
3,850
Trophies
1
Age
36
XP
7,313
Country
United States
Also there's plenty of one-eyed pilots out there.
Even if there are, it's gotta make it all that much more of a barrier to that path in life. Not that she couldn't rise above the odds, it's just a bizarre choice of a career to give her specifically.
 

Site & Scene News

Popular threads in this forum

General chit-chat
Help Users
  • K3Nv2 @ K3Nv2:
    How do you know if the night will be good when you're asleep
  • BakerMan @ BakerMan:
    because i didn't say i was asleep
  • BakerMan @ BakerMan:
    i said i was sleeping...
  • BakerMan @ BakerMan:
    sleeping with uremum
  • K3Nv2 @ K3Nv2:
    Even my mum slept on that uremum
  • TwoSpikedHands @ TwoSpikedHands:
    yall im torn... ive been hacking away at tales of phantasia GBA (the USA version) and have so many documents of reverse engineering i've done
  • TwoSpikedHands @ TwoSpikedHands:
    I just found out that the EU version is better in literally every way, better sound quality, better lighting, and there's even a patch someone made to make the text look nicer
  • TwoSpikedHands @ TwoSpikedHands:
    Do I restart now using what i've learned on the EU version since it's a better overall experience? or do I continue with the US version since that is what ive been using, and if someone decides to play my hack, it would most likely be that version?
  • Sicklyboy @ Sicklyboy:
    @TwoSpikedHands, I'll preface this with the fact that I know nothing about the game, but, I think it depends on what your goals are. Are you trying to make a definitive version of the game? You may want to refocus your efforts on the EU version then. Or, are you trying to make a better US version? In which case, the only way to make a better US version is to keep on plugging away at that one ;)
  • Sicklyboy @ Sicklyboy:
    I'm not familiar with the technicalities of the differences between the two versions, but I'm wondering if at least some of those differences are things that you could port over to the US version in your patch without having to include copyrighted assets from the EU version
  • TwoSpikedHands @ TwoSpikedHands:
    @Sicklyboy I am wanting to fully change the game and bend it to my will lol. I would like to eventually have the ability to add more characters, enemies, even have a completely different story if i wanted. I already have the ability to change the tilemaps in the US version, so I can basically make my own map and warp to it in game - so I'm pretty far into it!
  • TwoSpikedHands @ TwoSpikedHands:
    I really would like to make a hack that I would enjoy playing, and maybe other people would too. swapping to the EU version would also mean my US friends could not legally play it
  • TwoSpikedHands @ TwoSpikedHands:
    I am definitely considering porting over some of the EU features without using the actual ROM itself, tbh that would probably be the best way to go about it... but i'm sad that the voice acting is so.... not good on the US version. May not be a way around that though
  • TwoSpikedHands @ TwoSpikedHands:
    I appreciate the insight!
  • The Real Jdbye @ The Real Jdbye:
    @TwoSpikedHands just switch, all the knowledge you learned still applies and most of the code and assets should be the same anyway
  • The Real Jdbye @ The Real Jdbye:
    and realistically they wouldn't

    be able to play it legally anyway since they need a ROM and they probably don't have the means to dump it themselves
  • The Real Jdbye @ The Real Jdbye:
    why the shit does the shitbox randomly insert newlines in my messages
  • Veho @ Veho:
    It does that when I edit a post.
  • Veho @ Veho:
    It inserts a newline in a random spot.
  • The Real Jdbye @ The Real Jdbye:
    never had that i don't think
  • Karma177 @ Karma177:
    do y'all think having an sd card that has a write speed of 700kb/s is a bad idea?
    trying to restore emunand rn but it's taking ages... (also when I finished the first time hekate decided to delete all my fucking files :wacko:)
  • The Real Jdbye @ The Real Jdbye:
    @Karma177 that sd card is 100% faulty so yes, its a bad idea
  • The Real Jdbye @ The Real Jdbye:
    even the slowest non-sdhc sd cards are a few MB/s
  • Karma177 @ Karma177:
    @The Real Jdbye it hasn't given me any error trying to write things on it so I don't really think it's faulty (pasted 40/50gb+ folders and no write errors)
    Karma177 @ Karma177: @The Real Jdbye it hasn't given me any error trying to write things on it so I don't really...