1. GBAtemp_NextMind.png

    In one of the most sci-fi-esque videos shared in 2021 thus far, we see a macaque playing Pong with its mind; not in a movie, nor in a CGI demo, but in real life. I’m, of course, talking about the one shared by Elon Musk’s Neuralink. The animal manages to do this by means of a brain-computer interface (BCI) implanted in its skull, enabling its neural activity to interact with the game.

    Neuralink’s near-term goal is to use the technology for therapeutic purposes in order to help those who can’t use their limbs to control certain software and hardware. But eventually, they will want people to have what Musk describes as “a Fitbit in your skull” to control the technology they use with their thoughts. And the entertainment industry, including gaming, is also closely eyeing BCIs.

    Valve’s Gabe Newell has overtly expressed his interest in BCIs and in one of his most recent interviews shared part of his vision for integrating these devices to improve immersion in gaming far beyond what our “meat peripherals” currently can. Valve has also partnered with OpenBCI to jointly develop a hardware; which is likely to be a BCI-enabled VR headset. However, while Neuralink and Valve/OpenBCI have publicly shared their interests and intentions in this space, all of their progress is done behind closed doors; with their prototypes and dev kits inaccessible to most. Gabe Newell himself said that “if you're a software developer in 2022 who doesn't have one of these in your test lab, you're making a silly mistake”. So how can you dabble with BCI if you can’t have access to one?

    BCI startup NextMind might have a solution for you. Based in France, they have recently released their $400 BCI dev kit and I’ve had access to one myself along with some of its demos. Since it is a dev kit and not the final consumer version, I’ve opted for an impressions piece rather than a full review. Even the NextMind representative who walked me through the dev kit demos told me that the final product might not look like the dev kit at all and could even be integrated in a device. He compared it to the Oculus which started out as a series of dev kits before launching a consumer-ready product. This does for a pretty accurate comparison as BCI development for gaming and entertainment purposes is still in its infancy.

    end.jpg
    contents.jpg electrodes.jpg

    However, NextMind’s dev kit might as well have been the final product as its form factor is a surprisingly compact one and the device itself is very light (135x66x55mm and 60 grams). Unlike Neuralink’s BCI, the one from NextMind is non-invasive and is essentially a wearable as it comes with a headband to which the device clips to. I was quite impressed to see how small, practical and versatile NextMind designed their dev kit as it can even be inconspicuously clipped to a cap or a VR headset (more on that later). If this represents the dev kit, there’s a big chance that the final device will be even slimmer (at worst, it will stay the same which isn’t bad at all).

    Once the headband is adjusted to a comfortable fit, the BCI stays firmly at the back of your head with its dry electrodes (the 9 protrusions) making contact with your scalp. These electrodes can then read your brain activity, more specifically, activity from your visual cortex, which the device translates to an action.


    Wearing the headband with the electrodes poking at the back of your head isn't the most comfortable thing ever but it definitely isn’t unbearable. The discomfort is more apparent over time (after wearing it for 10-15 minutes) and feels a bit like applying too much pressure directly on your scalp with a comb. That said, I do hope the consumer version is made more comfortable. The headband on the other hand is comfortable as there is a thick layer of padding where it gets in contact with your forehead.

    Regarding batteries, the device packs a 240 mAh one that can be charged in 2 hours via the USB-C port on the underside of the device. Worry not as the USB-C port is only used for charging and the device works completely wirelessly as it pairs to a computer via Bluetooth (BLE). Additionally, there’s only one physical button on its right side to power it on/off and to enter pairing mode.

    electrodes 2.jpg
    button.jpg usb port.jpg

    On the software side of things, I had access to NextMind’s in-house demos which showcase the possibilities of the device. These are accessible via the NextMind Manager app and each launch requires the user to calibrate the device. This might sound inconvenient but it’s to ensure optimal performance of the BCI. Think of it the same way as you adjust the play area every time you don a VR headset.

    Calibration with NextMind’s BCI involves focusing at the center of the screen where you can see three small rotating bars. If you are focusing right (no talking or moving), the bars join to form a triangle (they can split again if you lose focus). It might sound easy when reading about it but it’s much tougher in practice. The NextMind representative who helped me during the demo walkthrough said it’s like controlling a new sense which isn’t a far-fetched claim once I’ve been through it myself. Thankfully, the process does get easier with practice.

    After I completed my first calibration process, I could have access to the demos that NextMind prepared. There’s a “TV remote” app that let me play/pause TV channels, mute/unmute them and select the one I wanted to watch; only by looking and focusing at the respective selection area on the screen. All the other demos were controlled in a similar fashion: a security lock whose pin I could type in with my eyes, directing the paddle of a Brick Breaker clone with my gaze, selecting the beats in a music composer. You can find more of the demos in the video below:


    NextMind was also very kind to provide access to a WIP VR game demo that uses their BCI and I could play it with my Oculus Quest tethered to my PC via the Oculus Link. That game involved exploding aliens by focusing on their brain and moving through portals by focusing on those.


    From those demos’ control descriptions, you might have realized something: the NextMind BCI functions similar to an eye tracker. That’s because it’s essentially what it does as it reads signals from the vision-processing area of the brain and translates the signal to information that is fed to a computer. When it works, it delivers a more wow-factor than an eye tracker but it’s tougher to get a hold of.

    Once I could control my focus my experience with the demos provided was a fun one. The response is accurate, works as intended and seeing things on-screen respond to my thoughts felt surreal and cool at the same time. This also indicated that I might as well get used to it as we will eventually have access to more and more such experiences as they seamlessly integrate with our existing or future devices.

    The technology behind it is quite impressive and goes beyond eye tracking. The true potential rests in what developers can create with it and those creations should indeed prove interesting. NextMind told me that they plan to have a section on their website to showcase their community projects and it might be worth keeping an eye on if you are interested in hte technology. When I asked the company whether they will limit themselves to control only software with their BCI, they said that it’s not necessarily the case as it’s possible to pair it with some hardware like smart switches or even coffee makers to initiate an action. This is somewhat akin to Macrotellect’s BrainLink Pro which I tested before but that one’s use is limited.

    From what I experienced, I can also see NextMind’s BCI work serve as a great accessory to other promising technologies. I particularly see it as a fit to phone-tethered Mixed Reality headsets like the Nreal Light or MAD Gaze GLOW Plus. These are more affordable, consumer-focused MR headsets, but they rely on the user controlling/navigating through MR apps with their phone. Hand tracking could work but is mostly a WIP on those devices and still requires physical input. NextMind’s BCI on the other hand is an accurate, ready-made option that could offer a totally hands-free way to perform simple navigation in MR. So in the future, we might increasingly control our devices with the power of our mind similar to how we control them with our physical force today.

    in band.jpg

    That future is at least a couple of years away at best as practical applications for BCIs is rather limited, as exemplified with my experience with the limited NextMind-compatible software. However, this is to be expected as the device is but a dev kit and will probably go through several iterations before a consumer unit hits the shelves; and by then, a thriving ecosystem could have developed around it.

    If you are a developer and want to heed to Gabe Newell’s advice, then NextMind’s dev kit presents itself as an adequate place to start developing BCI experiences. It packs promising tech in a compact form factor and the company behind it even released its SDK for developers to make use of.

    While we don’t know what the future holds for NextMind itself (they might be acquired or develop their device alongside other hardware manufacturers), BCI seems like a promising way forward as some big players are already investing heavily in the technology. So as a developer, you might not be amiss to start creating your projects with the technology and NextMind offers such an opportunity right now with its dev kit. And if you do end up developing for the device, do share your creations as I look forward to the types of experiences that can be crafted with NextMind's BCI!


    :arrow: NextMind Official Website
     
  2. Discussion (20 replies)

  3. DKB

    DKB S̵̜͎̺̔̊l̷̠̈́͗̾̏͠e̴̲͇͐e̸̹̬̔p̵̧̙̺̦̾̉.̶͚̇̎̄
    Member

    Joined:
    May 29, 2015
    Messages:
    2,023
    Country:
    United States
    a more advanced way to interact with vr porn

    yes finally

    looks cool though
     
    Louse and Soulsilve2010 like this.
  4. Vilagamer999

    Vilagamer999 tempBOT's ai cousin
    Member

    Joined:
    Jun 21, 2018
    Messages:
    388
    Country:
    Spain
    Very smart method of reading eye data ^_^
     
  5. 1B51004

    1B51004 GBAtemp Regular
    Member

    Joined:
    Nov 23, 2020
    Messages:
    220
    Country:
    United States
    Bro imagine mario 64
    You drown in the water, your brain thinks youre actually drowning
    still its a bit creepy for me (somehow) but very cool!
     
    rimoJO likes this.
  6. BitMasterPlus

    BitMasterPlus GBAtemp Regular
    Member

    Joined:
    Sep 1, 2017
    Messages:
    238
    Country:
    United States
    Just wait, the next versions will literally jack into your brain with needle-like ports through the eyes or in the back of your head right to your spinal cord or something, like in the movies. Y'know, for deeper immersion of course.
     
    Last edited by BitMasterPlus, Apr 19, 2021
  7. Vilagamer999

    Vilagamer999 tempBOT's ai cousin
    Member

    Joined:
    Jun 21, 2018
    Messages:
    388
    Country:
    Spain
    in 10 years time maybe, so far the only thing this technology can do is read brain stimuli poorly... the device can detect when pulses reach your eyes by being located in the rear of your head where the visual cortex is located, by firing different pulse rates in your monitor screen it can sort of detect what you are looking at since the device associates the different pulses with different commands, still pretty cool ^_^
     
    Last edited by Vilagamer999, Apr 19, 2021
  8. KiiWii

    KiiWii Reporter
    Reviewer

    Joined:
    Nov 17, 2008
    Messages:
    12,291
    Country:
    United Kingdom
    @Prans you get some seriously cool gear to check out! It’s pretty cool tech, but is it reliable.... we shall see!
     
    Prans likes this.
  9. Prans

    OP Prans Geek, gamer, human
    Senior Editor

    Joined:
    Apr 22, 2012
    Messages:
    1,925
    This one is cool indeed but its uses is still limited as it's a dev kit. I look forward to what might come out of this!
     
    KiiWii likes this.
  10. PatrickD85

    PatrickD85 GBAtemp Advanced Fan
    Member

    Joined:
    Jul 4, 2012
    Messages:
    858
    Country:
    Netherlands
    As mentioned by others, cool development but for the vast majority nothing worthwhile to look forward to just yet.
    This kind of tech still needs ATN LEAST 10-15 years before it becomes interesting for the masses.

    Kinda like VR ... we have it but what we have still is not what we want.
    And VR has existed since the 1970ish if im not mistaken. But still development is development.
     
  11. Foxi4

    Foxi4 Endless Trash
    Global Moderator

    Joined:
    Sep 13, 2009
    Messages:
    27,530
    Country:
    Poland
    This is giving me serious '90s vibes. We've been there before.



     
  12. eyeliner

    eyeliner Has an itch needing to be scratched.
    Member

    Joined:
    Feb 17, 2006
    Messages:
    1,791
    Country:
    Portugal
    Porn.
    Now.
    Thanks.
     
  13. Shalashaska98

    Shalashaska98 GBAtemp Advanced Fan
    Member

    Joined:
    Jan 17, 2018
    Messages:
    901
    Country:
    United States
  14. anhminh

    anhminh Pirate since 2010
    Member

    Joined:
    Sep 30, 2010
    Messages:
    1,352
    Country:
    Vietnam
    Now we can have mobile game ads stream directly into our brain.
     
    rimoJO likes this.
  15. HarvHouHacker

    HarvHouHacker Owner of the Rock Band Customs Project
    Member

    Joined:
    Mar 24, 2019
    Messages:
    759
    Country:
    United States
    I think that something like this would be difficult to use, if it works as the first video describes. Your eyes are constantly moving, and if you accidentally look at something, it might be toggled by the device. Also, what are the health risks of such a thing beaming to your brain? Hopefully, it's a frequency that will not cause permanent brain damage.

    Personally, I think VR and AR are better ways to go, as they don't directly require physical contact. Something like this could give you headaches as bad as Google Glass, if you're sensitive enough to it.
     
  16. shorty_bobert

    shorty_bobert Member
    Newcomer

    Joined:
    Feb 25, 2009
    Messages:
    35
    Country:
    United States
    Think the opposite. It only reads, so it would be more profitable to sell the brain-tracking data
     
    rimoJO and DarknessPlay3r like this.
  17. Silent_Gunner

    Silent_Gunner Crazy Cool Cyclops
    Member

    Joined:
    Feb 16, 2017
    Messages:
    2,653
    Country:
    United States
    Correct me if I'm wrong, but I thought Neurolink was all about giving us humans a fighting chance in the event things go FUBAR with AI and robotics and Skynet becomes a literal Deus Ex Machina if things get that far.

    While this is nice and all, I'm not too sure that I'm a big fan of implanting anything inside my body that's robotic; we all know that technology that makes it to the consumer market is already outdated, so let's say Valve releases the Valve Enhancer or some other name; you get implanted with a chip in your head (and let's just put the Mark of the Beast implications to the side even if I'd be lying that this isn't going to assuage people's fears on that front), and the Valve Enhancer 2 comes around; how does one, if they want to, upgrade from Enhancer 1 to Enhancer 2 without the potential for problems? Because if this is supposed to allow people to do things with their mind, it has to interact in some way with the brain, and I sure hope the chip isn't going to be implanted, as in, pins injected right into the brain matter itself, otherwise, I can see issues arising there as well.

    Last, but not least, are rejection medications going to be required to prevent people who want this from dying or being impaired in some other way? Or does this not have the problems that prosthetics can have?
     
  18. Taleweaver

    Taleweaver Storywriter
    Member

    Joined:
    Dec 23, 2009
    Messages:
    7,922
    Country:
    Belgium
    Heh... I just read a novel about a malicious computer virus that infects a device like this, causing real illness to the users. Despite the but client elevator pitch (computer virus infects real people), it's actually a very decent thriller. Worth a read (book's called Mona).

    As for this... I'll wait out a bit.
     
    Prans likes this.
  19. Prans

    OP Prans Geek, gamer, human
    Senior Editor

    Joined:
    Apr 22, 2012
    Messages:
    1,925
    With this device, you need to focus on a specific point on the screen (later maybe device) for the desired action to take place. It doesn't happen if you just glance at it, so it's very tough to toggle something accidentally unless you have 10/10 focus all the time.

    Other than Bluetooth, this thing isn't beaming anything. If anything, you are beaming your brianwaves at the device. The protrusions are EEG electrodes that have been used to read brain signals in medicine and research for decades. It doesn't induce anything to your brain. It just picks up signals which are interpreted by the device.

    Again, no headaches induced as it's not intrusive in any way. The only headache you might get is from frustration by not getting it to work at the beginning as it needs some practice.

    Eventually Neuralink wants to do that yes.

    Neuralink is indeed intrusive as it requires surgery to remove part of your skull (the bone) to be implanted. NextMind on the other hand is non-intrusive as it's a wearable. Likely, Valve's option will be the same and upgrades will need to be swapped like you upgrade consoles/phones etc for more features as the BCIs can pickup finer and finer signals.
     
    HarvHouHacker and Silent_Gunner like this.
  20. mspy

    mspy GBAtemp Regular
    Member

    Joined:
    Jul 29, 2018
    Messages:
    151
    Country:
    Brazil
    This kinda reminds of OCZ NIA which was released more than 10 years ago for the masses for about 60$ IIRC

     
    Prans likes this.
  21. xBleedingSoulx

    xBleedingSoulx GBAtemp Advanced Fan
    Member

    Joined:
    Sep 20, 2007
    Messages:
    554
    Country:
    United Kingdom
    If it lets me control computers with my brain, stick a chip in me. I volunteer.
     
Draft saved Draft deleted
Loading...

Hide similar threads Similar threads with keywords - Impressions, NextMind,