Brain-computer interface for Second Life

Brain-computer interface controls Second Life avatar --

While recent developments in brain-computer interface (BCI) technology have given humans the power to mentally control computers, nobody has used the technology in conjunction with the Second Life online virtual world — until now.

A research team led by professor Jun’ichi Ushiba of the Keio University Biomedical Engineering Laboratory has developed a BCI system that lets the user walk an avatar through the streets of Second Life while relying solely on the power of thought. To control the avatar on screen, the user simply thinks about moving various body parts — the avatar walks forward when the user thinks about moving his/her own feet, and it turns right and left when the user imagines moving his/her right and left arms.

The system consists of a headpiece equipped with electrodes that monitor activity in three areas of the motor cortex (the region of the brain involved in controlling the movement of the arms and legs). An EEG machine reads and graphs the data and relays it to the BCI, where a brain wave analysis algorithm interprets the user’s imagined movements. A keyboard emulator then converts this data into a signal and relays it to Second Life, causing the on-screen avatar to move. In this way, the user can exercise real-time control over the avatar in the 3D virtual world without moving a muscle.

Future plans are to improve the BCI so that users can make Second Life avatars perform more complex movements and gestures. The researchers hope the mind-controlled avatar, which was created through a joint medical engineering project involving Keio’s Department of Rehabilitation Medicine and the Tsukigase Rehabilitation Center, will one day help people with serious physical impairments communicate and do business in Second Life.

(For video of the Second Life BCI, check the links on the Ushida & Tomita Laboratory news page, right above the first photo.)

[Source: Nikkei Net]




59 Responses to “Brain-computer interface for Second Life”

  1. Mac

    Trouble is, *thinking* about performing an action is still different than actually doing it. You still won’t have the sense of “being there” that this kind of research suggests. Worse yet, that kind of experience is impossible without somehow suppressing your real-world responses. If I raise my hand, my actual hand will go up, regardless of how my avatar responds to the impulse.

    Interesting, but not anywhere close to the sort of thing most people will assume it implies (IMHO).

    [Reply]

  2. @Mac: What you are thinking of, and what subsequently leads you to assume everyone is, is full immersion: transfer or your consciousness into the avatar. You are correct to say that one should not confuse that with this, which is direct control of an external entity (be the avatar a purely software based one, such as your double in Second Life) or a phsyical one (we already have implant tech that allows monkeys to control robotic hands) via EEG monitoring… which is still damn cool, IMHO. ;)

    [Reply]

  3. Dwayne

    I would love to have that.

    [Reply]

  4. anonymous

    this is amazing and will lead to improvements in the quality of life for many with limited physical capabilities. sl already has done this with paraplegic friends. just amazing work

    [Reply]

  5. Freebird2k

    Would be cool to have virtual keyboard and type away using your mind.

    I can’t wait this to support battelfield 2/2142.

    [Reply]

  6. Spacer

    Mac’s post that “… *thinking* about performing an action is still different than actually doing it.” is actually both correct and incorrect. When we walk to the shop we don’t think about our balance, about breathing, about the movement of feet. When we were young we had to (well maybe not breathing but perhaps if you go back early enough….). We do this things automatically as we have learnt how to string such thoughts/impulses together. Games are actually how children learn and improve balance and motion and so on. Having such a tool integrated into a game is a good way to help this technology advance.

    [Reply]

  7. taph

    I think this is a great news. As a disabled myself, I think it’s great there are people working on technologies like this one. I play massive multiplayer online role-playing games, not Second Life though, and I do not have too much trouble but with my disease it can make me worse and I fear I would lose my favorite hobby where I get the chance to socialize online and do all those things regular people do which I wouldn’t be able to do in real life. I get to be at the same level for once with everyone else. I have troubles though with other videogames where the devs have made over complicated controls, they have completely forgotten that games are supposed to be FUN. Such a device would be great.

    [Reply]

  8. That’s AMAZING… Making machinima in SL will be easier– just think
    Japanese Machinima http://www.youtube.com/watch?v=en1nzven7jA

    [Reply]

  9. The idea is that the device develops to a point where you feel yourself moving transcended from body sense. The topper is that you take in the sights as fast as your eyes move. You are really there.

    [Reply]

Leave a Reply

Trackbacks/Pingbacks

  1. Second Life News for October 12, 2007 « The Grid Live
  2. brain-computer interface (BCI)… mueve tu avatar en Second Life con tu pensamiento :
  3. Newlaunches.com
  4. » Links for 13-10-2007 » Velcro City Tourist Board » Blog Archive
  5. GeekBrief.TV | Video Podcast » Archive » GBTV #0244 | GeekBrief.TV
  6. Una interfaccia cervello-computer per Second Life
  7. Nerdcore — Links vom 13. 10. 07: Spike Jonze, Draht-Lamborgini, Karate-Nonnen und Star Wars auf der Trompete
  8. Too many topics, too little time. » Brain-computer interface for Second Life ::: Pink Tentacle
  9. Second Life: Second Life Gets Brain Controls | K E K U [alpha]
  10. Robotic, News: Brain-Computer Interface (BCI) and Second Life « EBM and Clinical Support Librarians@UCHC
  11. Thought controlled SL navigation : Dramatech Space
  12. Controlando Second Life con el cerebro » Pixfans
  13. walking paper scraps at walking paper
  14. UMBC’s got GAIM » Blog Archive » Brain-Computer interface for second life
  15. Krishwords » Blog Archive » Brain Computer Interface to control the movement of second life avatar
  16. BionicBrain.net » Blog Archive » Bionic Brain Interfaces
  17. Links JD 2454387.5 « ideonexus
  18. Oh Brave New World, That Hath Such Creatures In It! « paintings and ramblings
  19. Virtual reality: it’s a two-for-one sale! | Population of One
  20. Brain-computer interface for Second Life - StrafeRight.com Forums
  21. Use Your Head to Play Second Life » Smarter Gadgets Blog
  22. Thinking about Second Life
  23. Cuando el futuro nos alcanze « G-Filex
  24. FW: Brain-computer interface for Second Life | The Story of My “Second Life”
  25. Control your Avatar with Your Brain « Dusan Writer’s Metaverse
  26. Brain-computer interface for Second Life « Digital Culture
  27. Avatrian: Our Blogs
  28. bwl zwei null » Virtuelle Welten sind nicht zu bremsen
  29. Not funny… ever. » Blog Archive » Virtually Horrified
  30. Interface uses brain signals to play Second Life | The latest PC, PS3, Xbox360, Wii, PSP, Xbox Gaming News
  31. Videogames: le news del 17.10.07 | N3TV
  32. OTAKKU blog » Pengendalian secara visual melalui pikiran
  33. u r being recorded:news
  34. Posted on Adverlab at MIT: Mind Control for Second Life Avatars « Death to internal marketing
  35. - yaccos blog - » Blog Archive » Second Thoughts on Second Life
  36. Dove Lane » Blog Archive » Disability Aid: Brain-Computer Interface for Second Life
  37. L’avatar si muove con il pensiero at DIGICODE
  38. Bolg :: From reality to cyberreality
  39. » News Roundup M is for Myg
  40. Brain-computer interface for Second Life « Second Life Accessibility
  41. OmegaMom
  42. Brain-Computer Interface for Second Life
  43. Explore the future? « BRAINETHICS
  44. Interface Design - Brain-Computer Interfacing « interfaces, robotics, toys of the future
  45. Jeff McNeill » Blog Archive » links for 2007-12-16
  46.   GBTV #0244 (small) | GeekBrief.TV by TechTV Update
  47. Hands Free Second Life | Kabalyero
  48. Live Blogging - Laptop Institute Keynote - Scott Klososky | Whip Blog
  49. Links 2008-08-11 -- Adam Crowe
  50. turtlethink.com | Hands Free 3D