Asimo robot controlled by human thought (video)

Honda's brain-machine interface for robot control --

Honda has developed new brain-machine interface (BMI) technology that allows humans to control the Asimo humanoid robot simply by thinking certain thoughts.

The BMI system, which Honda developed along with Advanced Telecommunications Research Institute International (ATR) and Shimadzu Corporation, consists of a sensor-laden helmet that measures the user’s brain activity and a computer that analyzes the thought patterns and relays them as wireless commands to the robot. (Watch video.)

When the user simply thinks about moving his or her right hand, the pre-programmed Asimo responds several seconds later by raising its right arm. Likewise, Asimo lifts its left arm when the person thinks about moving their left hand, it begins to walk when the person thinks about moving their legs, and it holds its hand up in front of its mouth when the person thinks about moving their tongue.

Honda BMI -- The high-precision BMI technology relies on three different types of brain activity measurements. EEG (electroencephalography) sensors measure the slight fluctuations in electrical potential on the scalp that occur when thinking, while NIRS (near-infrared spectroscopy) sensors measure changes in cerebral blood flow. Newly developed information extraction technology is used to process the complex data from these two types of sensors, resulting in a more accurate reading. The system reportedly has an accuracy rate of more than 90%.

The use of EEG and NIRS sensors makes the new system more compact than previous BMI systems that rely on bulkier fMRI (functional magnetic resonance imaging) technology. Although the system is small enough to be transported from place to place, the developers plan to further reduce the size.

Honda, which has been conducting BMI research and development with ATR since 2005, is looking into the possibility of one day using this type of interface technology with artificial intelligence and robotics to create devices that users can operate without having to move.

[Source: Honda press release]

Scientists extract images directly from brain

ATR mind reader --

Researchers from Japan’s ATR Computational Neuroscience Laboratories have developed new brain analysis technology that can reconstruct the images inside a person’s mind and display them on a computer monitor, it was announced on December 11. According to the researchers, further development of the technology may soon make it possible to view other people’s dreams while they sleep.

The scientists were able to reconstruct various images viewed by a person by analyzing changes in their cerebral blood flow. Using a functional magnetic resonance imaging (fMRI) machine, the researchers first mapped the blood flow changes that occurred in the cerebral visual cortex as subjects viewed various images held in front of their eyes. Subjects were shown 400 random 10 x 10 pixel black-and-white images for a period of 12 seconds each. While the fMRI machine monitored the changes in brain activity, a computer crunched the data and learned to associate the various changes in brain activity with the different image designs.

Then, when the test subjects were shown a completely new set of images, such as the letters N-E-U-R-O-N, the system was able to reconstruct and display what the test subjects were viewing based solely on their brain activity.

For now, the system is only able to reproduce simple black-and-white images. But Dr. Kang Cheng, a researcher from the RIKEN Brain Science Institute, suggests that improving the measurement accuracy will make it possible to reproduce images in color.

“These results are a breakthrough in terms of understanding brain activity,” says Dr. Cheng. “In as little as 10 years, advances in this field of research may make it possible to read a person’s thoughts with some degree of accuracy.”

The researchers suggest a future version of this technology could be applied in the fields of art and design — particularly if it becomes possible to quickly and accurately access images existing inside an artist’s head. The technology might also lead to new treatments for conditions such as psychiatric disorders involving hallucinations, by providing doctors a direct window into the mind of the patient.

ATR chief researcher Yukiyasu Kamitani says, “This technology can also be applied to senses other than vision. In the future, it may also become possible to read feelings and complicated emotional states.”

The research results appear in the December 11 issue of US science journal Neuron.

[Source: Chunichi]

Japan’s cyborg research enters the skull

Mind-controlled robot arm -- Researchers at Osaka University are stepping up efforts to develop robotic body parts controlled by thought, by placing electrode sheets directly on the surface of the brain. Led by Osaka University Medical School neurosurgery professor Toshiki Yoshimine, the research marks Japan’s first foray into invasive (i.e. requiring open-skull surgery) brain-machine interface research on human test subjects. The aim of the research is to develop real-time mind-controlled robotic limbs for the disabled, according to an announcement made at an April 16 symposium in Aichi prefecture.

Although brain waves can be measured from outside the scalp, a stronger, more accurate signal can be obtained by placing sensors directly on the brain — but that requires open-skull surgery, making it more difficult to recruit volunteer test subjects.

The researchers, who have filed a license application with the Osaka University Hospital ethics board, are working to enlist willing subjects already scheduled to have brain electrodes implanted for the purpose of monitoring epilepsy or other conditions. The procedure, which does not involve puncturing the cortex, places an electrode sheet at the central sulcus, a fold across the center of the brain near the primary motor cortex (which is responsible for planning and executing movements).

To date, the researchers have worked with four test subjects to record brain wave activity generated as they move their arms, elbows and fingers. Working with Advanced Telecommunications Research Institute International (ATR), the researchers have developed a method for analyzing the brain waves to determine the subject’s intended activity to an accuracy of greater than 80%. The next step is to use the data to control robot arms developed by the University of Tokyo’s Department of Precision Engineering.

[Source: Asahi]

Robovie droid helps lost shoppers

Robovie --

The Osaka-based Advanced Telecommunications Research Institute (ATR) has developed a crowd-monitoring humanoid robot that recognizes when people are lost and helps them find their way.

In a series of demonstrations conducted from January 22 to 24, a souped-up version of ATR’s Robovie humanoid robot monitored people as they passed through a 100 square meter (1,076 sq ft) section of the Universal Citywalk Osaka shopping center. Relying on data from 16 cameras, 6 laser range finders and 9 RFID tag readers installed in and around the area, the robot was able to watch up to 20 people at a time, pinpoint their locations to within a few centimeters, and classify each individual’s behavior into one of 10 categories (waiting, wandering, walking fast, running, etc.).

Robovie -- Whenever Robovie spotted people who looked disoriented, the child-sized droid wheeled up to them and asked, “Are you lost?” If so, the robot provided simple directions to the destination and pointed the way. If not, the robot proceeded to recommend nearby shops and restaurants.

ATR says the Robovie test is the first in a long series of robot-related demonstrations to be conducted at Universal Citywalk Osaka. This week, the company announced it was establishing a permanent base in the shopping center, which will serve as a real-world environment for testing new robot-oriented business ideas. In June, the company plans to start hiring out its machines to companies toying with the idea of employing robots.

[Sources: Robot Watch, Yomiuri, Nikkei]