Facebook aims to help people write with their ‘brainwaves’

21 Apr 2017

Social network giant Facebook on Wednesday unveiled projects aimed at allowing people to use their minds to type messages or their skin to hear words.

Facebook launched the research shop, called Building 8, last year to conduct long-term work that might lead to hardware products. In charge of the unit is Regina Dugan, who led a similar group at Alphabet Inc's Google and was previously director of the US Defense Advanced Research Projects Agency, or DARPA.

"Speech is essentially a compression algorithm, and a lousy one at that," Dugan told a packed audience at the Annual Developers Conference in Silicon Valley.

"That is why we love great writers and poets, because they are just a little bit better at compressing the fullness of a thought into words. What if we could type directly from our brain into a computer?"

Work on mind-reading machines has been going on for some time outside the corporate environment as well, and scientists at UC Berkeley this week announce creating a device that reads people's minds through their brainwaves, which could lead to an ''easily-operated'' machine that links up to smartphones (See: Soon, you could have a mind-reading app on your smartphone!).

The Facebook project grew from being an idea six months ago to being the focus of a team of more than 60 scientists, engineers, and system integrators, according to Dugan, who heads the Building 8 team devoted to coming up with innovative hardware for the social network's mission of connecting the world.

"We are just getting started," Dugan said. "We have a goal of creating a system capable of typing 100 words-per-minute straight from your brain."

Video played during her presentation showed a woman with an advanced neurodegenerative disease using her mind to move a cursor on a computer screen, slowly typing words.

Such brain-computer interface technology currently involves implanting electrodes, but Facebook wants to use optical imaging to eliminate the need to surgically intrude on brains, according to Dugan.

Facebook is looking at creating "silent-speech interfaces" based on sensors that could be worn, and made in quantity.

"We are not talking about decoding your random thoughts; that is more than many of us want to know," Dugan quipped.

"We are talking about thoughts you want to share. Words you have decided to send to the speech centre of the brain."

Such technology could let people fire off text messages or emails by thinking, instead of needing to interrupt what they are doing to use smartphone touchscreens, for example.

It would also have the potential to capture concepts and semantics associated with words people are thinking, making language differences irrelevant by enabling sharing of what is in mind, Dugan said.

"Unlike other approaches, ours will be focused on developing a noninvasive system that could one day become a speech prosthetic for people with communication disorders or a new means for input to AR," Dugan said in a post on her Facebook page, referring to augmented reality.

"Even something as simple as a 'yes/no' brain click, or a 'brain mouse' would be transformative."

The Building 8 group is also working on sensors that let people "hear" through their skin, with what they feel being converted into words in a variation on how the ear turns vibrations into comprehensible sounds.

"Our brains have the ability to construct language from components," Dugan said.

"I suggest that one day, not so far away, it may be possible for me to think in Mandarin and for you to feel it instantly in Spanish."

Such technology remains years away, according to Dugan.

Work under way in Building 8 "will one day allow us to choose to share a thought, just like we do with photos and videos," Facebook co-founder and chief executive Mark Zuckerberg said in a post on his page at the social network.

"Eventually, we want to turn it into a wearable technology that can be manufactured at scale."