Macintosh pioneer Jef Raskin’s vision gets real with Vision Pro

The kind of human-computer brain interface imagined by original Macintosh inventor, Jef Raskin just took a big step toward reality thanks to a company called Synchron, a brain implant, the simplicity of vision OS and an Apple Vision Pro.

So, what is this?

The company has figured out how to use the implant to deliver brain-controlled commands to the device. The idea is that it enables hands- and voice-free interaction with the computer. I’m in little doubt it builds on the existing accessibility features within the Apple product, and in doing so it opens a door toward truly augmented human/computer interaction.

Think Star Trek meets Minority Report.

Who is this for?

Right now the solution is aimed at people with paralysis (a patient with amyotrophic lateral sclerosis – ALS – is the first person to use it). The patient used his thoughts to control the cursor on the Apple Vision Pro when he played Solitaire, watched Apple TV and sent text messages.

“This is pretty cool, I’ve been wanting to try this for a while now,” the patient, Mark said. “It’s like watching it in the theater, it really comes to life. Using this type of enhanced reality is so impactful and I can imagine it would be for others in my position or others who have lost the ability to engage in their day-to-day life. It can transport you to places you never thought you’d see or experience again.” Mark is otherwise unable to use the Apple Vision Pro due to the loss of function of his upper limbs.

The human user interface

I’m in little doubt that this work realizes some of the ambitions Raskin had back before the introduction of the Macintosh, as best illustrated in this interview. Raskin was dedicated to simplifying human computer interaction – and if this new invention can stand up to reality, then his vision has gotten tantalizingly close to reality – and the fact that Vision Pro is also a Mac means this is true computing.

From the press release:

“BCI is a platform to re-connect people with injury or disease back to the fast-moving consumer technology landscape. Vision Pro is a powerful system, but it relies on the use of hand gestures to exert control over the UI. We are sending control signals directly from the brain to replace the need for hand gestures,” said Tom Oxley, CEO & Founder, Synchron, “We are moving towards a new Bluetooth standard for Human Computer Interactions that don’t require touch or speech. This is a critical unmet need for millions of people with paralysis.”

The Synchron BCI is implanted in the blood vessel on the surface of the motor cortex of the brain via the jugular vein, through a minimally-invasive endovascular procedure. Once implanted, it is designed to detect and wirelessly transmit motor intent out of the brain, intended to restore the capability for severely paralyzed people to control personal devices with hands-free point-and-click.”

Please follow me on Mastodon, or join me in the AppleHolic’s bar & grill and Apple Discussions groups on MeWe.