Neurotech Hack: Brain Duino, WebXR, Oculus Go Part 3

Neurotech Hack: Brain Duino, WebXR, Oculus Go Part 3

Read the full description here: https://medium.com/silicon-valley-global-news/annoucing-the-neurotech-sf-vr-hack-3-brainduino-webxr-oculus-go-cf405a2b6cd2?source=linkShare-762ca6f92949-1532627855

In the first Neurotech SF VR Brainduino WebXR Oculus Go meetup which took place on June 29th we connected the Brainduino board to the collaboration station (a Desktop Computer) at Noisebridge with it’s Debian distro over bluetooth, we created a simple server in python 2.0 and we used ajax inside an aframe.io page we created to pull the table of numbers that was being created by the brainduino into the WebVR page but we were stopped by the fact that our Python server had no web security and that doesn’t work when our aframe page uses ssh and https.

We were able to see our webvr page inside the Oculus Go via the built in web browser but obviously our sphere, cube, and tetrahedron were not moving up and down because we could not important the brainwave data.

So in the Neurotech SF VR Brainduino WebXR Oculus Go part 2, that took place on July 6th, we attempted to connect the brainduino to a mac instead of linux. We ended up going around the http/https incompatibility by serving the brainduino data over http on linux using pythons built in simple server and then using a vpn tunnelling trick via the vpn called ngrok which had https. That enabled us to bring some of the brainduino sensor data into a webvr page but it was static data instead of streaming data. At that point we ran out of time.

I think we were attempting to use the Fetch API from Javascript to access the data on the desktop on the linux machine at Noisebridge called the collaboration station, skipping the use of a mac and skipping the use of a vpn for tunnelling.

I am able to get the brainduino data into a local webpage hosted on the Debian Linux Collaboration Station at Noisebridge. That’s part of the way there.

During the 2nd meetup some awesome linux hackers helped me to create a new project on my github where we pushed the previous work, to this github now is the Dreamteam have contributed documentation for the software update they created for the Brainduino.

This reduces the amount of work we have to do but it doesn’t solve everything.

We still need to integrate the data from the local web page with our webvr code, and we need to have our code running so that it can be accessed by the browser on the Oculus Go which is supposed to be worn by the person wearing the sensors.

Once we are able to important the streaming numbers in aframe we can instruct the webpage to do things with those numbers, such as taking a sample of those numbers every so many seconds and updating the onscreen objects with a new position in VR space.

I would like to see if we can turn the table of numbers from the brainduino into something that could make a circles and cylindars of computer graphics rotate, change colors, and morph in interesting ways reflecting the mind waves.