Common standard existent computer speech recognition input via microphone is used to assist an internet connected existent brain machine interface to be trained to recognize a programmable dictionary of recognized thoughts (and images). Such recognized thoughts, images, imagined words, and/or spoken speech computer recognized words are used to control and select from a computer and/or the internet the audio and visual information presented within a head-worn stereoscopic display headset. Current existent non-invasive brain machine interfaces (brain-computer interfaces) have used magnetoencephalographic data from superconductive quantum interference device's output, spin exchange relaxation free magnetometric data, electroencephalographic data, and functional magnetic resonance imaging to recognize thoughts (and detect lies) with ever increasing resolution.
Uniquely in this invention, spoken words through the microphone input into the speech recognition computer are compared with selected computer digitized memory pattern templates of particular thoughts as calculated from the analysis of particular electroencephalographic brain wave patterns after noise filtration. Brain waves detected by scalp galvanic skin response are Beta, Delta, Gamma, Alpha, Theta waves, Mu rhythms, and P300 signals. Selected paired matching of spoken speech recognized words to sampled stored computer pattern memory templates of brain waves (mostly Beta) and P300 signals representing thoughts and imagery is the process of thought recognition used in this invention. Thoughts and spoken recognized words are also paired with computer output control signals which control all other here mentioned devices, however, speech recognition control of computer output signals has override and control priority over all devices.
Once trained, this brain machine interface can be used to control 3D rapid prototype printers, 2D and 3D graphic displays of imagined visualizations, remotely piloted vehicles (cars, trucks, tractors, mining equipment, helicopters, boats , planes, jets, trains, missiles, mobile weapon platforms, spacecraft, rovers etc.), remote surgical apparatus, electronic games, avatars, painting machines, speech synthesizers, music synthesizers, musical instruments, servo controlled exoskeletons. and remote teleoperator controlled robotics.
This brain machine interface invention is distinguished from prior art by its simultaneous synergistic combinational use of several of the following existent well known systems working cooperatively together. These systems are the brain machine interface, its spoken speech recognition computer unique assistance, its coupling to the headworn stereoscopic virtual reality audio visual headsets with microphone, its hand held graphic digitizing tablet with air-mouse-pen, its full body-worn haptic teleoperator control suit with self viewing remote cameras mounted on an XY omni-directional walker treadmill, and its internet link enabling the headset-wearer to summon from his computer and the entire world wide internet web all kinds of binocular and stereoscopic images, videos, sounds and other almost unlimited data of every imaginable kind while also having the ability to control a myriad of other machines.
Now, whereas, all of the above mentioned individual component systems are known in the prior art, this new, novel, and original combinational use of some of these systems with a brain machine interface working synergistically cooperatively together produces many effects which are very much greater and more useful than the mere summation or aggregation of the component systems.