Difference between revisions of "Brain Computer Interface"

From Tmplab
m
(/tmp/bci (aka Neurohack))
 
(89 intermediate revisions by 2 users not shown)
Line 1: Line 1:
== /tmp/bci (aka Neurohack) ==
+
= /tmp/bci (aka Neurohack) =
Project involving hardware and software in 3 different major fields : Science / Computer Interface / Art<br>
+
A [http://www.tmplab.org /tmp/lab] project in Science/Education, Art and human interfaces fields.
Currently 3 hardware and 2 software main directions are followed. <br>
+
<BR>
 +
<br>
 +
Neurohack has now a dedicated [http://www.neurohack.cc website]
 +
 
 +
= LATEST NEWS =
  
= HARDWARE =
+
NEXT WORKSHOP : January 2012 in Paris<br>
  
== Commercial ready-to-use BCI-kits ==
+
= WHAT WE DO =
  
Real brainwaves centered current affordable commercial offers are either too simple (Mindset : ONE dry sensor) or required complex setup (Emotiv: several WET sensors).
+
== SCIENCE ==
 +
 +
* Neurosciences : Creation of dedicated software for brain functionnal imaging : near infra red spectroscopy and EEG with stimulus control and machine learning.
 +
* Neurosciences : Design and run experiences with a built in [http://www.imagilys.com/functional-MRI-fMRI/ paradigm] manager with speech synthesis.
 +
* Education : Already 2 (in Paris) and 1 (in London) Workshop "ON/OFF", talked about basic functional brain, bci concepts and offered hands on possibilities.
 +
* Large sets of brain generated data are available in CSV file format, be creative !
 +
 +
Current steps are : Experimental protocols and results statistic analysis to stronger assess different hardware reliability. We need some of your brain computing time to increase our test population. See contact below to Participate ! <br><br>
 +
For more references on all used techniques (scientific background/bibliography selection) : see the [[/tmp/bci/starterkit]].<br>
 +
For more information on machine learning see the subproject page: [[/tmp/bci/machine-learning]].<br>
  
=== NeuroSky Mindset ===
+
== ART ==
  
* Single EEG dry sensor headset with audio
+
Neurohack, as art group, offer music/video/real space live rendering and human performances based on brain activity. Neurohack may also help any art project in need.
* Ability to sample at 512Hz and access the ''raw signal'' or ''filtered'' FFT transform every second (waves: alpha, beta, delta, ...)
+
Different venues :
* BSD license Python SDK that works under linux with serial access mapped to the bluetooth device: https://github.com/groner/pythinkgear
+
* [[DialogueS, EEG project]] on December 17 2010.
* Software for OSX and windows also available by headset manufacturer : Neurosky
+
* Fete01 on May 7 2011 for Labomedia Orleans.
 +
* [[MindProcessing]] for Macval (Museum of contemporary art de Vitry/seine) on May 22 2011.  
 +
* [http://www.tmplab.org/2011/06/25/workshops-tmplab-au-macval-a-vitry-sseine/ Workshops] at Macval on July 3 2011.<br>
  
=== Emotiv ===
+
== BRAIN COMPUTER INTERFACE APPLICATIONS ==
 +
* Help disable people.
 +
* BYOU : Bring Your Own Use : we love collaborative work, tell us your ideas !
 +
* Computer, robots,... command.
 +
<br>
  
TODO: describe me!
+
= SOFTWARE  =
  
== DIY EEG headset ==
+
== Jackson : Hub for brainwaves ==
  
* 2 OpenEEG sets were built (2 wet electrodes each)
+
The home-brewed EEG/FNIRS software is made in Rebol and called "Jackson". Several versions have been created for dedicated purposes, like jprocessing or jLIVE, a sequencer style live tool, available from 1 to zillion brains, for art performance, cooperative "construction" (graphics, sound, music, MIDI, DMX light control, command,...). The Rebol option was chosen for dead simple portability and to interface seamlessly local and Internet connexions.<br>
* Continuous raw data feed only that must be filtered and analyzed.
+
Currently supported hardware is the Mindset, but any device connected to a standard port (serial, usb, ethernet,...) can be implemented.<br><br>
 +
Downloadable software are listed below. For a more about the flagship software : [[/tmp/bci/jackson]].<br>
  
== DIY Near Infra Red Spectroscopy headset ==
+
== Brainwave sounds ==
  
* Designing a new acquisition device (efficient, easy to wear, affordable) using Near Infra Red Spectroscopy
+
OpenEEG systems with Pure Data software. Follow this [http://gerard.paresys.free.fr/Projets/ProjetEEG.html link]
* Prelimanary tests were done with a light fiber and spectrometer
 
* Joint developement with [http://www.volumique.com Editions Volumique]
 
 
<br>
 
<br>
  
= SOFTWARE  =
+
== jBMM ==
  
== Bainwaves to music, lights, sounds,... ==
+
Basic Mind Music is a basic software that use Pure Data to produce music according to your attention. The notes are fixed for a non chaotic music style, but low attention will switch to low pitch. HIgh mental state will select an higher pitch. It's an octave switching instrument, 2 tracks are available [http://www.soundcloud.com/ownison online]. See below for repository address.
  
The homebrewed software is made in Rebol and called "Jackson". Several versions have been created for dedicated purposes, like jprocessing or jLIVE, a sequencer style live tool, available from 1 to zillion brains, for art performance, cooperative "construction" (graphics, sound, DMX light control, command,...). The Rebol option was chosen for dead simple portability and to interface seamlessly local and Internet connexions.<br>
+
== jprocessing ==
Currently supported hardware is the Mindset.<br>
 
  
== Brainwave sounds ==
+
The code for an installation in a french museum of contemporary art. jBMM is the musical part of jprocessing. See below for repository address.
  
Made in Pure Data
+
== tcpOSC ==
<br>
 
  
= WHAT WE DO =
+
Rebol has no OSC implementation a dead simple tcp to OSC relay was written in python. <br><br>
 +
The repository for all tmpbci software is [http://www.github.com/tmpbci tmpbci on github]<br>
  
== SCIENCE ==
+
= HARDWARE =
  
* Neurosciences : dedicated software for brain functionnal imaging : MRI, near IR, EEG with machine learning
+
== Commercial ready-to-use BCI-kits ==
* Large sets of brain generated data available in CSV file format. (40 hours)
 
* For more information on machine learning see the subproject page: [[/tmp/bci/machine-learning]]
 
 
Current steps are : designing experimental tests and results statistic analysis to stronger assess hardware reliability.
 
  
== ART ==
+
Real brainwaves centered current affordable commercial offers are either too simple (Mindset : ONE dry sensor) or required complex setup (Emotiv: several WET sensors).
 +
<br><br>
 +
''NeuroSky Mindset''
 +
<br>
 +
* Single EEG dry sensor headset with audio
 +
* Ability to sample at 512Hz and access the ''raw signal'' or ''filtered'' FFT transform every second (waves: alpha, beta, delta, ...)
 +
* BSD license Python SDK that works under linux with serial access mapped to the bluetooth device: https://github.com/groner/pythinkgear
 +
* Software for OSX and windows also available by headset manufacturer : Neurosky
 +
<br>
 +
''EMOTIV'' : todo
 +
<br>
 +
== DIY EEG headset ==
  
Neurohack, as Digital arts - music / video live rendering, human performance of the brain activity - has been done in different venues :
+
* 2 OpenEEG sets were built (2 wet electrodes each).
 +
* Continuous raw data feed only that must be filtered and analyzed.
 +
* Follow this [http://gerard.paresys.free.fr/Projets/ProjetEEG.html link]
  
* [[DialogueS, EEG project]] on December 17 2010.
+
== DIY Near Infra Red Spectroscopy headset ==
* Fete01 on May 7 2011 for Labomedia Orleans.
 
* [[MindProcessing]] for Macval (Museum of contemporary art de Vitry/seine) on May 22 2011.
 
* [http://www.tmplab.org/2011/06/25/workshops-tmplab-au-macval-a-vitry-sseine/ Workshops] at Macval on July 3 2011.
 
  
== BRAIN COMPUTER INTERFACE APPLICATIONS ==
+
* Designing a new acquisition device (efficient, easy to wear, affordable) using Near Infra Red Spectroscopy.
* Computer, robots,... command.
+
* Prelimanary tests were done with a light fiber and spectrometer.
* Help disable people.
+
* Joint developement with the book hackers from [http://www.volumique.com Editions Volumique]
* BYOU : Bring Your Own Use : the geekier, the better !
+
* Electronic design, all details and wiki,  follow [http://wiki.electrolab.fr/Projets:Perso:2011:fNIRS_headset tmpbci at Electrolab] (french)
 
<br>
 
<br>
  
Line 73: Line 96:
 
* Improve OpenEEG solution by signal analysis.
 
* Improve OpenEEG solution by signal analysis.
 
* Improve control by implementing Machine Learning.
 
* Improve control by implementing Machine Learning.
* Develop artistic collaboration especially in Music composition and wide public use.
+
* Develop artistic collaboration i.e music composition and wide public use.
 
* Continue bootstrapping people that need some experience in our knowledge area.  
 
* Continue bootstrapping people that need some experience in our knowledge area.  
 
<br>
 
<br>
  
For more about Jackson : [[/tmp/bci/jackson]].<br>
+
To join us or for questions, welcomed comments, ideas : tmpbci at gmail dot com<br>
For more references (bibliography) : see the [[/tmp/bci/starterkit]].<br>
+
Neurohack meetings are following /tmp/lab meetings, every thursday 9pm+ at La gaite lyrique, Paris<br>
The repository for tmpbci software is [http://www.github.com/tmpbci tmpbci on github]<br>
+
twitter : tmpbci<br>
To join us or for questions, welcomed comments, ideas : tmpbci at gmail dot com
+
Last wiki update : November 2011
Last update : August 2011
 

Latest revision as of 15:02, 1 January 2015

/tmp/bci (aka Neurohack)

A /tmp/lab project in Science/Education, Art and human interfaces fields.

Neurohack has now a dedicated website

LATEST NEWS

NEXT WORKSHOP : January 2012 in Paris

WHAT WE DO

SCIENCE

  • Neurosciences : Creation of dedicated software for brain functionnal imaging : near infra red spectroscopy and EEG with stimulus control and machine learning.
  • Neurosciences : Design and run experiences with a built in paradigm manager with speech synthesis.
  • Education : Already 2 (in Paris) and 1 (in London) Workshop "ON/OFF", talked about basic functional brain, bci concepts and offered hands on possibilities.
  • Large sets of brain generated data are available in CSV file format, be creative !

Current steps are : Experimental protocols and results statistic analysis to stronger assess different hardware reliability. We need some of your brain computing time to increase our test population. See contact below to Participate !

For more references on all used techniques (scientific background/bibliography selection) : see the /tmp/bci/starterkit.
For more information on machine learning see the subproject page: /tmp/bci/machine-learning.

ART

Neurohack, as art group, offer music/video/real space live rendering and human performances based on brain activity. Neurohack may also help any art project in need. Different venues :

BRAIN COMPUTER INTERFACE APPLICATIONS

  • Help disable people.
  • BYOU : Bring Your Own Use : we love collaborative work, tell us your ideas !
  • Computer, robots,... command.


SOFTWARE

Jackson : Hub for brainwaves

The home-brewed EEG/FNIRS software is made in Rebol and called "Jackson". Several versions have been created for dedicated purposes, like jprocessing or jLIVE, a sequencer style live tool, available from 1 to zillion brains, for art performance, cooperative "construction" (graphics, sound, music, MIDI, DMX light control, command,...). The Rebol option was chosen for dead simple portability and to interface seamlessly local and Internet connexions.
Currently supported hardware is the Mindset, but any device connected to a standard port (serial, usb, ethernet,...) can be implemented.

Downloadable software are listed below. For a more about the flagship software : /tmp/bci/jackson.

Brainwave sounds

OpenEEG systems with Pure Data software. Follow this link

jBMM

Basic Mind Music is a basic software that use Pure Data to produce music according to your attention. The notes are fixed for a non chaotic music style, but low attention will switch to low pitch. HIgh mental state will select an higher pitch. It's an octave switching instrument, 2 tracks are available online. See below for repository address.

jprocessing

The code for an installation in a french museum of contemporary art. jBMM is the musical part of jprocessing. See below for repository address.

tcpOSC

Rebol has no OSC implementation a dead simple tcp to OSC relay was written in python.

The repository for all tmpbci software is tmpbci on github

HARDWARE

Commercial ready-to-use BCI-kits

Real brainwaves centered current affordable commercial offers are either too simple (Mindset : ONE dry sensor) or required complex setup (Emotiv: several WET sensors).

NeuroSky Mindset

  • Single EEG dry sensor headset with audio
  • Ability to sample at 512Hz and access the raw signal or filtered FFT transform every second (waves: alpha, beta, delta, ...)
  • BSD license Python SDK that works under linux with serial access mapped to the bluetooth device: https://github.com/groner/pythinkgear
  • Software for OSX and windows also available by headset manufacturer : Neurosky


EMOTIV : todo

DIY EEG headset

  • 2 OpenEEG sets were built (2 wet electrodes each).
  • Continuous raw data feed only that must be filtered and analyzed.
  • Follow this link

DIY Near Infra Red Spectroscopy headset

  • Designing a new acquisition device (efficient, easy to wear, affordable) using Near Infra Red Spectroscopy.
  • Prelimanary tests were done with a light fiber and spectrometer.
  • Joint developement with the book hackers from Editions Volumique
  • Electronic design, all details and wiki, follow tmpbci at Electrolab (french)


WHAT NEXT ?

  • Improve OpenEEG solution by signal analysis.
  • Improve control by implementing Machine Learning.
  • Develop artistic collaboration i.e music composition and wide public use.
  • Continue bootstrapping people that need some experience in our knowledge area.


To join us or for questions, welcomed comments, ideas : tmpbci at gmail dot com
Neurohack meetings are following /tmp/lab meetings, every thursday 9pm+ at La gaite lyrique, Paris
twitter : tmpbci
Last wiki update : November 2011