Difference between revisions of "Research"

From Interaction Station Wiki
Jump to navigation Jump to search
(43 intermediate revisions by 4 users not shown)
Line 1: Line 1:
 
 
[[Category:Research]]
 
[[Category:Research]]
 
+
<onlyinclude>
==INTRO==
+
*[http://interactionstation.wdka.hro.nl/wiki/Research/Research2014-2015-Beam Research 2014-2015 by Beam]
This page is a collection of research and explorations of a "research teacher interaction station WdKA". Some topics are more practical than others, all topics are developed directly from questions of students. The goal is to document in a brief way the problems and solutions. This page is NOT meant to be technical only!!! You will see a lot of design and technolgy intertwined.
+
*[[Internet of Things]]
<BR>
+
*[[Image Analysis]]
 
+
*[[Emotion Recognition Kinetic Kit]]
==Research: Design and Energy Harvesting==
+
*[[Mechanisms]]
'''The research question: "What means energy harvesting for students of the WdKA?"<BR>'''
+
*[[AI]]
Some subquestion: <BR>
+
*[[E-textile swatches]]
*"Motivation: Why is energy harvesting an interesting topic for WdKA students?"[http://interactionstation.wdka.hro.nl/wiki/Research/Energy_Harvesting_Motivation]<BR>
+
</onlyinclude>
*"Inventarisation: What kind of design projects are using energy harvesting?"
 
*"Which domains of energy harvesting are in most interesting for WdKA students?"
 
*"How can a WdKA student make a difference?"[http://interactionstation.wdka.hro.nl/wiki/Research/Energy_Harvesting_WDKA_student_make_a_difference]
 
*"Practical problems for the WdKA students"
 
<BR>
 
'''What is Energy harvesting?'''<BR>
 
Energy harvbesting or scavenging is collecting small quantities of energy which are considered waste or not important or fall of the table of the big spenders.<BR>
 
You can make your design independent of an energy source in some cases, using this "free" energy. Besides that your design doesn't use batteries, which are considered polluting the environment. ALso your design will function where there is no electricity, nor batteries available, like remote villages or during disasters when for instance powerlines are destroyed. There are two levels of independency: independent of supplies of power, and this means also independecy of political manipulation or even commercial exploitation.<BR>
 
<BR>
 
'''Why "Design" and energy harvesting?'''<BR>
 
Energy harvesting uses electronics. Depending on your chosen source of energy and the funtional aspects of your design you have to insert specific equipment. There will be an inpact on your design and functioning. You have to consider why and when it will be used for what and match this with your energy harcesting strategy. So it is important to look at projects of designers using this kind of energy for their products, architecture, fashion silhouets.
 
<BR><BR>
 
'''Tons of info on how to make your design having it's own way of generating energy'''
 
*[http://interactionstation.wdka.hro.nl/wiki/Design_and_Energy_Harvesting_research Design & Energy Harvesting]
 
*[http://interactionstation.wdka.hro.nl/wiki/Ljusa_hack Ljusa Hack page]
 
*[http://interactionstation.wdka.hro.nl/wiki/Solar_cell  More than you want to know about Solar cells]
 
[[File:Deh1.jpg|300px]]<BR><BR>
 
 
 
'''Artistic Results of this investigation'''<BR>
 
Research by an artist designer is different from scientific research. The topic is not only addressed with analysis, inventarisation, comparison and reflection, but also by DIY strategies. The design field is complex, adding energy harvesting only raises this complexity. Useful WdKA experinece can only be obtained by starting design experiments wihtin this domain testing and exploring the possibilities and difficulties.
 
Several experiements are done, from practical ones, like chsoing a device for hacking to complicated ones like an energy game inserted in a silhouet. All the steps of these artistic investigations are documented in a blog: [https://myfablab.wordpress.com/], eg [https://myfablab.wordpress.com/2015/04/19/victory-over-the-sun-technical-testing/]
 
*Victory over the Sun
 
This is a wearable where you can play a game with the Sun. The Sun is generating energy with a solar cell and you are generating energy using a dynamo (the hacked Ljusa). The winner is the one who can fill the 10F supercap with energy first. The choice for a wearable is appropriate because with this wearable you can try the game at different locations and situations, thus gaining experience what kind of energy generation is best for what kind of location.<BR>
 
[https://myfablab.wordpress.com/2015/04/19/victory-over-the-sun-technical-testing/ Testing version 2 of Victory over the Sun]<BR>
 
In a third version the electronics is made portable. You can add it to any garment you are wearing at the moment you want to play the game.<BR>
 
[[File:Vos2.jpg|300px]]<BR>
 
<BR>
 
 
 
*Kit for hacking a Ljusa
 
This is a tutorial how to hack a Ljusa and make it into your own energy generating product. Also the AI files for lasercutting the parts you need for nicely integrating the dynamo and the STL file for the leaver are available.<BR>
 
[http://interactionstation.wdka.hro.nl/wiki/Ljusa_hack Hacking Kit for the Ljusa]<BR>
 
[[File:Ljusa kit1.jpg|300px]]<BR><BR>
 
[[File:Ljusa kit2.jpg|300px]]<BR>
 
 
 
*2015 E-textile Summercamp Swatch
 
For the third collection of e-textile samples called "The Swatchbook", organized by Hannah Perner-Wilson, I produced a Swatch which demonstrates flashing a LED using the tribo electric effect. The two materials, amoflex polyester and paper on aluminum foil are inserted in a knitted folding of polyester threads. Not only is this folding contributing to the effect, also the image of the energy response is visible in the knitting, using the lace knitting technique.<BR>
 
[http://etextile-summercamp.org/swatch-exchange/light-without-battery/ Light without a battery Swatch ]
 
<BR>
 
[[File:Swatch4.jpg|300px]]<BR>
 
 
 
*Essay: [http://interactionstation.wdka.hro.nl/wiki/Essay 2011: News about the Mosstable is coming soon!]
 
As mentioned before the field of energy harvesting is complex. In the case of the Cambridge Mosstable designers explained some research on moss plants with a design table. But this table is suggesting possible future developments which are not at all realized at the moment. Laymen, for instance students "believe" the energy promise of this table, because there is a scientist involved. The designer cannot be blamed suggesting too much, since he is not an expert. How far can this kind of design suggestions about technology and science go?
 
 
 
==Exploration: Connecting the Neurosky Mindwave brain sensor to your project==
 
Research question:<BR>
 
"How to connect the popular Neurosky EEG sensor to student projects?"<BR>
 
Subquestions:<BR>
 
*"Connecting to the Arduino of the Mindflex toy version, and charting/solving problems"<BR>
 
*"Connecting the Bluetooth Neurosky version, and charting/solving problems"<BR>
 
<BR>
 
'''Serial Connection: with 2 wires.'''<BR>
 
Connecting the Mindflex version (marktplaats 15-25 euro's) to the Arduino is not very difficult and well described in tutorials:<BR>
 
[http://frontiernerds.com/brain-hack How-To]<BR>
 
[https://github.com/kitschpatrol/Brain scripts]<BR>
 
The problem is keeping the connection alive. Sometimes it works using a solution of salt and wetting your forehead a little bit.<BR>
 
The other problem is a design problem: the mindflex on your head is looking clumsy already, the wires and or an Arduino on top look even clumsier:-)<BR>
 
<BR>
 
'''Mobile Phone connection'''
 
For connecting the Neurosky Mindwave Mobile (more expensive: amazon, 130 euor's), using Bluetooth, the sensor brain signals can be send wirelessly to your mobile phone or an Arduino.<BR>
 
If you connect with your Mobile Phone this device is in the Bluetooth protocol the "Master". Everything is easy following the instructions. <BR>
 
If you want ot make your own app you have to know how to program Android devices. Mindwave has a DEV kit and examples.<BR>
 
 
 
<BR>
 
'''Wireless connection to an Arduino: Bluetooth'''<BR>
 
For this you need a Bluetooth module attached to your Arduino. <BR>
 
When the Mindwave has to connect the bluetooth module attached should serve as a Master. Most Bluetooth modules can act without a problem as a slave, but only some as Master. Yu have to find the right BT module.<BR>
 
This solves the clumsyness problem: the Arduino (or standalone ATmega328) can be hidden in your project.<BR>
 
<BR>
 
There are 2 relevant tutorials:<BR>
 
[https://learn.sparkfun.com/tutorials/hackers-in-residence---hacking-mindwave-mobile Sparkfun]<BR>
 
[http://developer.neurosky.com/docs/doku.php?id=mindwave_mobile_and_arduino Mindwave]<BR>
 
<BR>
 
Although in these tutorials the right Bluetooth Module is indicated we compared several Bluetooth boards:<BR>
 
*[https://myfablab.wordpress.com/2015/05/07/bluetooth-boards-and-the-neurosky-mindwave/ ]<BR>
 
By the way, the hacked Mindflex sends the same data as the Mindwave Mobile, but is connected directly, using wires, to an Arduino (Serial RX PIN).<BR>
 
 
 
[[File:Bt9.jpg |300px ]] Left Mindflex, right the Mindwave, the last one looks far more designed!<BR>
 
 
 
Another update: if you have trouble doing the Serial acrobatics then you could switch the Arduino for a Teensy. This board can be programmed with Arduino software, costs less, and has 3 Serial Ports, beside the USBSerial. It can be connected easily to a BlueSMiRF and the Mindwave:<BR>
 
[https://myfablab.wordpress.com/2015/05/12/teensy-3-0-bluesmirf-and-mindwave/ blogpost about this]
 
 
 
[[File:Bt20.jpg|300px]]<BR>
 
The Teensy has much more possiblities, lots of PWM PINs for Servo Motors, touch (proximity) PIN's etc.<BR>
 
 
 
==Exploration: EPOC brain waves visualiser==
 
[[File:IMG 20150518 095215.jpg|300px
 
]]EPOC, with 14 sensors, compared to 1 of the Mindwave<BR>
 
At Stadslab you can work with the [https://emotiv.com/epoc.php EPOC of emotiv].<BR>
 
Compared to the Mindwave this device promises a lot. The EPOC comes as a device giving signals which are already processed. The software to get the RAW data has to be bought separately and at twice the cost of the device itself. The software is not available at Stadslab.<BR>
 
The signals for facial expressions seem to work reasonably well, blink, laugh, smile, right focus, left focus. The so called "AFFECT" values are not looking too good at the moment (maybe more experience is needed).<BR>
 
These can be found in the OSC data:<BR>
 
/AFF/Engaged/Bored; <BR>
 
/AFF/Excitement; <BR>
 
/AFF/Excitement Long Term; <BR>
 
/AFF/Meditation; <BR>
 
/AFF/Frustration; <BR>
 
 
 
During a recording of values (see setup below) ''Meditation'' and ''Engagement'' were always constant. Left with ''excitement'', ''"excitement long term"'' and ''frustration'' you see that ''excitement'' and ''"excitement long term"'' are rather related, the long term is the same flattened out, filtering out the peaks.<BR>
 
[[File:EPOC.png|300px]]<BR>
 
These data can be found at[https://github.com/contrechoc/Meab_scripts/blob/master/EPOC_testData1 github]<BR>
 
 
 
During wearing you can discover that, according to this device, your ''frustration'' is suddenly at 100%! Also your excitement is not really what you feel yourself. This is also displayed in the image, where frustration is often at the 1.0 maxiumum. Besides that: frustration below the 1.0 is very similar to ''Excitement''...
 
<BR>
 
It could be that these data will improve if you train the device, that is calibrate it to your kind of brainwaves.<BR>
 
<BR>
 
Test setup for recording data:<BR>
 
The EPOC has a USB dongle connecting to a WINDOWS laptop. You use the standard Emotiv EPOC Control Panel application to connect and select the user. Then you need "Mind the OSC" application to extract OSC values. These can be read by a Processing application.
 
[http://hyperritual.com/blog/processing-epoc-osc/ example by Hyperritual].<BR>
 
To save the AFFECT data we used this Processing sketch which can be found at [https://github.com/contrechoc/Meab_scripts/blob/master/EPOC_PROCESSING_generating_test_data Github].<BR>
 
 
 
[[File:EpocImage data.png|300px]] Then the data can be visualised in  Excel, or Google Charts.<BR>
 
Compared to the Mindwave Mobile this EPOC has more possibilities but mainly for registration of facial expressions.
 
 
 
==Exploration: hacking the KH-940 machine knitter==
 
This is called lobotomy - brain transformation - of the knitting machine KH-940. The hardware in the machine is removed and replaced with an Arduino Due. This microcontroller with a special board and special software can connect to the KH-940 knitting machine. You can prepare images for knitting in several knitting techniques. Not only Nordic, but also patent stitch, slip stitch, weave stitch and other stitches.<BR>
 
*[https://myfablab.wordpress.com/2014/10/11/writing-my-own-software-for-the-kh-940/ Software for the Due]<BR>
 
*[https://myfablab.wordpress.com/2015/03/01/preparing-knitting-images/ Double bed knitting]<BR>
 
*[https://myfablab.wordpress.com/2015/03/01/preparing-knitting-images/ Weave knit]<BR>
 
*[https://myfablab.wordpress.com/2014/10/11/doing-invisible-knitted-datavisualisation/ Data vis knit]<BR>
 
*[https://myfablab.wordpress.com/2015/03/01/preparing-knitting-images/ Double bed Jacquard knitting]
 
[[File:Mk1.jpg|300px]]<BR>
 
Demonstration: 28-05-2015 and 03-06-2015<BR>
 
[[File:Mk5.jpg|300px]]
 
 
 
==Exploration: Making Relief prints using a 3D printer==
 
This investigation was combining the "old" analog relief print press with the "new" 3D printer. The 3D printer is used to create plates which can be printed using the relief print press in the Publication station. Possibilities of the 3D printer, like the fill patterns are used to create special effects. In the workflow the Blender plugin which can make relief from images is used.<BR>
 
It all started on a small river near a small town in Holland:
 
[https://myfablab.wordpress.com/2014/09/14/gps-track-fiddling-knitting-and-3d-printing/ ] <BR>
 
A draft research paper can be found here:
 
[http://contrech.home.xs4all.nl/research/relief_print_research_draft.pdf]<BR>
 
Course about this subject: Quarter 3 2014/2015<BR>
 
 
 
[http://contrech.home.xs4all.nl/research/relief_print1.ppt Course powerpoint1]<BR>
 
[http://contrech.home.xs4all.nl/research/relief_print2.ppt Course powerpoint2]<BR>
 
[http://contrech.home.xs4all.nl/research/relief_print3.ppt Course powerpoint3]<BR>
 
 
 
[[File:Rp1.jpg|300px]]<BR>
 
Exploration continues on the knitting machine:<BR>
 
[[File:Tra2.jpg|300px]]<BR>
 
<BR>
 
and on the lasercutter:<BR>
 
[[File:Tra1.jpg|300px]]<BR>
 
[[File:Tra2.jpg|300px]]
 
<BR>
 
 
 
==Exploration: Visualising and Materializing GPS Tracking==
 
What can you do with a GPS tracking?<BR>
 
Rowing on a small river in the heart of Holland....<BR>
 
First of all you can project your track in Google Earth.<BR>
 
But what exactly is your track, where are the data?<BR>
 
The data file is in .kmz format. This is a zip, chane it to .zip and unzip.<BR>
 
Then you find the .kml file. In there are your data.<BR>
 
These data can be imported into Excel or Google Charts.<BR>
 
Then you can start designing your path like the famous subway map from London: get these undesigned curves out!<BR>
 
[http://www.contrechoc.com/mapping/tracking_interactive.xls xls example with formula's]<BR>
 
With this nice straigthened path you can make a relief in Blender using import image plugin and the modifiers subdivision and displace. <BR>
 
Make an STL file and export to a 3D printer, now you have your track in 3D.<BR>
 
Or you go to a knitting machine and knit your track, using Designa Knit and Nordic knitting.<BR>
 
 
 
[[File:Track.png|300px]]
 
<BR><BR>
 
==Exploring Servo motors==
 
Documentation in progress!
 
There are lots of motors, stepper motors, DC motors and servo motors amnogst others, to choose from. You have to find the right motor for your project. The servomotor can normally only rotate a certain number of degrees ("normally", because you can hack it). The sevo motor is used for instance for steering a car, not for driving. You can indicate the position of the servo motor lever.<BR>
 
<BR>
 
The servomotor rotates, so the first movement is a circle. With some extra arms and mechanics you can change this into linear (horizontal, vertical) movement. Pushing can be done with 2 servomotors.<BR>
 
<BR>
 
Getting one servo motor rotating is easy with an Arduino and this basic script (inside the Arduino Examples):<BR>
 
[http://www.arduino.cc/en/Tutorial/Sweep]
 
But several features occur when you start using more or try combining servo motors with other ATmega328 possiblities.<BR>
 
<BR>
 
'''Pictures'''<BR>
 
Servo motor, small and big:<BR>
 
 
 
 
 
Servo motor combination as a pusher, flat and rouned<BR>
 
[[File:Servo push.jpg|300px]]<BR>
 
 
 
Servo motors pushers on a shoulder (project Exaltation of Jasna Rokegem):<BR>
 
[[File:Sp1.jpg|300px]]<BR>
 
 
 
'''Scripting considerations'''<BR>
 
In the script you have to use a library. This is a piece of code which is hidden from your own script. If you use this isolated it will function fine. But for instnace you cannot combine it with this library SoftwareSerial. These two libraries use the same functions (the timer) and will interfere with each other. What kind of situation this will be a problem? Say you want to have a bluetooth connection, this uses the Serial TX and RX. So opening Serial Window won't work. So you connect using a Softwareserial, which is also Serial, but on other PIN's than 0 and 1. Then you add a servo motor.
 
<BR>
 
How to solve this?<BR>
 
The servomotor is needed, so teh solution is not using SoftwareSerial. If you want debugging information you could switch to an LCD screen or another wireless connection, eg RF12.<BR>
 
<BR>
 
(This problem occured in th coding for project "Ex-standing Waves" of Jasna Rokegem.<BR>
 
 
 
'''Power considerations'''<BR>
 
You have to realize that servomotors use a lot of energy, electrical power. The Arduino can easily handle one, but two are already at the limit of the power the USB can provide. So you add batteries, and power the servo's directly using the battery. Then you get the problem that the micorcontroller restarts when the servo starts. This is because the servo is usiing a lot of energy starting up and the Voltage of the batteries suddenly drops. <BR>
 
Two solutions (which have to be used both...). Adding a big capacitor, this works as a buffer for sudden drops in Voltage. But in the end you have to add a battery for the microcontroller. Giving both microcontroller and the servo's their own power source, only connecting the GND's will solve the problem.<BR>
 
 
 
In this picture you can discover the 4 servo motors, the battery pack for the servo's, and the lipo battery for the micorcontroller. This board has a RF12 transceiver for getting wireless commands, or send signals to other silhouets. And also there is a BlueSMiRf board [https://www.sparkfun.com/products/12577] (red bottom) for connecting to the Mindwave:<BR>
 
 
 
[[File:Exaltation technology.jpg|300px]]<BR>
 
electronics for fashion project "Ex-standing Waves" of Jasna Rokegem.<BR>
 

Revision as of 00:53, 17 January 2019