Difference between revisions of "Kinect Hacks"

From Interaction Station Wiki
Jump to navigation Jump to search
 
(91 intermediate revisions by 4 users not shown)
Line 1: Line 1:
 
== Elective - Kinect Hacks ==
 
== Elective - Kinect Hacks ==
1 quarter / 8 weeks / 2 hours per week
+
1 quarter / 10 weeks  
  
== Teachers ==
+
== Teacher ==
Olivier Otten<br>
+
Javier Lloret <br/>
Brigit Lichtenegger
+
email: info@javierlloret.com
  
== Format ==
+
== Getting Started ==  
Students work in groups of max. 5 people.
+
* [[About Kinect | About the Kinect]]
 +
* [[Getting Started with Processing | Getting started with Processing]]
 +
* [[Setting up the Kinect with Processing | Getting the Kinect to work with Processing]]
 +
 
 +
== Processing/Kinect Sketches ==
 +
* [http://javierlloret.info/kinect/Kinect_Hacks_Skeleton_New.zip Kinect Skeleton New Sketch]
 +
* [http://javierlloret.info/kinect/Kinect_Hacks_point_cloud_example_new.zip Kinect Point cloud New Sketch]
  
For each assignment the group delivers:
+
== Animata: Animations controlled with Kinect ==
* Textual description of the the concept (+/- 1 A4)
+
*Download Animata 0.4 from this link:
* Visual research, sketches
+
*https://code.google.com/archive/p/animata/downloads
* Cast, who is responsibale for what?
+
*http://animata.kibu.hu/tutorials.html
* Short video registration of the prototype / end result (each group is responsible for filming and editings of their finished works)
+
*Animata + Motion Capture:
 +
*http://neurogami.com/presentations/KinectForArtists/
 +
 
 +
== Synapse ==
 +
*http://synapsekinect.tumblr.com/post/6305020721/download
 +
 
 +
== Brekel ==
 +
*http://brekel.com/
  
The documentations described above is required to be assessed.
+
== NI Mate ==
 +
https://ni-mate.com/download/
  
== Assignment 1 – Transformation ==
+
== Processing + Post-production example ==  
=== Description ===
+
* [http://moullinex-blog.tumblr.com/post/3180520798/catalina-music-video Catalina Music Video How To]
Pick a topic where a clear change / transformation occurs.<br>
 
Make use of both conceptual and visual contrasts;<br>
 
conceptual: poor/rich, left/right (political), village/city.<br>
 
visual: black/white, small/big, hard/soft.<br>
 
  
On the basis of the chosen topic, you make a visualization per group in the form of an image sequence. This sequence can be; photographed, filmed,
+
== Sound Library for Processing ==
drawn, etc.
+
*Examples:
 +
* IO -> AudioInput
 +
*Soundfile -> Sample
  
Via an existing template (which can be customized per group), the image sequence is connected to the Kinect. The transformation happens by body movements of the user.
+
== Assignments ==
 +
* 2 Assignments
 +
*50% of total score each one of them.
 +
*Working in groups
  
=== planning ===
+
For each assignment the group delivers:
Duration 3 weeks:
+
* Textual description of the the concept
* week 1: Introduction Kinect. (connecting, drivers, plugins, scripting) + discussing the assignment
+
* Visual research, sketches, sound?
* week 2: conceptdevelopments / create prototype
+
* Cast, who is responsible for what?
* week 3: presentation prototype
+
* Short video registration of the prototype / end result (each group is responsible for the filming and editing of their finished works)
  
=== References ===
+
[[Kinect Hacks 2016 2017 Module 1| First Assignment]]
* [http://www.kinecthacks.com/ kinecthacks]
 
* [http://vimeo.com/18499643 Interactive Display Window Concept]
 
* [http://vimeo.com/60156741 Nike Selfridges]
 
  
=== Tech ===
+
== Second Assignment ==
* [[About Kinect | About the Kinect]]
 
* [[Getting Started with Processing | Getting started with Processing]]
 
* [[Setting up the Kinect with Processing | Getting the Kinect to work with Processing]]
 
* [http://interactionstation.wdka.hro.nl/diy/downloads/KinectImageSequence.zip Download Template]
 
  
=== Learning Objectives ===
+
Scan (at least) one object or space using Kinect. Create a video where you used the scanned object or space to create a narrative (of at least 90 seconds).
* The student is able to create a physical interfase with use of the Kinect.  
+
Groups of 1 or 2 students.
* The student can visualize a conceptual transformation in the form of an image sequence.
 
  
=== Assessment criteria ===
+
Presentation second assignment: '''31th January''' (obligatory to present to pass the course)
* Conceptual development and research on the theme of 'transformation'.
 
* Technical skills and realization of the prototype with the Kinect.
 
* Personal development, be able to develop new insights.
 
* Collaboration; being able to make an active contribution, meet deliverables, take responsibility.
 
  
=== Weighting assignment===
+
=== Inspiration  ===
50% of total score
+
*Cécile B. Evans http://cecilebevans.com/index.php/hyperlinks-i-ii/
 +
*Ed Atkins http://www.stedelijk.nl/en/exhibitions/70432
  
== Assignment 2 - non linear storytelling ==
+
=== Scanning Tools  ===
=== Description ===
+
*'''For Mac Os:'''
Video is often presented in a linear fashion. In this assignment you create a nonlinear interactive video / animation. On the basis of the movements of
+
*Skanect http://skanect.occipital.com/
the user different scenes are triggered. Within this video you make use of video loops.  
+
*'''For Windows:'''
The topic for this video is "new / artificial nature '.
+
*Recontructme http://reconstructme.net/reconstructme-ui/
 +
* For using Reconstructme you might need to also install the Kinect SDK if it doesn't recognize the Kinect:
 +
*https://www.microsoft.com/en-us/download/confirmation.aspx?id=40278
  
=== References ===
+
=== Facial Motion Capture with Faceshift  ===
"References new nature:''<br>
+
*http://faceshift.com/studio/2015.2/introduction.html
[http://www.nextnature.net/ Next Nature]<br>
 
[http://www.studioroosegaarde.net/ Studio Daan Roosegaarde]<br>
 
  
''References interactive video:''<br>
+
=== Kinect+DSLR with RGBD Toolkit ===
[http://www.newrafael.com/websites Rafaël Rozendaal]<br>
+
*http://www.techhive.com/article/254952/rgbd_toolkit_combines_kinects_and_dslrs_makes_a_match_made_in_film_geek_heaven.html
[http://www.selfcontrolfreak.com Selfcontrolfreak]<br>
 
  
=== Planning ===
+
=== Visualizing and Fixing 3D scanned models (Mac & Windows)  ===
''Duration 4 weeks:''
+
*Meshmixer http://www.meshmixer.com/download.html
* week 1: Introduction non-linear storytelling + explanation assignment
+
*Meshmixer cleaning scan video tutorial https://www.youtube.com/watch?v=tkIAY3PJR7s
* week 2: conceptdevelopment / make prototype
+
*Meshlab http://www.meshlab.net/#download
* week 3: develop prototype: presentation prototype
+
'''*For exporting png images with transparency from a 3D scanned model with Meshlab''': File->Save snapshot->activate Background Screen Multiplier -> Save
* week 4: final presentation prototype
 
  
=== Learning Objectives ===
+
=== Screen Video Recording ===
* The student can use / apply the kinect in his or her own work.  
+
*'''For Mac:'''
* The student is able to use video in a non linear fashion and tell a story.
+
*Quicktime http://osxdaily.com/2010/11/16/screen-recorder-mac/
 +
*Monosnap https://www.monosnap.com/welcome#
 +
*'''For Windows:'''
 +
*Camstudio http://camstudio.org/
  
=== Assessment criteria ===
+
=== Groups: ===  
* Conceptual development and research on the theme "new / artificial nature '.
+
== Groups 17:50 ==
* Technical skills and realization of the prototype with the Kinect.
+
*Group 1:
* Collaboration; being able to make an active contribution, meet deliverables, take responsibility.
+
*Tom Sibma 0917622
 +
*Group 2:
 +
*Sarah Wong 0905338
 +
*Group 3:
 +
*Amber Ledegang 0911446
 +
*Leonie Fernhout 0925005
 +
*Group 4:
 +
*Marije de Heij 0882958
 +
*Group 5:
 +
*Alexandra den Dikken 0926183
 +
*Group 6:
 +
*Syree Palm 0938528
 +
*Group 7:
 +
*Nigel El Rey Du Sol Miguel 0882260
 +
*Group 8:
 +
*Shoshanna Israeli 0926412
 +
*Babeth Lijzenga 0925586
 +
*Group 9:
 +
*Tom Rentmeester 0912919
 +
*Thijs Mosterman 0917912
 +
*Group 10:
 +
*Jorijn de Jonge 0935298
 +
*Group 11:
 +
*Joep Hurkmans 0931531
 +
*Group 12:
 +
*Jelle van Bouwhorst 0928746
 +
*Group 13:
 +
*Vince Talbot 0927166
 +
*Sebastiaan Crisan 0929940
 +
*Group 14:
 +
*Diederik Mulder 0919800
 +
*Zefnath de Lima 0913434
 +
*Group 15:
 +
*Andri Bastiaanssen 0907770
 +
*Group 16:
 +
*Eady van Acker 0911866
  
=== Weighting assignment ===
+
== Groups 19:30 ==
50% van total score"
+
*Group 1
 +
*Beau Eckhardt 0927339
 +
*Group 2
 +
*Wolter Dreissen 0927691
 +
*Melcher Oosterman 0925206
 +
*Group 3
 +
*Yanthe Roumen 0925406
 +
*Bob Jonkers 0929075
 +
*Group 4
 +
*Tom Schouw 0918999
 +
*Group 5
 +
*Carly Muller 0880287
 +
*Kathryn Man 0937377
 +
*Group 6
 +
*Tristan Kingdon 0918837
  
==Self-reflection==
+
[[Category:2014]]
Each student delivers a selfreflection based on the 2 assignments in which his or her contribution within the group becomes clear. Next to that analyse the process, and take into account what went well or less well,  ie where you personally could benefit from a continued effort.
 
You have the option to deliver your selfreflection in the form of a written pdf, or a short video.
 

Latest revision as of 12:37, 20 January 2023

Elective - Kinect Hacks

1 quarter / 10 weeks

Teacher

Javier Lloret
email: info@javierlloret.com

Getting Started

Processing/Kinect Sketches

Animata: Animations controlled with Kinect

Synapse

Brekel

NI Mate

https://ni-mate.com/download/

Processing + Post-production example

Sound Library for Processing

  • Examples:
  • IO -> AudioInput
  • Soundfile -> Sample

Assignments

  • 2 Assignments
  • 50% of total score each one of them.
  • Working in groups

For each assignment the group delivers:

  • Textual description of the the concept
  • Visual research, sketches, sound?
  • Cast, who is responsible for what?
  • Short video registration of the prototype / end result (each group is responsible for the filming and editing of their finished works)

First Assignment

Second Assignment

Scan (at least) one object or space using Kinect. Create a video where you used the scanned object or space to create a narrative (of at least 90 seconds). Groups of 1 or 2 students.

Presentation second assignment: 31th January (obligatory to present to pass the course)

Inspiration

Scanning Tools

Facial Motion Capture with Faceshift

Kinect+DSLR with RGBD Toolkit

Visualizing and Fixing 3D scanned models (Mac & Windows)

*For exporting png images with transparency from a 3D scanned model with Meshlab: File->Save snapshot->activate Background Screen Multiplier -> Save

Screen Video Recording

Groups:

Groups 17:50

  • Group 1:
  • Tom Sibma 0917622
  • Group 2:
  • Sarah Wong 0905338
  • Group 3:
  • Amber Ledegang 0911446
  • Leonie Fernhout 0925005
  • Group 4:
  • Marije de Heij 0882958
  • Group 5:
  • Alexandra den Dikken 0926183
  • Group 6:
  • Syree Palm 0938528
  • Group 7:
  • Nigel El Rey Du Sol Miguel 0882260
  • Group 8:
  • Shoshanna Israeli 0926412
  • Babeth Lijzenga 0925586
  • Group 9:
  • Tom Rentmeester 0912919
  • Thijs Mosterman 0917912
  • Group 10:
  • Jorijn de Jonge 0935298
  • Group 11:
  • Joep Hurkmans 0931531
  • Group 12:
  • Jelle van Bouwhorst 0928746
  • Group 13:
  • Vince Talbot 0927166
  • Sebastiaan Crisan 0929940
  • Group 14:
  • Diederik Mulder 0919800
  • Zefnath de Lima 0913434
  • Group 15:
  • Andri Bastiaanssen 0907770
  • Group 16:
  • Eady van Acker 0911866

Groups 19:30

  • Group 1
  • Beau Eckhardt 0927339
  • Group 2
  • Wolter Dreissen 0927691
  • Melcher Oosterman 0925206
  • Group 3
  • Yanthe Roumen 0925406
  • Bob Jonkers 0929075
  • Group 4
  • Tom Schouw 0918999
  • Group 5
  • Carly Muller 0880287
  • Kathryn Man 0937377
  • Group 6
  • Tristan Kingdon 0918837