Difference between revisions of "Kinect Hacks"

From Interaction Station Wiki
Jump to navigation Jump to search
 
(80 intermediate revisions by 2 users not shown)
Line 1: Line 1:
 
== Elective - Kinect Hacks ==
 
== Elective - Kinect Hacks ==
−
1 quarter / 10 weeks / 2 hours per week
+
1 quarter / 10 weeks  
  
 
== Teacher ==
 
== Teacher ==
−
Javier Lloret
+
Javier Lloret <br/>
 +
email: info@javierlloret.com
  
−
== Format ==
+
== Getting Started ==  
 +
* [[About Kinect | About the Kinect]]
 +
* [[Getting Started with Processing | Getting started with Processing]]
 +
* [[Setting up the Kinect with Processing | Getting the Kinect to work with Processing]]
  
−
For each assignment the group delivers:
+
== Processing/Kinect Sketches ==
−
* Textual description of the the concept (+/- 1 A4)
+
* [http://javierlloret.info/kinect/Kinect_Hacks_Skeleton_New.zip Kinect Skeleton New Sketch]
−
* Visual research, sketches
+
* [http://javierlloret.info/kinect/Kinect_Hacks_point_cloud_example_new.zip Kinect Point cloud New Sketch]
−
* Cast, who is responsible for what?
+
 
−
* Short video registration of the prototype / end result (each group is responsible for the filming and editing of their finished works)
+
== Animata: Animations controlled with Kinect ==
 +
*Download Animata 0.4 from this link:
 +
*https://code.google.com/archive/p/animata/downloads
 +
*http://animata.kibu.hu/tutorials.html
 +
*Animata + Motion Capture:
 +
*http://neurogami.com/presentations/KinectForArtists/
 +
 
 +
== Synapse ==
 +
*http://synapsekinect.tumblr.com/post/6305020721/download
  
−
The documentations described above are required to be assessed.
+
== Brekel ==
 +
*http://brekel.com/
  
−
== Assignment 1 – Transformation ==
+
== NI Mate ==
−
=== Description ===
+
https://ni-mate.com/download/
−
Pick a topic where a clear change / transformation occurs.<br>
 
−
Make use of both conceptual and visual contrasts;<br>
 
−
conceptual: poor/rich, left/right (political), village/city.<br>
 
−
visual: black/white, small/big, hard/soft.<br>
 
  
−
On the basis of the chosen topic, you make a visualization per group in the form of an image sequence. This sequence can be; photographed, filmed,
+
== Processing + Post-production example ==
−
drawn, etc.
+
* [http://moullinex-blog.tumblr.com/post/3180520798/catalina-music-video Catalina Music Video How To]
  
−
Via an existing template (which can be customized per group), the image sequence is connected to the Kinect. The transformation happens by body movements of the user.
+
== Sound Library for Processing ==
 +
*Examples:
 +
* IO -> AudioInput
 +
*Soundfile -> Sample
  
−
=== planning ===
+
== Assignments ==
−
Duration 3 weeks:
+
* 2 Assignments
−
* week 1: Introduction Kinect. (connecting, drivers, plugins, scripting) + discussing the assignment
+
*50% of total score each one of them.
−
* week 2: conceptdevelopments / create prototype
+
*Working in groups
−
* week 3: presentation prototype
 
  
−
=== References ===
+
For each assignment the group delivers:
−
* [http://www.kinecthacks.com/ kinecthacks]
+
* Textual description of the the concept
−
* [http://vimeo.com/18499643 Interactive Display Window Concept]
+
* Visual research, sketches, sound?
−
* [http://vimeo.com/60156741 Nike Selfridges]
+
* Cast, who is responsible for what?
 +
* Short video registration of the prototype / end result (each group is responsible for the filming and editing of their finished works)
  
−
=== Tech ===
+
[[Kinect Hacks 2016 2017 Module 1| First Assignment]]
−
* [[About Kinect | About the Kinect]]
 
−
* [[Getting Started with Processing | Getting started with Processing]]
 
−
* [[Setting up the Kinect with Processing | Getting the Kinect to work with Processing]]
 
−
* [http://interactionstation.wdka.hro.nl/diy/downloads/KinectImageSequence.zip Download Template]
 
  
−
=== Learning Objectives ===
+
== Second Assignment ==
−
* The student is able to create a physical interface with use of the Kinect.
 
−
* The student can visualize a conceptual transformation in the form of an image sequence.
 
  
−
=== Assessment criteria ===
+
Scan (at least) one object or space using Kinect. Create a video where you used the scanned object or space to create a narrative (of at least 90 seconds).
−
* Conceptual development and research on the theme of 'transformation'.  
+
Groups of 1 or 2 students.
−
* Technical skills and realization of the prototype with the Kinect.
 
−
* Personal development, be able to develop new insights.
 
−
* Collaboration; being able to make an active contribution, meet deliverables, take responsibility.
 
  
−
=== Weighting assignment===
+
Presentation second assignment: '''31th January''' (obligatory to present to pass the course)
−
50% of total score
 
  
−
== Assignment 2 - non linear storytelling ==
+
=== Inspiration  ===
−
=== Description ===
+
*Cécile B. Evans http://cecilebevans.com/index.php/hyperlinks-i-ii/
−
Video is often presented in a linear fashion. In this assignment you will create a nonlinear interactive video / animation. Based on the movements of
+
*Ed Atkins http://www.stedelijk.nl/en/exhibitions/70432
−
the user, different scenes are triggered. Within this video you make use of video loops.  
 
−
The topic for this video is "new / artificial nature '.
 
  
−
=== References ===
+
=== Scanning Tools  ===
−
"References new nature:''<br>
+
*'''For Mac Os:'''
−
[http://www.nextnature.net/ Next Nature]<br>
+
*Skanect http://skanect.occipital.com/
−
[http://www.studioroosegaarde.net/ Studio Daan Roosegaarde]<br>
+
*'''For Windows:'''
−
[http://vimeo.com/7235817 Zimoun]
+
*Recontructme http://reconstructme.net/reconstructme-ui/
 +
* For using Reconstructme you might need to also install the Kinect SDK if it doesn't recognize the Kinect:
 +
*https://www.microsoft.com/en-us/download/confirmation.aspx?id=40278
  
−
''References interactive video:''<br>
+
=== Facial Motion Capture with Faceshift  ===
−
[http://www.newrafael.com/websites Rafaël Rozendaal]<br>
+
*http://faceshift.com/studio/2015.2/introduction.html
−
[http://www.selfcontrolfreak.com Selfcontrolfreak]<br>
 
  
−
=== Planning ===
+
=== Kinect+DSLR with RGBD Toolkit ===
−
''Duration 4 weeks:''
+
*http://www.techhive.com/article/254952/rgbd_toolkit_combines_kinects_and_dslrs_makes_a_match_made_in_film_geek_heaven.html
−
* week 1: Introduction non-linear storytelling + explanation assignment
 
−
* week 2: conceptdevelopment / make prototype
 
−
* week 3: develop prototype: presentation prototype
 
−
* week 4: final presentation prototype
 
  
−
=== Tech ===
+
=== Visualizing and Fixing 3D scanned models (Mac & Windows)  ===
−
* [[VideoCompression | How to compress a large videofile]] - using quicktime conversion
+
*Meshmixer http://www.meshmixer.com/download.html
−
* [http://interactionstation.wdka.hro.nl/diy/downloads/kinect_video_new.zip Download Template]
+
*Meshmixer cleaning scan video tutorial https://www.youtube.com/watch?v=tkIAY3PJR7s
−
* [[Kinect video template modifications | How to change the template code to create a transition]]
+
*Meshlab http://www.meshlab.net/#download
 +
'''*For exporting png images with transparency from a 3D scanned model with Meshlab''': File->Save snapshot->activate Background Screen Multiplier -> Save
  
−
=== Learning Objectives ===
+
=== Screen Video Recording ===
−
* The student can use / apply the kinect in his or her own work.  
+
*'''For Mac:'''
−
* The student is able to use video in a non linear fashion and tell a story.
+
*Quicktime http://osxdaily.com/2010/11/16/screen-recorder-mac/
 +
*Monosnap https://www.monosnap.com/welcome#
 +
*'''For Windows:'''
 +
*Camstudio http://camstudio.org/
  
−
=== Assessment criteria ===
+
=== Groups: ===  
−
* Conceptual development and research on the theme "new / artificial nature '.
+
== Groups 17:50 ==
−
* Technical skills and realization of the prototype with the Kinect.
+
*Group 1:
−
* Collaboration; being able to make an active contribution, meet deliverables, take responsibility.
+
*Tom Sibma 0917622
 +
*Group 2:
 +
*Sarah Wong 0905338
 +
*Group 3:
 +
*Amber Ledegang 0911446
 +
*Leonie Fernhout 0925005
 +
*Group 4:
 +
*Marije de Heij 0882958
 +
*Group 5:
 +
*Alexandra den Dikken 0926183
 +
*Group 6:
 +
*Syree Palm 0938528
 +
*Group 7:
 +
*Nigel El Rey Du Sol Miguel 0882260
 +
*Group 8:
 +
*Shoshanna Israeli 0926412
 +
*Babeth Lijzenga 0925586
 +
*Group 9:
 +
*Tom Rentmeester 0912919
 +
*Thijs Mosterman 0917912
 +
*Group 10:
 +
*Jorijn de Jonge 0935298
 +
*Group 11:
 +
*Joep Hurkmans 0931531
 +
*Group 12:
 +
*Jelle van Bouwhorst 0928746
 +
*Group 13:
 +
*Vince Talbot 0927166
 +
*Sebastiaan Crisan 0929940
 +
*Group 14:
 +
*Diederik Mulder 0919800
 +
*Zefnath de Lima 0913434
 +
*Group 15:
 +
*Andri Bastiaanssen 0907770
 +
*Group 16:
 +
*Eady van Acker 0911866
  
−
=== Weighting assignment ===
+
== Groups 19:30 ==
−
50% of total score
+
*Group 1
 +
*Beau Eckhardt 0927339
 +
*Group 2
 +
*Wolter Dreissen 0927691
 +
*Melcher Oosterman 0925206
 +
*Group 3
 +
*Yanthe Roumen 0925406
 +
*Bob Jonkers 0929075
 +
*Group 4
 +
*Tom Schouw 0918999
 +
*Group 5
 +
*Carly Muller 0880287
 +
*Kathryn Man 0937377
 +
*Group 6
 +
*Tristan Kingdon 0918837
  
−
==Self-reflection==
+
[[Category:2014]]
−
Each student delivers a selfreflection based on the 2 assignments in which his or her contribution within the group becomes clear. Next to that analyse the process, and take into account what went well or less well,  ie where you personally could benefit from a continued effort.
 
−
You have the option to deliver your selfreflection in the form of a written pdf, or a short video.
 

Latest revision as of 12:37, 20 January 2023

Elective - Kinect Hacks

1 quarter / 10 weeks

Teacher

Javier Lloret
email: info@javierlloret.com

Getting Started

Processing/Kinect Sketches

Animata: Animations controlled with Kinect

Synapse

Brekel

NI Mate

https://ni-mate.com/download/

Processing + Post-production example

Sound Library for Processing

  • Examples:
  • IO -> AudioInput
  • Soundfile -> Sample

Assignments

  • 2 Assignments
  • 50% of total score each one of them.
  • Working in groups

For each assignment the group delivers:

  • Textual description of the the concept
  • Visual research, sketches, sound?
  • Cast, who is responsible for what?
  • Short video registration of the prototype / end result (each group is responsible for the filming and editing of their finished works)

First Assignment

Second Assignment

Scan (at least) one object or space using Kinect. Create a video where you used the scanned object or space to create a narrative (of at least 90 seconds). Groups of 1 or 2 students.

Presentation second assignment: 31th January (obligatory to present to pass the course)

Inspiration

Scanning Tools

Facial Motion Capture with Faceshift

Kinect+DSLR with RGBD Toolkit

Visualizing and Fixing 3D scanned models (Mac & Windows)

*For exporting png images with transparency from a 3D scanned model with Meshlab: File->Save snapshot->activate Background Screen Multiplier -> Save

Screen Video Recording

Groups:

Groups 17:50

  • Group 1:
  • Tom Sibma 0917622
  • Group 2:
  • Sarah Wong 0905338
  • Group 3:
  • Amber Ledegang 0911446
  • Leonie Fernhout 0925005
  • Group 4:
  • Marije de Heij 0882958
  • Group 5:
  • Alexandra den Dikken 0926183
  • Group 6:
  • Syree Palm 0938528
  • Group 7:
  • Nigel El Rey Du Sol Miguel 0882260
  • Group 8:
  • Shoshanna Israeli 0926412
  • Babeth Lijzenga 0925586
  • Group 9:
  • Tom Rentmeester 0912919
  • Thijs Mosterman 0917912
  • Group 10:
  • Jorijn de Jonge 0935298
  • Group 11:
  • Joep Hurkmans 0931531
  • Group 12:
  • Jelle van Bouwhorst 0928746
  • Group 13:
  • Vince Talbot 0927166
  • Sebastiaan Crisan 0929940
  • Group 14:
  • Diederik Mulder 0919800
  • Zefnath de Lima 0913434
  • Group 15:
  • Andri Bastiaanssen 0907770
  • Group 16:
  • Eady van Acker 0911866

Groups 19:30

  • Group 1
  • Beau Eckhardt 0927339
  • Group 2
  • Wolter Dreissen 0927691
  • Melcher Oosterman 0925206
  • Group 3
  • Yanthe Roumen 0925406
  • Bob Jonkers 0929075
  • Group 4
  • Tom Schouw 0918999
  • Group 5
  • Carly Muller 0880287
  • Kathryn Man 0937377
  • Group 6
  • Tristan Kingdon 0918837
Retrieved from "http://interactionstation.wdka.hro.nl/mediawiki/index.php?title=Kinect_Hacks&oldid=9997"