Kinect Hacks

Elective - Kinect Hacks

1 quarter / 10 weeks

Teacher

Javier Lloret
email: info@javierlloret.com

Getting Started

• About the Kinect
• Getting started with Processing
• Getting the Kinect to work with Processing

Processing/Kinect Sketches

• Kinect Skeleton New Sketch
• Kinect Point cloud New Sketch

Animata: Animations controlled with Kinect

• Download Animata 0.4 from this link:
• https://code.google.com/archive/p/animata/downloads
• http://animata.kibu.hu/tutorials.html
• Animata + Motion Capture:
• http://neurogami.com/presentations/KinectForArtists/

Synapse

• http://synapsekinect.tumblr.com/post/6305020721/download

Brekel

• http://brekel.com/

NI Mate

https://ni-mate.com/download/

Processing + Post-production example

• Catalina Music Video How To

Sound Library for Processing

• Examples:
• IO -> AudioInput
• Soundfile -> Sample

Assignments

• 2 Assignments
• 50% of total score each one of them.
• Working in groups

For each assignment the group delivers:

• Textual description of the the concept
• Visual research, sketches, sound?
• Cast, who is responsible for what?
• Short video registration of the prototype / end result (each group is responsible for the filming and editing of their finished works)

First Assignment

Second Assignment

Scan (at least) one object or space using Kinect. Create a video where you used the scanned object or space to create a narrative (of at least 90 seconds). Groups of 1 or 2 students.

Presentation second assignment: 31th January (obligatory to present to pass the course)

Inspiration

• Cécile B. Evans http://cecilebevans.com/index.php/hyperlinks-i-ii/
• Ed Atkins http://www.stedelijk.nl/en/exhibitions/70432

Scanning Tools

• For Mac Os:
• Skanect http://skanect.occipital.com/
• For Windows:
• Recontructme http://reconstructme.net/reconstructme-ui/
• For using Reconstructme you might need to also install the Kinect SDK if it doesn't recognize the Kinect:
• https://www.microsoft.com/en-us/download/confirmation.aspx?id=40278

Facial Motion Capture with Faceshift

• http://faceshift.com/studio/2015.2/introduction.html

Kinect+DSLR with RGBD Toolkit

• http://www.techhive.com/article/254952/rgbd_toolkit_combines_kinects_and_dslrs_makes_a_match_made_in_film_geek_heaven.html

Visualizing and Fixing 3D scanned models (Mac & Windows)

• Meshmixer http://www.meshmixer.com/download.html
• Meshmixer cleaning scan video tutorial https://www.youtube.com/watch?v=tkIAY3PJR7s
• Meshlab http://www.meshlab.net/#download

*For exporting png images with transparency from a 3D scanned model with Meshlab: File->Save snapshot->activate Background Screen Multiplier -> Save

Screen Video Recording

• For Mac:
• Quicktime http://osxdaily.com/2010/11/16/screen-recorder-mac/
• Monosnap https://www.monosnap.com/welcome#
• For Windows:
• Camstudio http://camstudio.org/

Groups 17:50

• Group 1:
• Tom Sibma 0917622
• Group 2:
• Sarah Wong 0905338
• Group 3:
• Amber Ledegang 0911446
• Leonie Fernhout 0925005
• Group 4:
• Marije de Heij 0882958
• Group 5:
• Alexandra den Dikken 0926183
• Group 6:
• Syree Palm 0938528
• Group 7:
• Nigel El Rey Du Sol Miguel 0882260
• Group 8:
• Shoshanna Israeli 0926412
• Babeth Lijzenga 0925586
• Group 9:
• Tom Rentmeester 0912919
• Thijs Mosterman 0917912
• Group 10:
• Jorijn de Jonge 0935298
• Group 11:
• Joep Hurkmans 0931531
• Group 12:
• Jelle van Bouwhorst 0928746
• Group 13:
• Vince Talbot 0927166
• Sebastiaan Crisan 0929940

Groups 19:30

• Group 1
• Beau Eckhardt 0927339
• Group 2
• Wolter Dreissen 0927691
• Melcher Oosterman 0925206
• Group 3
• Yanthe Roumen 0925406
• Bob Jonkers 0929075
• Group 4
• Tom Schouw 0918999
• Group 5
• Carly Muller 0880287
• Kathryn Man 0937377
• Group 6
• Tristan Kingdon 0918837