Revision as of 23:29, 17 April 2021

Processing

Processing is a free graphical library and integrated development environment built for the electronic arts, new media art,

and visual design communities with the purpose of teaching non-programmers the fundamentals of computer programming in a visual context.

Currently, Processing uses the Java language, p5.js (JavaScript), and Processing.py (Python).

https://processing.org/download/

Say Hello

setup()

only run once.

draw()

will continuously repeat the action inside of the {}

1void setup(){
2size(400,400);
3println("Hello!Nan");
4
5}
6void draw(){
7println("welcome to interaction station!");
8}

copy-paste the code above and observe the message from the console.

Now, let's try to draw something

 1void setup(){
 2size(400,400);
 3//println("hello!Nan");
 4background(30,50,80);
 5
 6}
 7void draw(){
 8//println("welcome to nteraction station!");
 9//RGB Value
10stroke(30,150,140);
11line(width/2, height/2, mouseX, mouseY);
12}

Sketch --> Run

Sketch --> Tweak

Sketch --> Present

Full screen!

 1void setup(){
 2//size(400,400);
 3//println("hello!Nan");
 4fullScreen();
 5background(30,50,80);
 6
 7}
 8void draw(){
 9//println("welcome to nteraction station!");
10//RGB Value
11stroke(30,150,140);
12line(width/2, height/2, mouseX, mouseY);
13}

draw

 1void setup(){
 2//size(400,400);
 3//println("hello!Nan");
 4fullScreen();
 5background(30,50,80);
 6 
 7}
 8void draw(){
 9//println("welcome to interaction station!");
10//RGB Value
11noStroke();
12fill(0,200,0);
13
14ellipse(width/2,height/2,150,150);
15stroke(30,150,140);
16strokeWeight(2);
17line(width/2, height/2, mouseX, mouseY);
18println("mouseX:",mouseX);
19println("mouseY:",mouseY);
20if(mousePressed){
21background(30,50,80);
22}
23}

Communication with Arduino

there are two ways to get processing sketches communicating with microcontrollers.

1. the first one is to use the microcontroller as an HID (Human Interface Device), like a mouse or keyboard.

in this case, we only need to change some code in Arduino IDE.

now. we will use the X and Y values from the motion sensor on CPX to control the position of the nouse.

and left button on CPX to work as mouse left click.

 1#include "Mouse.h"
 2#include <Adafruit_CircuitPlayground.h>
 3float X, Y, Z;
 4//int leftButton;
 5bool mouseIsActive = false; 
 6int slideSwitch;
 7
 8void setup() {
 9  // put your setup code here, to run once:
10  CircuitPlayground.begin();
11  Mouse.begin();
12}
13
14void loop() {
15  //read slide switch from cpx.
16  slideSwitch = CircuitPlayground.slideSwitch();
17  // if the switch is on the CPX mouse is active, 
18  if(slideSwitch ==HIGH){
19    mouseIsActive=true;
20    }else{
21      //if the slide switch is off, the cpx mouse will be off
22      mouseIsActive=false;
23      }
24
25  //read the leftButton from cpx
26  int leftButton = CircuitPlayground.leftButton();
27  //x and y position from motion sensor
28  X = CircuitPlayground.motionX();
29  Y = CircuitPlayground.motionY();
30
31  //int xReading=map(x,-1,1,0,100);
32   // if the mouse control state is active, move the mouse with motion sensor X and Y value.
33  if (mouseIsActive) {
34    Mouse.move(X*2, Y*2, 0);
35  }
36
37 // if the mouse is not pressed, press it:
38  if (leftButton==HIGH){
39    if (!Mouse.isPressed(MOUSE_LEFT)) {
40      Mouse.press(MOUSE_LEFT);
41     }
42    }else{  // else the mouse button is not pressed:
43      if (Mouse.isPressed(MOUSE_LEFT)) {
44      Mouse.release(MOUSE_LEFT);
45    }
46      }
47  delay(5);
48}

2. however, sometimes, you want to send data directly from a microcontroller to processing.

in this case, we need to do write few lines of code in both Arduino and processing.

in Arduino IDE:

 1#include <Adafruit_CircuitPlayground.h>
 2float X, Y, Z;
 3void setup() {
 4 Serial.begin(9600);
 5 CircuitPlayground.begin();
 6}
 7
 8void loop() {
 9
10  int leftButton = CircuitPlayground.leftButton();
11  X = CircuitPlayground.motionX();
12  Y = CircuitPlayground.motionY();
13  Z = CircuitPlayground.motionZ();
14  int xVal=map(X,-9,10,0,1920);
15  int yVal=map(Y,-9,10,0,1080);
16
17  Serial.print(xVal);
18  Serial.write('\t');
19  Serial.print(yVal);
20  Serial.write('\t');
21  Serial.println(leftButton);
22  
23  delay(10);
24
25}

in Processing:

Print the value in Processing

 1import processing.serial.Serial;
 2//select serial port and set bauds rate
 3static final int PORT_INDEX=6,BAUDS=9600;
 4// create an array, a list of data will be used to store values from snesors.
 5int[] vals= {};
 6
 7void setup(){
 8  noLoop();
 9  frameRate(20);
10  final String[] ports = Serial.list();
11  printArray(ports);
12  new Serial(this, ports[PORT_INDEX], BAUDS).bufferUntil(ENTER);
13
14  
15}
16
17void draw(){
18
19   print("x=");
20   println(vals[0]); 
21   print("Y=");
22   println(vals[1]); 
23   print("Button=");
24   println(vals[2]); 
25
26    }
27 
28void serialEvent(final Serial s) {
29  vals = int(splitTokens(s.readString()));
30  redraw = true;
31}

Add the lines back in the code

 1import processing.serial.Serial;
 2static final int PORT_INDEX=6,BAUDS=9600;
 3int[] vals= {};
 4
 5void setup(){
 6  noLoop();
 7  frameRate(20);
 8  final String[] ports = Serial.list();
 9  printArray(ports);
10  new Serial(this, ports[PORT_INDEX], BAUDS).bufferUntil(ENTER);
11
12  fullScreen();
13  background(30,50,130);
14}
15
16void draw(){
17
18  /* print("x=");
19   println(vals[0]); 
20   print("Y=");
21   println(vals[1]); 
22   print("Button=");
23   println(vals[2]); */
24
25    noStroke();
26    fill(255,255,0);    
27    ellipse(width/2,height/2,150,150);
28    stroke(30,170,160);
29    strokeWeight(4);
30    line(width/2, height/2, vals[0], vals[1]);
31    if(vals[2]==1){
32    background(30,50,130);
33    }
34
35 }
36 
37void serialEvent(final Serial s) {
38  vals = int(splitTokens(s.readString()));
39  redraw = true;
40}

draw a image

Let' try to draw an image with Pimage!

https://processing.org/reference/PImage.html

first, we need to create empty processing and save it somewhere on your computer.

in this case, we created a sketch folder, and inside of the sketch folder,

we need to create a new folder called "data" and save an image (jpg, png, gif,tga)in the "data" folder.

 1PImage images;
 2
 3void setup() {
 4 // size(1920, 1080);
 5  //
 6 fullScreen();
 7 images=loadImage("run.gif");
 8}
 9
10void draw() { 
11 // background(0);
12  image(images,0,0, images.width, images.height );
13  //image(images,(width-images.width)/2,(height-images.height)/2, images.width, images.height );
14  
15}

Image sequence:

Step two:

let's make it move!

in order to do that we need to use a sequence of images.

you can copy the image sequences at the file folder from the physical interfaces@interaction station channel on Teams

 1int numImages=23;
 2int startNumImages=1;
 3PImage[] images= new PImage[numImages];
 4int imgInSeq=1;
 5
 6void setup() {
 7 // size(1920, 1080);
 8 //let's give it a frame rate value so that we can change it later:-))
 9 frameRate(18);
10 fullScreen();
11
12 for (int i = 0; i < numImages; i++) {
13   String imageName = "run-" + nf(i, 5) + ".png";
14   images[i] = loadImage(imageName);
15  }
16}
17
18void draw() { 
19 background(0);
20//int imgInSeq = (int)map(mouseX, 0, width, 0, numImages - 1);
21//we can use % (modulo) to cycle through the images. from 1- to numImages
22imgInSeq= (imgInSeq+1) % numImages;
23image(images[imgInSeq],0,0,images[imgInSeq].width,images[imgInSeq].height);
24//image(images[imgInSeq], (displayWidth-images[imgInSeq].width)/2, (displayHeight-images[imgInSeq].height)/2, images[imgInSeq].width, images[imgInSeq].height );
25}