I am planning to make a plant-shaped music instrument played with human body. The goal is to encourage people to perform with the music and stretch their body. I will use posenet or other gesture sensing technology to allow users to control the plant on the screen. And probably use tone.js to play the music. By interacting with different part or object on the screen, they will finish a series of deskexercise gestures. I try to use pure javascript for this project >~< wish for some luck.

My inspiration

My inspiration started when I saw a palm tree in a video. As the leaves passing by the camera, there was music in the background. Also, I have had a hard time try to encourage myself to stretch and workout regularly each day during my break. So I think, why not combine those two ideas and we can make some art out of it.

another project: https://youtu.be/DOIjYoceL5E

P5 Sketch: https://editor.p5js.org/yilinzou/sketches/qtDGy8vVZ

Visual reference

I tried with MUNIT in runway, and I kinda like the style here. Also, it is a model made so I guess I might use it:

However, there is another function called toon shader in unity and here is what it looks like:

The original

with the tone shader

Another reference I really like.

https://www.instagram.com/dedouze/

I really like this style but I guess I will have to figure out a way to use 3D models and make them interactive in javascript.

Audience:

This project is part of my thesis. I am making this tool for students or staff who have to sit all day long for their daily tasks. For them, they can finish the game in 2 minutes, as a little rest for their busy work schedule.