OverviewIdeationCommunication ProtocolData FlowUsage in bigger projectsTakeaways

Generative Art: A unique artistic experience that combines the senses of touch and sound, enabling participants to create their own one-of-a-kind artwork

Arduino | Processing — 2023
Project

Individual School Project

Timeline

4 days

Tools used

Arduino, Processing

Overview
How it works
• Upon pressing on any button and applying force on the force sensor(/pressure sensor)
• Circle trail will be generated with size of circle varying according to force applied
• Different buttons will give different beats/sounds and different circle forms
• RED: Filled circle, YELLOW: Stroke Circle, GREEN: Glowing lines
• Last frame will be saved as a jpg after closing window
Ideation
Initially my idea was to use three or four different force sensors to produce different beats with the force values being used to vary the parameters of the art generated, however there wasn't enough force/pressures sensors available.

Hence, I improvised by using a 3 button membrane instead in addition to a force sensor in this case.
Data Flow
Assuming a user presses a button and the force sensor, I would first get the key pressed and the force sensor values,

1. The key pressed would then be sent to the MP3 Module
- to determine what kind of beats/sound would be produced (by the MP3 Module)
-  as well as to Processing:  
- to determine what type of art would be generated (RED: Filled circle, YELLOW: Stroke Circle, GREEN: Glowing lines)

2. whereas, the force sensor values would be sent to Processing
- to be used to vary the parameters of the art generated (in this case determine the size of the art/circles generated)
how it can be expanded
Create Generative art based on sound outputsIn addition to using the force sensor values only.

The force sensor values can also be sent to the mp3 module to vary the volume of sound played which would inturn help to vary the sound output values sent to sound sensor as well.
how can this serial communication be used in bigger projects?
1.   Rythmic Game
Sends UI response to the screen showing which areas has been correctly stepped on

2.   Draw using movement
Using a motion sensor to trace movement and vary the graphics generated

3.   Sensory interactive graphics
Art that can follow movement of participants/art that can vary according to touch by participants, etc
takeaways:
This was a fun project to try to combine and apply the things I've learned in both Arduino and Processing.

With additional time, I would be eager to delve deeper into expanding the concept by creating a movement-based game. In this game, players would be required to memorize the beats played and replicate them by performing corresponding movements. This would add an interactive and engaging layer to the gameplay experience, fostering rhythm-based challenges and enhancing player immersion.