Eyes on you: A visual representation of the cyclical nature of obsession, explored through the metaphor of the human gaze

Touchdesigner | Mediapipe — 2024
Project

Team Project
3 members

Timeline

6 weeks
2024

Tools used

Touchdesigner with mediapipe

Role

Technical Developer

Theme: Obsession
Concept
The experience unfolds in three stages: the initial intensity of focused attention, the magnetic pull of allure, and the eventual decline into neglect. This immersive project delves into the emotional journey of obsession, prompting introspection on how our relationships and interests transform over time.

By blending artistic expression with scientific and technological exploration, Eyes On You seeks to deepen our understanding of human connection and foster greater awareness of the dynamic interplay between perception and emotion.
How it works
As you enter the space, your presence is immediately detected through a webcam attached from top down. The eyes respond in real-time, and follows your movements. It dilates and constricts in response, visually representing the flow of interest and obsession.

When you remain still, the pupils dilate, intensifying the sense of growing obsession.

As users engage with the installatons, it prompts a reflection on their own experiences of fascination and disinterest with the idea of obsession.
Creation of Eyes Using Paper Mache
Spraypainting the Eyes
Technical Process
Visuals

Creation of Eye Visuals is using AI Generated Images, composited on Touch Designer.

We seggregated parts of an eye into various layers before compositing them in TouchDesigner.  This method enabled the manipulation of specific parts of the eye to achieve the intended effect.
Tracking
movement
The initial prototypes used optical flow and blob tracking in TouchDesigner to detect movement directions—left, right, up, and down—and were mapped to the eye's position to follow the motion. However, this method proved slow and occasionally inaccurate.

Hence, we decided to use MediaPipe as this provided more reliable and responsive coordinates for tracking participant movement in real time. Using the pose tracking component from the MediaPipe library, we mapped the participant's nose tip coordinates to rotate the eye toward their position.
Dilating eye
Using an lfo as a counter, I toggled between an increase and decrease count to control the size of the eye pupil based on detection of still movement by the participant.

This creates the effect where, as the participant locks eyes with them, the eyes begin to dilate, symbolizing a growing obsession.
~special thanks to my instructor as well as my amazing teammates ₊˚⊹♡ for making this proj a success
⸜(。˃ ᵕ ˂ )⸝♡
the end.