Reflection
Physical Installation, NA, 09.2024
Integrated natural elements with digital interactive technology to create a physical installation work. Inspired by the natural form of lotus leaves, used glass - painting hand - drawing techniques to process acrylic substrates into glass paintings of different sizes, providing a physical canvas for digital interaction.
- Core Stack: Arduino (C) + TouchDesigner (Python) + Projection Mapping
- Technical Implementation:
- Developed an embedded system using Arduino Uno R3 to process real - time data from the Pulse Sensor MAX30102 heart rate sensor. Wrote code in C to precisely control data input and preliminary processing.
- Designed a signal processing pipeline for biofeedback visualization in TouchDesigner using Python. Simply put, the collected heart - rate data is transformed into dynamic visual effects, and the latency of this transformation process is less than 100 milliseconds. This allows users to experience almost synchronous changes in the display with their heartbeats, providing a smooth feeling.
- Constructed a physical - digital hybrid interaction interface:
- Used laser cutting to fabricate acrylic substrates into glass paintings of different sizes.
- Achieved projection mapping in TouchDesigner with the help of Kantan Mapper and generated dynamic textures, projecting light and shadow onto the glass paintings to enhance the visual effect.
- In the future, plan to integrate DMX512 lighting control into the on - site installation. DMX512 is a digital signal protocol commonly used to control stage lighting and other devices. Here, it can automatically adjust the color, brightness, etc. of the lights according to user interactions and the overall installation atmosphere, making the lights match user interactions and the entire display environment.
- Analyzed the heart rate variability (HRV) indicators in the heart rate sensor data, adjusted the interactive projections on the glass paintings according to the user's heart rate, optimized the therapeutic feedback loop, created a relaxing and calming environment, and achieved a psychological healing effect. This personalized sensory experience highlights the connection between humans and nature, as well as the integration of technology and traditional craftsmanship.
- Developed an embedded system using Arduino Uno R3 to process real - time data from the Pulse Sensor MAX30102 heart rate sensor. Wrote code in C to precisely control data input and preliminary processing.
- Designed a signal processing pipeline for biofeedback visualization in TouchDesigner using Python. Simply put, the collected heart - rate data is transformed into dynamic visual effects, and the latency of this transformation process is less than 100 milliseconds. This allows users to experience almost synchronous changes in the display with their heartbeats, providing a smooth feeling.
- Constructed a physical - digital hybrid interaction interface:
- Used laser cutting to fabricate acrylic substrates into glass paintings of different sizes.
- Achieved projection mapping in TouchDesigner with the help of Kantan Mapper and generated dynamic textures, projecting light and shadow onto the glass paintings to enhance the visual effect.
- In the future, plan to integrate DMX512 lighting control into the on - site installation. DMX512 is a digital signal protocol commonly used to control stage lighting and other devices. Here, it can automatically adjust the color, brightness, etc. of the lights according to user interactions and the overall installation atmosphere, making the lights match user interactions and the entire display environment.
- Analyzed the heart rate variability (HRV) indicators in the heart rate sensor data, adjusted the interactive projections on the glass paintings according to the user's heart rate, optimized the therapeutic feedback loop, created a relaxing and calming environment, and achieved a psychological healing effect. This personalized sensory experience highlights the connection between humans and nature, as well as the integration of technology and traditional craftsmanship.
This project is not affiliated with any projects being undertaken by Rolls-Royce.

























