Works
A summary of my principal research, creative, and professional activities — spanning experimental research and interactive systems, creative research and installations, and professional media production.
Research & Interactive Systems
Haptic–Narrative Congruency in Immersive Entertainment
2023–2026Experimental Psychology · Multisensory Perception · HCI
The central research programme of my DPhil. I am developing the Haptic–Narrative Congruence Framework (HNCF), which examines how the relationship between touch and story shapes audience experience in immersive entertainment. Part of this work was carried out during a research visit to the Embodied Media Lab, Keio University, Tokyo (April–June 2026).
Methods: psychophysics, controlled behavioural experiments, multisensory interaction design, experimental stimulus development, statistical modelling.
Outputs
- DPhil thesis: Haptic-narrative congruence and multisensory experience in immersive entertainment (submitted October 2026)
Talks & presentations
- Keio University SFC — Feeling the Story: Touch, Haptics, and Multisensory Entertainment, invited guest lecture (June 2026)
- Embodied Media Lab, Keio University — Embodied Touch and Narrative Congruency: Semantic, Temporal, and Body-Location Dimensions of Haptic Design in Immersive Entertainment, ASPIRE Exchange Program final presentation (June 2026)
Role: DPhil researcher, University of Oxford; supervised by Professor Charles Spence
Wearable Haptic Cinema / Bubble Suit
2024–2026Wearable Haptics · Physical Computing · Experimental Research
The “Bubble Suit” is an Arduino-controlled, full-body pneumatic wearable that delivers pressure feedback synchronised with film viewing. The project covers the full cycle from concept and interaction design, through hardware and software prototyping and integration with film content, to controlled experimental evaluation of how wearable touch changes the experience of watching film. Developed as part of my DPhil research at the University of Oxford.
Publication
- Gao, Y., Liu, G., & Spence, C. (2026). Enhancing the experience of film with a wearable tactile/haptic suit. Multimedia Tools and Applications, 85, 65. doi:10.1007/s11042-026-21158-0
Talks & presentations
- EuroHaptics 2026, Siena, Italy (July 2026)
- Cyber Interface Lab, University of Tokyo — Multisensory Entertainment Experiences: From Haptic Cinema to Olfactory Timekeeping (May 2026)
- Multisensory Storytelling Summit, Bristol — Haptic entertainment experiences: Exploring pressure and vibration wearables to enhance cinematic experiences (May 2025)
- South West UK Pre-CHI, University of Bristol — A “feel-around” experience: Exploring wearable haptics for enhanced film engagement (April 2025)
- Experimental Psychology DPhil Seminar, University of Oxford — A “feel-around” experience (March 2025)
- Somerville College, University of Oxford — A “feel-around” experience, mixed reality piano concert with scientific talks, in collaboration with Trinity College Dublin (February 2025)
Role: Project lead — conceptualisation, interaction design, hardware and software development, methodology, experimentation, and formal analysis
Creative Research & Interactive Installations
Multisensory Floral Clock
2019–2026Kinetic Installation · Multisensory Design · Olfaction
A multisensory timekeeping installation integrating mechanical movement, scent, material design, and technology. Originally conceived as a kinetic installation, it was later developed into a research project on multisensory and biophilic design.
Publication
- Gao, Y., & Spence, C. (2026). Multisensory floral clock. In A. L. Brooks, D. Banakou, & S. Ceperkovic (Eds.), ArtsIT 2024, LNICST (Vol. 650, pp. 20–35). Springer. doi:10.1007/978-3-031-97254-6_2
- Gao, Y., & Spence, C. (2025). Multisensory floral clock: Biophilic timekeeping with mechanical blooms and scent. Paper presented at the pro² Network+ Summer School 2025.
Exhibitions & events
- Cyber Interface Lab, University of Tokyo — talk (May 2026)
- Device Prototyping Summer School, Lancaster University — talk (July 2025)
- 13th EAI ArtsIT, NYU Abu Dhabi — paper presentation (November 2024)
- Olfactory Cultural Studies Workshop, Copenhagen — Design considerations for a multisensory floral scent clock (April 2024)
- Art & Science Event Programme, Wolfson College, Oxford — Flower clock: From digital to physical (November 2023)
- FutureLab Exhibition (2019)
- NYU Shanghai Machine Art Event (2019)
Role: Concept, design, fabrication, and development; later research project with Professor Charles Spence
Umwelten
2021–2022Interactive Installation · Kinetic Systems · Transmedia Storytelling
An interactive kinetic transmedia installation. Using the concept of umwelt, the project explores transmedia storytelling, embodied interaction, kinetic movement, and physical–digital interaction to design autonomous systems that move away from anthropomorphism.
Exhibitions & press
- Ars Electronica 2021 — London Garden: Polysocial Realities (September 2021)
- The Bartlett Fifteen Show, UCL (2022)
- Maker Update — Project of the Week (2022)
- Goldie, A., Gao, Y., & Liu, Q. (2022). Umwelten. Zanna Magazine, 2022(11).
Role: Co-creator, with Amelia Goldie and Sienna Liu — M.Arch thesis project, Design for Performance and Interaction, The Bartlett, UCL
View project →Professional & Film Practice
CCTV New Year's Gala — Interactive Media Design
2022–2023Professional Practice · Interactive Media · Large-scale Production
The CCTV New Year's Gala is a nationally broadcast production reaching approximately 1.3 billion viewers. As part of the wider production, my own contributions were:
- Interactive and visual-design research for the Gala.
- Designing and implementing interactive elements for 8–10 performances, including music, dance, and comedy.
- Creative and technical input across 40+ programme segments.
- Collaborating with visual-design, filming, and production teams across interactive media, visual storytelling, documentation, and post-production.
Role: Interactive Design Research Assistant (CCTV × Central Academy of Fine Arts, Beijing), working within a large production team
Film & Directing — Selected Showreel
2017–presentFilmmaking · Cinematography · Creative Direction
Director and cinematographer of more than 20 short films, music videos, concert productions, and other audiovisual works across New York, Abu Dhabi, London, Shanghai, Beijing, and other international contexts. My practice spans narrative and experimental film, interactive film, music video, live performance, and transmedia storytelling.
- Messed Up Dating — interactive narrative film, exhibited at the NYU ITP Spring Show, New York (2018)
- Four interactive films about social media addiction — capstone project, Interactive Media Arts, NYU Shanghai (2019)
- Teaching Assistant, Cinematography: Art & Craft, NYU Abu Dhabi (2018–2019)
Role: Director and/or cinematographer
Messed Up Dating
2018Interactive Film · Nonlinear Storytelling
An interactive narrative film exhibited at the NYU ITP Spring Show, New York — an early example of my work in interactive, nonlinear storytelling, which later continued in my NYU Shanghai capstone of four interactive films about social media addiction.