Twinning Fyvie Hall: Audience Data, Generative Organ Performance and Social VR

Hermes, K., Harrison, L. and Grunewald, S. 2026. Twinning Fyvie Hall: Audience Data, Generative Organ Performance and Social VR. Society for Music Production Research Conference. Huddersfield 11 Jul - 09 Sep 2026 SMPR.

TitleTwinning Fyvie Hall: Audience Data, Generative Organ Performance and Social VR
AuthorsHermes, K., Harrison, L. and Grunewald, S.
TypeConference paper
Abstract

This paper presents a work-in-progress hybrid performance project that digitally twins Fyvie Hall and its Compton organ at the University of Westminster within the social VR platform VRChat. In the physical hall, the organ plays “itself” via MIDI transmitted over Ethernet to the organ’s control system. The MIDI stream is generated by a Max patch that treats audience behaviour in the room (for example, headcount or movement) as parameters in a generative performance system. The same data drive a sampler instrument, built from recorded organ material, whose output is spatialised in a VRChat reconstruction of Fyvie Hall using convolution with measured impulse responses of the hall and streamed via OBS to in-world loudspeakers. Audience presence and action are thus continuously translated into musical structure across co-present and virtual spaces.
We situate this experiment within Christopher Small’s notion of musicking as the totality of social acts that constitute musical performance (Small 1998), asking how relations between audience, instrument and venue are reconfigured when the organ is algorithmically “played” by the crowd rather than a visible organist. Drawing on Claire Bishop’s critique of participatory art (Bishop 2012), we interrogate whether this data-driven approach constitutes meaningful participation or a tightly managed spectacle of interactivity, particularly as metrics such as headcount stand in for complex embodied presence. Work on social VR as a socio-technical assemblage for embodiment and collaboration (e.g. Freeman et al. 2022) informs our analysis of how liveness, co-presence and spectatorship are differently experienced in VRChat’s avatar-based twin of Fyvie Hall. Finally, we connect the project to emerging acoustic and architectural digital twins in heritage contexts (e.g. Katz et al. 2025), considering how a VRChat-based hall might operate not only as a performance venue but as a living archive and pedagogical resource for organ practice and audience research.

KeywordsSocial VR; Digital Twinning; Installation
Year2026
ConferenceSociety for Music Production Research Conference
PublisherSMPR
Accepted author manuscript

Related outputs

Human-centred creative technology in music performance and transmedia practice
Hermes, K. Forthcoming. Human-centred creative technology in music performance and transmedia practice.

Beyond the Music Video: AI, Worldbuilding, and Audiovisual Music Practice
Hermes, K. 2026. Beyond the Music Video: AI, Worldbuilding, and Audiovisual Music Practice. Innovation in Music 26. Aalborg University, Denmark 12 - 14 Jun 2026 Routledge.

Generative AI as a tool to support film composition and sound design – an industry case study
Hermes, K. 2026. Generative AI as a tool to support film composition and sound design – an industry case study. in: Innovation in Music Routledge.

The Emergence of AI in Music
Hermes, K. 2025. The Emergence of AI in Music. SongZap.

Augmented creativity - using AI collaborators to make a music video
Hermes, K. 2025. Augmented creativity - using AI collaborators to make a music video. Dancecult: Journal of Electronic Dance Music Culture. 17 (1), pp. 102-128. https://doi.org/10.12801/1947-5403.2025.17.01.06

Co-Creativity for Musicians
Hermes, K. 2025. Co-Creativity for Musicians. Westminster AI Network Launch. University of Westminster 22 - 22 Oct 2025 University of Westminster.

A Rhythmanalysis of Collision Detection in Action Games: How is the Player's Understanding of Diegesis Informed by Rhythm and Real-Time Collision Detection?
Harrison, L. and Summerly, R. 2025. A Rhythmanalysis of Collision Detection in Action Games: How is the Player's Understanding of Diegesis Informed by Rhythm and Real-Time Collision Detection? Ludo 2025. University Square Stratford Campus, University of East London. 10 Jul - 12 Sep 2025

Far Away
McCutcheon, R. and Harrison, L. 2025. Far Away. Ambika P3 35 Marylebone Rd, London NW1 5LS 05 - 23 Aug 2025

Augmented creativity: does AI help or hinder musicians' creative processes?
Hermes, K. 2025. Augmented creativity: does AI help or hinder musicians' creative processes? in: Innovation In Music 24 New York Routledge.

Where now for interactive sound and music?
Harrison, L. 2025. Where now for interactive sound and music? in: Routledge.

Can we create an artefact of a piece of interactive audio?
Harrison, L. 2025. Can we create an artefact of a piece of interactive audio? in: Routledge.

Is interactive sound and music ever finished?
Lucy Ann Harrison and Harrison, L. 2025. Is interactive sound and music ever finished? in: Interactive Sound and Music: Beyond Pressing Play Routledge.

How can you make interaction a meaningful part of the work?
Harrison, L. 2025. How can you make interaction a meaningful part of the work? in: Interactive Sound and Music: Beyond Pressing Play Routledge.

How do you compose for multiple possibilities?
Harrison, L. 2025. How do you compose for multiple possibilities? in: Interactive Sound and Music: Beyond Pressing Play Routledge.

How do audience expectations change in an interactive space?
Harrison, L. 2025. How do audience expectations change in an interactive space? in: Interactive Sound and Music: Beyond Pressing Play Routledge.

Is it actually interactive and does it actually matter?
Harrison, L. 2025. Is it actually interactive and does it actually matter? in: Interactive Sound and Music: Beyond Pressing Play Routledge.

Introduction
Harrison, L. 2025. Introduction. in: Interactive Sound and Music: Beyond Pressing Play Routledge.

Interactive Sound and Music: Beyond Pressing Play
Harrison, L.A. 2025. Interactive Sound and Music: Beyond Pressing Play. Focal Press.

Research Methods in Live Electronic Music and Audio-Visual Performance
Hermes, K. 2025. Research Methods in Live Electronic Music and Audio-Visual Performance. in: Dines, M., Rambarran, S. and Dylan-Smith, G. (ed.) The Intellect Handbook of Popular Music Methodologies London, UK Intellect.

Telharmonium (WIP Performance)
Harrison, L. 2024. Telharmonium (WIP Performance).

Nyokee Mainstage Performance at Hyper Japan
Hermes, K. 2024. Nyokee Mainstage Performance at Hyper Japan. London 18 2024 - 20 Jul 2025

Still Lives
Lost Text/Found Space, Harrison, L., McCutcheon, R. and Rebellato, D. 2024. Still Lives. The Old Waiting Room, Peckham Rye 02 - 13 Jul 2024

Blender for Musicians
Hermes, K. 2024. Blender for Musicians. University of Westminster CreaTech Conference. London 10 Jun 2024

Creative Cyborgs: Virtual 3D Characters as Artist Identities for Musicians
Hermes, K. 2024. Creative Cyborgs: Virtual 3D Characters as Artist Identities for Musicians. in: Gullö, Jan-Olof, Hepworth-Sawyer, Russ, Hook, Dave, Marrington, Mark, Paterson, Justin and Toulson, Rob (ed.) Innovation in Music: Adjusting Perspectives Routledge.

Levelling up chiptune: nostalgic retro games console sounds for the ROLI Seaboard
Hermes, K. 2024. Levelling up chiptune: nostalgic retro games console sounds for the ROLI Seaboard. in: Jan-Olof Gullö, Russ Hepworth-Sawyer, Justin Paterson, Rob Toulson and Mark Marrington (ed.) Innovation in Music: Technology and Creativity Focal Press. pp. 237-251

Panel Discussion: Creative Collaboration in the Recording Studio
Hermes, K. 2023. Panel Discussion: Creative Collaboration in the Recording Studio. 154th Audio Engineering Society Convention. Aalto University, Espoo, near Helsinki, Finland 13 - 15 May 2023 Audio Engineering Society Convention.

Nyokee at Anime Electro Night
Hermes, K. 2023. Nyokee at Anime Electro Night. London 13 Jan 2023

Nyokee Mainstage Performance at MAGfest
Hermes, K. 2023. Nyokee Mainstage Performance at MAGfest. Maryland, United States 05 - 08 Jan 2023

Still Lives (Workshop)
Lost Text/Found Space, Harrison, L., McCutcheon, R. and Rebellato, D. 2023. Still Lives (Workshop). The Old Waiting Room, Peckham Rye 17 - 18 Nov 2023

An Unbiased View of AI
Hermes, K. 2023. An Unbiased View of AI. Music and Gaming Festival 2023 (MAGFEST). Maryland, United States 05 - 08 Jan 2023 MAGFest, Inc..

Nyokee Live at Comic Con
Hermes, K. 2022. Nyokee Live at Comic Con. London 28 - 30 Oct 2022

Nyokee Performance at Hyper Japan
Hermes, K. 2022. Nyokee Performance at Hyper Japan. London 21 - 23 Jul 2023

Machines on Stage: Approaches to Performing Electronic Music Live
Hermes, K. 2022. Machines on Stage: Approaches to Performing Electronic Music Live. Audio Engineering Society.

Creating Interactive Sound
Harrison, L. 2022. Creating Interactive Sound. Lighthouse (ed.) Women in Music: Arte Sônica Amplificada. Online across Brazil Apr 2022

8-bit Music on Twitch: How the Chiptune Scene Thrived During the Pandemic
Hermes, K. 2022. 8-bit Music on Twitch: How the Chiptune Scene Thrived During the Pandemic. Dancecult: Journal of Electronic Dance Music Culture. 14 (1). https://doi.org/10.12801/1947-5403.2022.14.01.07

Performing Electronic Music Live
Hermes, K. 2022. Performing Electronic Music Live. Abingdon, UK Routledge.

Nyokee Performance at Develop Brighton
Hermes, K. 2021. Nyokee Performance at Develop Brighton. Brighton 26 - 27 Oct 2021

Performing Electronic Music Live - video tutorial series
Hermes, K. 2021. Performing Electronic Music Live - video tutorial series.

Bridging the Technical Divide: Techniques for effective communication with artists
Harrison, L., Britton, N., Chatterley, A. and Russell, M. 2021. Bridging the Technical Divide: Techniques for effective communication with artists. AES Spring Show. Online 25 - 28 May 2021 Audio Engineering Society.

Guiding Audiences with Sound: Techniques for interactive and games audio.
Harrison, L. 2021. Guiding Audiences with Sound: Techniques for interactive and games audio. AES Spring Show. Online 25 - 28 May 2021 Audio Engineering Society.

Music and Sound in Virtual/Augmented Realities-Questions, Challenges and Approaches A Multidisciplinary Roundtable
Summer, T., Cook, J., Famer, W., Ferrè, E.R., Harrison, L., Hemming, R., Nescu, A.I., Reed, L., Roberts, F., Stevens, R., Tatlow, S. and Whittaker, L. 2021. Music and Sound in Virtual/Augmented Realities-Questions, Challenges and Approaches A Multidisciplinary Roundtable. Journal of Sound and Music in Games. 2 (2), pp. 63-83. https://doi.org/10.1525/jsmg.2021.2.2.63

Teaching Principles of Interactive Sound
Harrison, L A. 2021. Teaching Principles of Interactive Sound. in: Stevens, B. (ed.) Teaching Electronic Music Routledge. pp. 90-102

8-BIT MUSIC ON TWITCH: How the Chiptune Scene is Overcoming the Pandemic
Hermes, K. 2021. 8-BIT MUSIC ON TWITCH: How the Chiptune Scene is Overcoming the Pandemic . Dancecult Conference 2021. Online 15 - 17 Sep 2021

Creative Considerations for On-Screen Visuals in Popular Electronic Music Performances
Hermes, K. 2021. Creative Considerations for On-Screen Visuals in Popular Electronic Music Performances. in: Hepworth-Sawyer, R., Paterson, J. and Toulson, R. (ed.) Innovation In Music: Future Opportunities London, UK Routledge.

Guiding Audiences with Sound
Harrison, L. 2020. Guiding Audiences with Sound. Lighthouse (ed.) The Space in Sound. Online Sep 2020

The Living Library
Seadog Theatre, Harrison, L., Bridges, L, Slade, E. and Trower, S. 2020. The Living Library.

The Living Library
Seadog Theatre, Harrison, L., Bridges, L., Slade, E. and Trower, S. 2020. The Living Library. Sinespace

Creating Interactive Sound
Harrison, L. 2019. Creating Interactive Sound. Women in Music: Arte Sônica Amplificada. Online across Brazil Apr 2022

Principles of gaming sound in interactive and immersive theatre
Harrison, L. 2019. Principles of gaming sound in interactive and immersive theatre. Ludo2019. Leeds Beckett 26 - 28 Apr 2019

Factors influencing the spectral clarity of vocals in music mixes
Hermes, K. 2019. Factors influencing the spectral clarity of vocals in music mixes. Loughran, R. and Angus-Whiteoak, J. (ed.) Audio Engineering Society 146th Convention. Dublin 20 - 23 Mar 2019 Audio Engineering Society. https://doi.org/10.17743/aesconv.2019.978-1-942220-26-8

Enhancing creativity through automatic mixing research: testing spectral clarity predictors in the mix process
Hermes, K. 2019. Enhancing creativity through automatic mixing research: testing spectral clarity predictors in the mix process. in: Gullö, J.O. (ed.) Proceedings of the 12th Art of Record Production Conference Mono: Stereo: Multi – Stockholm 2017 Stockholm, Sweden Royal College of Music (KMH) & Art of Record Production. pp. 155-170

Optimizing vocal clarity in the mix
Hermes, K. 2019. Optimizing vocal clarity in the mix. in: Hepworth-Sawyer, R., Hodgson, J., Paterson, J. and Toulson, R. (ed.) Innovation in Music: Performance, Production, Technology, and Business UK Routledge.

Memories of Fiction: The Living Library
Harrison, L. 2018. Memories of Fiction: The Living Library.

Control, collaboration and audience engagement in interactive sound installations
Harrison, L. 2018. Control, collaboration and audience engagement in interactive sound installations. PhD thesis Royal Holloway, University of London Music

Creativity, Collaboration and Workflow in Ableton
Boon, H., Gooderson, M. and Hermes, K. 2017. Creativity, Collaboration and Workflow in Ableton. Truman Brewery 29 - 31 Jan 2021

Til We Meet in England
Lost Text/Found Space, McCutcheon, R. and Harrison, L. 2017. Til We Meet in England.

Parameters of high quality mixes: EQ and spectral clarity
Hermes, K. 2017. Parameters of high quality mixes: EQ and spectral clarity.

Parameters of high quality mixes: EQ and spectral clarity
Hermes, K. 2017. Parameters of high quality mixes: EQ and spectral clarity.

Creativity, Collaboration and Workflow in Ableton
Hermes, K., Boon, H. and Gooderson, M. 2017. Creativity, Collaboration and Workflow in Ableton.

A Testimony and a Silence
Lost Text/Found Space, McCutcheon, R. and Harrison, L. 2016. A Testimony and a Silence.

Lives, loves and loss: Traces at Fenton House
Traces and Harrison, L. 2016. Lives, loves and loss: Traces at Fenton House.

The harmonic centroid as predictor of single sound spectral clarity
Hermes, K. 2016. The harmonic centroid as predictor of single sound spectral clarity.

The harmonic centroid as a predictor of string instrument timbral clarity
Hermes, K., Brookes, T. and Hummersone, C. 2016. The harmonic centroid as a predictor of string instrument timbral clarity. Audio Engineering Society Convention. Paris, France 04 - 07 Jun 2016 Audio Engineering Society.

The harmonic centroid as predictor of single sound spectral clarity
Hermes, K., Brookes, T. and Hummersone, C. 2015. The harmonic centroid as predictor of single sound spectral clarity.

The Influence of Dumping Bias on Timbral Clarity Ratings
Hermes, K., Brookes, T. and Hummersone, C. 2015. The Influence of Dumping Bias on Timbral Clarity Ratings. 139th Audio Engineering Society Convention. New York, USA 29 Oct - 01 Nov 2015 Audio Engineering Society.

That I will do my best...
Harrison, L. 2014. That I will do my best... Alexandra Palace 22 - 23 Feb 2014

The Wind Singer
Harrison, L. 2013. The Wind Singer. Girlguiding ICANDO, London Apr 2013

Mariam at Burford: Youth and Young Girlhood
Lost Text/Found Space, McCutcheon, R. and Harrison, L. 2013. Mariam at Burford: Youth and Young Girlhood.

Cary: The Mariam Cycles
Lost Text/Found Space, McCutcheon, R. and Harrison, L. 2013. Cary: The Mariam Cycles.

Permalink - https://westminsterresearch.westminster.ac.uk/item/x751y/twinning-fyvie-hall-audience-data-generative-organ-performance-and-social-vr


Share this

Usage statistics

3 total views
2 total downloads
These values cover views and downloads from WestminsterResearch and are for the period from September 2nd 2018, when this repository was created.