THE DESIGN OF A SMART CITY SONIFICATION SYSTEM USING A CONCEPTUAL BLENDING AND MUSICAL FRAMEWORK, WEB AUDIO AND DEEP LEARNING TECHNIQUES
Citation:
Stephen Roddy & Brian Bridges, THE DESIGN OF A SMART CITY SONIFICATION SYSTEM USING A CONCEPTUAL BLENDING AND MUSICAL FRAMEWORK, WEB AUDIO AND DEEP LEARNING TECHNIQUES, The 26th International Conference on Auditory Display (ICAD 2021), Virtual Conference, 25 28 June 2021, 21, 2021Download Item:
Abstract:
This paper describes an auditory display system for smart
city data for Dublin City, Ireland. It introduces and describes
the different layers of the system and outlines how they
operate individually and interact with one another. The
system uses a deep learning model called a variational
autoencoder to generate musical content to represent data
points. Further data-to-sound mappings are introduced via
parameter mapping sonification techniques during sound
synthesis and post-processing. Conceptual blending and
music theory provide frameworks, which govern the design
of the system. The paper ends with a discussion of the design
process that contextualizes the contribution, highlighting the
interdisciplinary nature of the project, which spans data
analytics, music composition and human-computer
interaction.
Sponsor
Grant Number
Science Foundation Ireland (SFI)
13/RC/2077
Irish Research Council (IRC)
Author's Homepage:
http://people.tcd.ie/stroddy
Author: Roddy, Stephen
Other Titles:
The 26th International Conference on Auditory Display (ICAD 2021)Type of material:
Conference PaperSeries/Report no:
21;Availability:
Full text availableLicences: