Towards Multimodal Exploratory Data Analysis: SoniScope as a Prototypical Implementation

Title (en)
Towards Multimodal Exploratory Data Analysis: SoniScope as a Prototypical Implementation
Language
English
Description (en)
The metaphor of auscultating with a stethoscope can be an inspiration to combine visualization and sonification for exploratory data analysis. This paper presents SoniScope, a multimodal approach and its prototypical implementation based on this metaphor. It combines a scatterplot with an interactive parameter mapping sonification, thereby conveying additional information about items that were selected with a visual lens. SoniScope explores several design options for the shape of its lens and the sorting of the selected items for subsequent sonification. Furthermore, the open-source prototype serves as a blueprint framework for how to combine D3.js visualization and SuperCollider sonification in the Jupyter notebook environment.
Keywords (en)
based input / output
Sound
Auditory feedback
Visualization systems and tools
Human centered computing
ISBN
978-3-03868-184-7
HTTP/WWW
https://diglib.eg.org:443/handle/10.2312/evs20221095
HTTP/WWW
https://doi.org/10.2312/evs.20221095
DOI
10.2312/evs.20221095
Author of the digital object
KajetanEnge (St. Pölten University of Applied Sciences)
AlexanderRind (St. Pölten University of Applied Sciences)
MichaelIber (St. Pölten University of Applied Sciences)
RobertHöldrich (University of Music and Performing Arts Graz)
WolfgangAigner (St. Pölten University of Applied Sciences)
Licence Selected
Description or Additional Data (en)
© 2022 The Author(s) Eurographics Proceedings © 2022 The Eurographics Association.
Name of Publication (en)
EuroVisShort2022
Publisher
The Eurographics Association
Publication Date
2022