Do Nascimento Correia, Nuno ORCID: https://orcid.org/0000-0002-9999-9162 and Tanaka, Atau (2021) From GUI to AVUI: situating audiovisual user interfaces within human-computer interaction and related fields. EAI Endorsed Transactions on Creative Technologies, 8 (27):e5. ISSN 2409-9708 (doi:10.4108/eai.12-5-2021.169913)

Preview

PDF (Open Access Article) 32738 CORREIA_From_GUI_To_AVUI_(OA)_2021.pdf - Published Version Available under License Creative Commons Attribution. Download (1MB) | Preview

Abstract

INTRODUCTION: We propose AudioVisual User Interfaces (AVUI), a novel type of UI linking interaction, sound and image. It extends the concept of Graphical User Interface (GUI) by adding interconnected sound and image.

OBJECTIVES: We aim to situate AVUIs in relation to identified relevant fields: Human-Computer Interaction (HCI), sonic interaction design, cognitive psychology and audiovisual art, and to identify benefits of AVUIs in the context of those fields.

METHODS: In this research, we combine literature review of related concepts with a user-centered design methodology, involving a community of audiovisual artists and performers.
RESULTS: We contextualize AVUI within the identified fields and identify benefits for the implementation of AVUIs in relation to those fields.

CONCLUSION: These results can contribute to the further adoption of AVUIs by the HCI community, particularly those interested in multisensory experience involving sound and image.

Item Type:	Article
Uncontrolled Keywords:	user interface, toolkit, interface builder, audiovisual, cross-modal interaction
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Faculty / School / Research Centre / Research Group:	Faculty of Engineering & Science Faculty of Engineering & Science > School of Computing & Mathematical Sciences (CMS)
Last Modified:	23 May 2022 10:33
URI:	http://gala.gre.ac.uk/id/eprint/32738

Actions (login required)

View Item

Downloads