Skip navigation

AVUI: Designing a toolkit for audiovisual interfaces

AVUI: Designing a toolkit for audiovisual interfaces

Correia, Nuno N. ORCID: 0000-0002-9999-9162 and Tanaka, Atau (2017) AVUI: Designing a toolkit for audiovisual interfaces. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. CHI '17 . ACM, New York, NY, USA, pp. 1093-1104. ISBN 978-1-4503-4655-9 (doi:https://doi.org/10.1145/3025453.3026042)

[img]
Preview
PDF (Author Accepted Manuscript)
20966 CORREIA_Designing_a_Toolkit_2017.pdf - Accepted Version

Download (5MB) | Preview

Abstract

The combined use of sound and image has a rich history, from audiovisual artworks to research exploring the potential of data visualization and sonification. However, we lack standard tools or guidelines for audiovisual (AV) interaction design, particularly for live performance. We propose the AVUI (AudioVisual User Interface), where sound and image are used together in a cohesive way in the interface; and an enabling technology, the ofxAVUI toolkit. AVUI guidelines and ofxAVUI were developed in a three-stage process, together with AV producers: 1) participatory design activities; 2) prototype development; 3) encapsulation of prototype as a plug-in, evaluation, and roll out. Best practices identified include: reconfigurable interfaces and mappings; object-oriented packaging of AV and UI; diverse sound visualization; flexible media manipulation and management. The toolkit and a mobile app developed using it have been released as open-source. Guidelines and toolkit demonstrate the potential of AVUI and offer designers a convenient framework for AV interaction design.

Item Type: Conference Proceedings
Title of Proceedings: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
Additional Information: Conference held from 06 - 11 May 2017, Denver, Colorado, USA.
Uncontrolled Keywords: User interface; toolkit; interface builder; audiovisual; crossmodal interaction; prototyping; participatory design; interaction design; hackathons
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Faculty / Department / Research Group: Faculty of Liberal Arts & Sciences
Faculty of Liberal Arts & Sciences > Department of Computing & Information Systems
Last Modified: 25 Oct 2019 15:11
Selected for GREAT 2016: None
Selected for GREAT 2017: None
Selected for GREAT 2018: None
Selected for GREAT 2019: GREAT 1
URI: http://gala.gre.ac.uk/id/eprint/20966

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics