Correia, Nuno N. ORCID: https://orcid.org/0000-0002-9999-9162 and Tanaka, Atau (2017) AVUI: Designing a toolkit for audiovisual interfaces. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. CHI '17 . ACM, New York, NY, USA, pp. 1093-1104. ISBN 978-1-4503-4655-9 (doi:10.1145/3025453.3026042)

Preview

PDF (Author Accepted Manuscript) 20966 CORREIA_Designing_a_Toolkit_2017.pdf - Accepted Version Download (5MB) | Preview

Abstract

The combined use of sound and image has a rich history, from audiovisual artworks to research exploring the potential of data visualization and sonification. However, we lack standard tools or guidelines for audiovisual (AV) interaction design, particularly for live performance. We propose the AVUI (AudioVisual User Interface), where sound and image are used together in a cohesive way in the interface; and an enabling technology, the ofxAVUI toolkit. AVUI guidelines and ofxAVUI were developed in a three-stage process, together with AV producers: 1) participatory design activities; 2) prototype development; 3) encapsulation of prototype as a plug-in, evaluation, and roll out. Best practices identified include: reconfigurable interfaces and mappings; object-oriented packaging of AV and UI; diverse sound visualization; flexible media manipulation and management. The toolkit and a mobile app developed using it have been released as open-source. Guidelines and toolkit demonstrate the potential of AVUI and offer designers a convenient framework for AV interaction design.

Item Type:	Conference Proceedings
Title of Proceedings:	Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
Additional Information:	Conference held from 06 - 11 May 2017, Denver, Colorado, USA.
Uncontrolled Keywords:	User interface; toolkit; interface builder; audiovisual; crossmodal interaction; prototyping; participatory design; interaction design; hackathons
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Faculty / School / Research Centre / Research Group:	Faculty of Engineering & Science > School of Computing & Mathematical Sciences (CMS) Faculty of Engineering & Science
Last Modified:	04 Mar 2022 13:07
URI:	http://gala.gre.ac.uk/id/eprint/20966

Actions (login required)

View Item

Downloads