Macquarrie, Andrew and Steed, Anthony (2020) Exploring the use of skeletal tracking for cheaper motion graphs and on-set decision making in Free-Viewpoint Video production. In: CVMP '20: European Conference on Visual Media Production. Virtual Event, United Kingdom. December 7 - 8 2020. Association for Computing Machinery (ACM), New York, United States, pp. 1-10. ISBN 978-1450381987 (doi:https://doi.org/10.1145/3429341.3429353)

Preview

PDF (AAM) 35111_MacQUARRIE_Exploring_the_use_of_skeletal_tracking.pdf - Accepted Version Available under License Creative Commons Attribution No Derivatives. Download (5MB) | Preview

Abstract

In free-viewpoint video (FVV), the motion and surface appearance of a real-world performance is captured as an animated mesh. While this technology can produce high-fidelity recreations of actors, the required 3D reconstruction step has substantial processing demands. This means FVV experiences are currently expensive to produce, and the processing delay means on-set decisions are hampered by a lack of feedback. This work explores the possibility of using RGB-camera-based skeletal tracking to reduce the amount of content that must be 3D reconstructed, as well as aiding on-set decision making. One particularly relevant application is in the construction of Motion Graphs, where state-of-the-art techniques require large amounts of content to be 3D reconstructed before a graph can be built, resulting in large amounts of wasted processing effort. Here, we propose the use of skeletons to assess which clips of FVV content to process, resulting in substantial cost savings with a limited impact on performance accuracy. Additionally, we explore how this technique could be utilised on set to reduce the possibility of requiring expensive reshoots.

Item Type:	Conference Proceedings
Title of Proceedings:	CVMP '20: European Conference on Visual Media Production. Virtual Event, United Kingdom. December 7 - 8 2020
Additional Information:	For the purpose of open access, the author has applied a ‘Creative Commons Attribution (CC BY) licence (where permitted by UKRI, ‘Open Government Licence’ or ‘Creative Commons Attribution No-derivatives (CC BY-ND) licence’ may be stated instead) to any Author Accepted Manuscript version arising.
Uncontrolled Keywords:	shape analysis, free-viewpoint video production
Subjects:	N Fine Arts > N Visual arts (General) For photography, see TR Q Science > QA Mathematics > QA75 Electronic computers. Computer science Q Science > QA Mathematics > QA76 Computer software
Faculty / School / Research Centre / Research Group:	Faculty of Engineering & Science Faculty of Engineering & Science > School of Computing & Mathematical Sciences (CMS)
Related URLs:	Publisher
Last Modified:	04 Mar 2022 13:06
URI:	http://gala.gre.ac.uk/id/eprint/35111

Actions (login required)

View Item

Downloads