Augmented Vision and Quality of Experience Assessment: Towards a Unified Evaluation Framework

In this paper, we address the need to standardize testing for new display modalities in upcoming media consumption scenarios. Specifically, we consider commercially available optical see-through devices, typically employed by operators in augmented vision or augmented reality scenarios. Based on current multimedia evaluation frameworks commonly applied to determine the subjective quality of experience, we extrapolate onto the additional environmental challenges provided by the overlay of media content with real-world backgrounds. We derive an overall framework of configurations and metrics that should be part of subjective quality assessment studies and be incorporated into future databases to provide a high quality ground truth foundation for long-term applicability. We present an exemplary experimental setup with related components currently in use to perform human subject experiments for this domain.