A position paper on 'Living Laboratories': rethinking ecological designs and experimentation in human-computer interaction
HCI has long moved beyond the evaluation of a single user sitting in front of a single desktop computer, yet many of our fundamentally held viewpoints about evaluation continues to be ruled by outdated biases derived from this legacy.
We need to engage with real users in 'Living Laboratories', in which researchers either adopt or create real systems that are used in real settings. These new experimental platforms will greatly enable researchers to conduct evaluations that span many users, places, time, location, and social factors in ways that are unimaginable before.
Chi, E. H. A position paper on 'Living Laboratories': rethinking ecological designs and experimentation in human computer interaction. Proceedings of HCI International 2009; 2009 July 19-24; San Diego, CA. Berlin: Springer; 2009; LNCS 5610: 597-605.