1,364
views
0
recommends
+1 Recommend
1 collections
    0
    shares

      Celebrating 65 years of The Computer Journal - free-to-read perspectives - bcs.org/tcj65

      scite_
       
      • Record: found
      • Abstract: found
      • Conference Proceedings: found
      Is Open Access

      Wizard of Oz Experiments and Companion Dialogues

      proceedings-article
      , , ,
      Proceedings of HCI 2010 (HCI)
      Human Computer Interaction
      6 - 10 September 2010
      Wizard of Oz, Companions, Dialogue Systems
      Bookmark

            Abstract

            Novel speech systems such as the conversational agents being developed by the Companions Project ( www.companions-project.org ) can be simulated using the Wizard of Oz methodology. In this approach technologies that are not yet ready for testing by people are replaced by a human, both for prototyping and collecting additional dialogue data. In the case of Companions we want to observe what it would be like for people interact with a fully functional embodied conversational agent (ECA) and to collect samples of typical dialogue in order to explore, evaluate and model dialogue strategies. One controversial aspect of the Wizard of Oz approach is whether people should be aware that they are interacting with a simulation or whether they should be “fooled” into thinking they are interacting with a real system. Clearly there are ethical issues involved in fooling people, but some argue that unless the participant believes the simulation to be real, the results of any experimentation will not be applicable to the real situation. Over the course of several previous Wizard of Oz experiments our observations suggest that the dialogues produced do not significantly differ whether the participants know that the technology is faked or not. This hypothesis was investigated by collecting dialogues from two groups of participants. One group of participants believed that the Wizard of Oz speech system was in fact a fully computerised prototype and the other group knew that they would be talking through the interface to a hidden person (the wizard). The dialogues were analysed for differences attributable to the participants’ beliefs about the system. This analysis was undertaken by an independent “blind” reviewer, a dialogue expert who attempted to allocate participants to one group or the other. His guess was wrong for four out of the six participants. Thus it appears that whether people believe they are interacting with a real system or not does not effect the dialogues and other factors, for example the personality of the person engaged in a dialogue with an ECA, are more important.

            Content

            Author and article information

            Contributors
            Conference
            September 2010
            September 2010
            : 117-123
            Affiliations
            [0001]Edinburgh Napier University

            School of Computing, Edinburgh, UK
            [0002]ILS Institute

            SUNY Albany, Albany, USA
            Article
            10.14236/ewic/HCI2010.16
            9821014d-c108-43f2-9874-234ed9e2b407
            © Jay Bradley et al. Published by BCS Learning and Development Ltd. Proceedings of HCI 2010, University of Abertay, Dundee, UK

            This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

            Proceedings of HCI 2010
            HCI
            24
            University of Abertay, Dundee, UK
            6 - 10 September 2010
            Electronic Workshops in Computing (eWiC)
            Human Computer Interaction
            History
            Product

            1477-9358 BCS Learning & Development

            Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2010.16
            Self URI (journal page): https://ewic.bcs.org/
            Categories
            Electronic Workshops in Computing

            Applied computer science,Computer science,Security & Cryptology,Graphics & Multimedia design,General computer science,Human-computer-interaction
            Companions,Wizard of Oz,Dialogue Systems

            Comments

            Comment on this article