31
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      A Bayesian Developmental Approach to Robotic Goal-Based Imitation Learning

      research-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          A fundamental challenge in robotics today is building robots that can learn new skills by observing humans and imitating human actions. We propose a new Bayesian approach to robotic learning by imitation inspired by the developmental hypothesis that children use self-experience to bootstrap the process of intention recognition and goal-based imitation. Our approach allows an autonomous agent to: (i) learn probabilistic models of actions through self-discovery and experience, (ii) utilize these learned models for inferring the goals of human actions, and (iii) perform goal-based imitation for robotic learning and human-robot collaboration. Such an approach allows a robot to leverage its increasing repertoire of learned behaviors to interpret increasingly complex human actions and use the inferred goals for imitation, even when the robot has very different actuators from humans. We demonstrate our approach using two different scenarios: (i) a simulated robot that learns human-like gaze following behavior, and (ii) a robot that learns to imitate human actions in a tabletop organization task. In both cases, the agent learns a probabilistic model of its own actions, and uses this model for goal inference and goal-based imitation. We also show that the robotic agent can use its probabilistic model to seek human assistance when it recognizes that its inferred actions are too uncertain, risky, or impossible to perform, thereby opening the door to human-robot collaboration.

          Related collections

          Most cited references29

          • Record: found
          • Abstract: found
          • Article: not found

          How to grow a mind: statistics, structure, and abstraction.

          In coming to understand the world-in learning concepts, acquiring language, and grasping causal relations-our minds make inferences that appear to go far beyond the data available. How do we do it? This review describes recent approaches to reverse-engineering human learning and cognitive development and, in parallel, engineering more humanlike machine learning systems. Computational models that perform probabilistic inference over hierarchies of flexibly structured representations can address some of the deepest questions about the nature and origins of human thought: How does abstract knowledge guide learning and reasoning from sparse data? What forms does our knowledge take, across different domains and tasks? And how is that abstract knowledge itself acquired?
            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            Understanding the Intentions of Others: Re-Enactment of Intended Acts by 18-Month-Old Children.

            Investigated was whether children would re-enact what an adult actually did or what the adult intended to do. In Experiment 1 children were shown an adult who tried, but failed, to perform certain target acts. Completed target acts were thus not observed. Children in comparison groups either saw the full target act or appropriate controls. Results showed that children could infer the adult's intended act by watching the failed attempts. Experiment 2 tested children's understanding of an inanimate object that traced the same movements as the person had followed. Children showed a completely different reaction to the mechanical device than to the person: They did not produce the target acts in this case. Eighteen-month-olds situate people within a psychological framework that differentiates between the surface behavior of people and a deeper level involving goals and intentions. They have already adopted a fundamental aspect of folk psychology-persons (but not inanimate objects) are understood within a framework involving goals and intentions.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              Is imitation learning the route to humanoid robots?

              This review investigates two recent developments in artificial intelligence and neural computation: learning from imitation and the development of humanoid robots. It is postulated that the study of imitation learning offers a promising route to gain new insights into mechanisms of perceptual motor control that could ultimately lead to the creation of autonomous humanoid robots. Imitation learning focuses on three important issues: efficient motor learning, the connection between action and perception, and modular motor control in the form of movement primitives. It is reviewed here how research on representations of, and functional connections between, action and perception have contributed to our understanding of motor acts of other beings. The recent discovery that some areas in the primate brain are active during both movement perception and execution has provided a hypothetical neural basis of imitation. Computational approaches to imitation learning are also described, initially from the perspective of traditional AI and robotics, but also from the perspective of neural network models and statistical-learning research. Parallels and differences between biological and computational approaches to imitation are highlighted and an overview of current projects that actually employ imitation learning for humanoid robots is given.
                Bookmark

                Author and article information

                Contributors
                Role: Editor
                Journal
                PLoS One
                PLoS ONE
                plos
                plosone
                PLoS ONE
                Public Library of Science (San Francisco, CA USA )
                1932-6203
                2015
                4 November 2015
                : 10
                : 11
                : e0141965
                Affiliations
                [1 ]Department of Computer Science & Engineering, University of Washington, Seattle, WA, United States of America
                [2 ]Institute for Learning & Brain Sciences, University of Washington, Seattle, WA, United States of America
                Centre for Coevolution of Biology & Culture, University of Durham, UNITED KINGDOM
                Author notes

                Competing Interests: The Intel Science and Technology Center, Seattle, is included in the list of acknowledgments due to their assistance with the project. This does not alter the authors’ adherence to PLOS ONE policies on sharing data and materials.

                Conceived and designed the experiments: RR MC AF AM DF. Performed the experiments: MC AF. Analyzed the data: MC AF. Contributed reagents/materials/analysis tools: MC AF. Wrote the paper: RR MC AF AM DF.

                Article
                PONE-D-15-03288
                10.1371/journal.pone.0141965
                4633237
                26536366
                114bd688-4867-4f8d-82ac-e8ee129a7c37
                Copyright @ 2015

                This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited

                History
                : 22 January 2015
                : 15 October 2015
                Page count
                Figures: 8, Tables: 1, Pages: 18
                Funding
                This work was supported by Office of Naval Research (ONR) Science of Autonomy, grant no. N000141310817, http://www.onr.navy.mil/; Office of Naval Research (ONR) Cognitive Science program, grant no. N000140910097, http://www.onr.navy.mil/; National Science Foundation (NSF), NSF grant no. SMA-1540619 and NSF grant no. IIS-1318733, http://www.nsf.gov/; Intel Science and Technology Center (ISTC), Seattle; and (NSERC) fellowship to A. Friesen, http://www.nserc-crsng.gc.ca/index_eng.asp. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
                Categories
                Research Article
                Custom metadata
                The data and code for this paper are now available on github as follows: Robot data: https://github.com/mjyc/chung2015plosone_robot_data. Matlab code: https://github.com/afriesen/gpgaze.

                Uncategorized
                Uncategorized

                Comments

                Comment on this article