2
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Form2Fit: Learning Shape Priors for Generalizable Assembly from Disassembly

      Preprint
      , , ,

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Is it possible to learn policies for robotic assembly that can generalize to new objects? We explore this idea in the context of the kit assembly task. Since classic methods rely heavily on object pose estimation, they often struggle to generalize to new objects without 3D CAD models or task-specific training data. In this work, we propose to formulate the kit assembly task as a shape matching problem, where the goal is to learn a shape descriptor that establishes geometric correspondences between object surfaces and their target placement locations from visual input. This formulation enables the model to acquire a broader understanding of how shapes and surfaces fit together for assembly -- allowing it to generalize to new objects and kits. To obtain training data for our model, we present a self-supervised data-collection pipeline that obtains ground truth object-to-placement correspondences by disassembling complete kits. Our resulting real-world system, Form2Fit, learns effective pick and place strategies for assembling objects into a variety of kits -- achieving \(90\%\) average success rates under different initial conditions (e.g. varying object and kit poses), \(94\%\) success under new configurations of multiple kits, and over \(86\%\) success with completely new objects and kits.

          Related collections

          Author and article information

          Journal
          30 October 2019
          Article
          1910.13675
          1b98090f-2904-4293-9ef6-35b701253630

          http://arxiv.org/licenses/nonexclusive-distrib/1.0/

          History
          Custom metadata
          Code, videos, and supplemental material are available at https://form2fit.github.io/
          cs.RO cs.CV cs.LG

          Computer vision & Pattern recognition,Robotics,Artificial intelligence
          Computer vision & Pattern recognition, Robotics, Artificial intelligence

          Comments

          Comment on this article