6
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Review of Stereo Matching Algorithms Based on Deep Learning

      review-article
      1 , 2 , 3 , 2 , 4 ,
      Computational Intelligence and Neuroscience
      Hindawi

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Stereo vision is a flourishing field, attracting the attention of many researchers. Recently, leveraging on the development of deep learning, stereo matching algorithms have achieved remarkable performance far exceeding traditional approaches. This review presents an overview of different stereo matching algorithms based on deep learning. For convenience, we classified the algorithms into three categories: (1) non-end-to-end learning algorithms, (2) end-to-end learning algorithms, and (3) unsupervised learning algorithms. We have provided a comprehensive coverage of the remarkable approaches in each category and summarized the strengths, weaknesses, and major challenges, respectively. The speed, accuracy, and time consumption were adopted to compare the different algorithms.

          Related collections

          Most cited references60

          • Record: found
          • Abstract: found
          • Article: not found

          Stereo processing by semiglobal matching and mutual information.

          This paper describes the Semi-Global Matching (SGM) stereo method. It uses a pixelwise, Mutual Information based matching cost for compensating radiometric differences of input images. Pixelwise matching is supported by a smoothness constraint that is usually expressed as a global cost function. SGM performs a fast approximation by pathwise optimizations from all directions. The discussion also addresses occlusion detection, subpixel refinement and multi-baseline matching. Additionally, postprocessing steps for removing outliers, recovering from specific problems of structured environments and the interpolation of gaps are presented. Finally, strategies for processing almost arbitrarily large images and fusion of disparity images using orthographic projection are proposed.A comparison on standard stereo images shows that SGM is among the currently top-ranked algorithms and is best, if subpixel accuracy is considered. The complexity is linear to the number of pixels and disparity range, which results in a runtime of just 1-2s on typical test images. An in depth evaluation of the Mutual Information based matching cost demonstrates a tolerance against a wide range of radiometric transformations. Finally, examples of reconstructions from huge aerial frame and pushbroom images demonstrate that the presented ideas are working well on practical problems.
            Bookmark
            • Record: found
            • Abstract: not found
            • Conference Proceedings: not found

            FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks

              Bookmark
              • Record: found
              • Abstract: not found
              • Conference Proceedings: not found

              Unsupervised Monocular Depth Estimation with Left-Right Consistency

                Bookmark

                Author and article information

                Contributors
                Journal
                Comput Intell Neurosci
                Comput Intell Neurosci
                CIN
                Computational Intelligence and Neuroscience
                Hindawi
                1687-5265
                1687-5273
                2020
                23 March 2020
                : 2020
                : 8562323
                Affiliations
                1School of Mathematics Science, Peking University, Beijing, China
                2Suzhou Automotive Research Institute, Tsinghua University, Beijing, China
                3Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of Nuclear Medicine, Peking University Cancer Hospital & Institute, Beijing, China
                4Su Zhou Automobile Research Institute, Suzhou, Jiangsu, China
                Author notes

                Academic Editor: Cornelio Yáñez-Márquez

                Author information
                https://orcid.org/0000-0002-7589-450X
                https://orcid.org/0000-0001-5114-3771
                Article
                10.1155/2020/8562323
                7125450
                32273887
                5e5dbd37-e615-4534-82f0-2eed10fe1125
                Copyright © 2020 Kun Zhou et al.

                This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

                History
                : 27 May 2019
                : 16 September 2019
                : 8 October 2019
                Funding
                Funded by: China Postdoctoral Science Foundation
                Categories
                Review Article

                Neurosciences
                Neurosciences

                Comments

                Comment on this article