Blog
About

0
views
0
recommends
+1 Recommend
1 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      The k conditional nearest neighbor algorithm for classification and class probability estimation

      1 , 2 , 2

      PeerJ Computer Science

      PeerJ

      Read this article at

      ScienceOpenPublisher
      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          The k nearest neighbor (kNN) approach is a simple and effective nonparametric algorithm for classification. One of the drawbacks of kNN is that the method can only give coarse estimates of class probabilities, particularly for low values of k. To avoid this drawback, we propose a new nonparametric classification method based on nearest neighbors conditional on each class: the proposed approach calculates the distance between a new instance and the kth nearest neighbor from each class, estimates posterior probabilities of class memberships using the distances, and assigns the instance to the class with the largest posterior. We prove that the proposed approach converges to the Bayes classifier as the size of the training data increases. Further, we extend the proposed approach to an ensemble method. Experiments on benchmark data sets show that both the proposed approach and the ensemble version of the proposed approach on average outperform kNN, weighted kNN, probabilistic kNN and two similar algorithms (LMkNN and MLM-kHNN) in terms of the error rate. A simulation shows that kCNN may be useful for estimating posterior probabilities when the class distributions overlap.

          Related collections

          Most cited references 20

          • Record: found
          • Abstract: not found
          • Article: not found

          Individual Comparisons by Ranking Methods

            Bookmark
            • Record: found
            • Abstract: not found
            • Book: not found

            The Nature of Statistical Learning Theory

              Bookmark
              • Record: found
              • Abstract: not found
              • Article: not found

              Shape matching and object recognition using shape contexts

                Bookmark

                Author and article information

                Journal
                PeerJ Computer Science
                PeerJ
                2376-5992
                2019
                May 13 2019
                : 5
                : e194
                Affiliations
                [1 ]University of Western Ontario, London, Canada
                [2 ]University of Waterloo, Waterloo, Canada
                Article
                10.7717/peerj-cs.194
                © 2019

                http://creativecommons.org/licenses/by/4.0/

                Product
                Self URI (article page): https://peerj.com/articles/cs-194

                Comments

                Comment on this article